Lead Data Engineer

Newcastle, United Kingdom

Back Apply now

Job Reference 1248018

Location Newcastle, United Kingdom

Date Added August 30, 2024

Lead Data Engineer

Location: Remote (Must be in Europe and right to work in country of residence)

Contract: Initially until the end of the year.

Rate: 400 euros a day gross

Start: ASAP

Key Responsibilities:

Implement the best data engineering tools and practices suited to the customer’s on-premise environment.
Deliver robust, reusable, and maintainable ETL/ELT data pipelines with stable performance.
Improve the operational functionality of existing data pipelines.
Lead and participate in regular code reviews to ensure high-quality standards.
Engage in ongoing knowledge sharing and onboarding sessions.

Required Skills and Experience:

Strong proficiency in Python and extensive experience in ETL/ELT development, orchestration, and maintenance.
Hands-on experience with unit testing of Airflow DAGs and data processing applications.
Expertise in cutting-edge Big Data processing technologies, primarily batch processing with some streaming.
Proven track record in deploying Machine Learning solutions into production.
Deep understanding of data architecture and ability to choose the right tools and solutions for specific needs.
Familiarity with fundamental principles of data visualization.
Proficiency in Apache Airflow, PostgreSQL, S3 object storage, Kafka, and some data visualization tools (Grafana, Superset), and Kubernetes.

Nice to Have Skills:

Knowledge of performance metrics for evaluating ML models.
Familiarity with S3-compatible storage (MinIO), Kafka, Spark, MongoDB or other NoSQL databases, ELK stack, Loki, Apache Superset, and Grafana.
Experience in the telecommunications (Telco) sector is a plus.

Related Jobs

Permanent 21 Nov 2024

São Paulo, Brazil

IT Business Analyst

Airswift is seeking an IT Business Analyst to work on a permanent contract with ...

Airswift is seeking an IT Business Analyst to work on a permanent contract with a major software Company in São Paulo.
As a Business Analyst you will be an inquisitive and strategic thinker who seeks to not only understand the root cause of a business or end user problem/opportunity, but to understand the drivers, asking the right questions at the right time. You will act as a critical friend, collaborating with and enabling stakeholders to make informed decisions based on sound analysis. .
You will work within the Business Analysis Service Framework to deliver a range of services that support the business in IT enabled change. You will also be encouraged to help support the continual progression of the Business Analysis Service, acting as a champion for it, fostering new relationships to build and grow its use and suggesting new ways of working to ensure it remains aligned to the needs of the business.

JOB RESPONSIBILITIES

Undertake analysis to understand how a business area works, considering the people, organization, processes, information, data and technology
Identify and elaborate user and business needs to enable effective design, development and business change
Ensure new solutions and services meet business and user needs, and are aligned with organizational goals
Understand any business and policy constraints that need to be considered, and assess the implications
Identify areas for improvement, explore feasible options, analyze the effects of change and define success measures
Take ownership for improving your own knowledge of business analysis, methods and tools and play an active role within the BA practice and wider community in sharing knowledge and supporting other members

JOB QUALIFICATIONS

Higher Education
Advanced English (required)
Experience working with systems integrators
Experience working with software development tools, such as Azure DevOps, to gather and manage requirements.
Experience in sales-related processes, this covers CRM (Salesforce), ERP (Oracle) and subscription management (Zuora).
BCS Diploma in Business Analysis
IIBA Certified Business Analysis Professional

ABOUT AIRSWIFT
Airswift serves as a strategic partner to our clients in STEM industries. We offer a turnkey workforce solution to acquire, mobilise and employ top talent in over 70 countries. With 800 employees in over 60 offices worldwide, 7,000 contractors and a candidate database of 1.5m specialists, our geographical reach and pool of available talent, experience and expertise is unmatched in the industry. We are proud to serve as a trusted advisor to clients looking to expand their operations internationally and offer employer of record services, payroll outsourcing, as well as HR consulting.

Apply Now

Permanent 2 Dec 2024

Singapore, Singapore

Field Engineer

We are currently partnering with a leading multinational corporation in the ...

We are currently partnering with a leading multinational corporation in the semiconductor front-end equipment manufacturing industry to expand their service engineering team in anticipation of the coming ramp up. This company is well-known for its employment stability and high levels of employee satisfaction, both of which are vital in the dynamic semiconductor industry. I’m excited to share that we have been exclusively awarded paid assignments to fulfil the mandates for 10 Service Engineers.

Responsibilities:

Perform onsite installations, implement continuous improvement programs, conduct parts overhauls, and carry out preventive maintenance, modifications, and repairs on equipment.
Troubleshoot and resolve technical issues related to semiconductor equipment and systems, including computer systems, complex software, and networked or wireless systems.
Coordinate logistics and communicate with customers on equipmentrelated issues.
Address customer complaints and provide timely solutions to resolve their concerns.
Report common customer complaints to management to facilitate future improvements.
Monitor product performance and deliver regular update reports and feedback on customer service requests.

Requirements:

Minimum a Degree or Diploma in Electrical/Electronic/Mechanical/Mechatronic Engineering with at least 2 years of field engineering experience within the semiconductor equipment or machinery space.
Excellent communication and interpersonal skills to interact with customers and stakeholders across all levels.
A highly motivated individual capable of working independently with minimal supervision.

Benefits:

Strong employer branding, top 5 among their competitors.
Attractive compensation and employees’ benefits
New expansion role with visible career prospect and proven job stabilities.

Welcome any application to mike.soh@airswift.com if you are interested to apply, find out more about this job or have anyone to recommend. We regret to inform that due to the high volume of applicants, only shortlisted candidates will be notified. Thank you in for your kind understanding.

Apply Now

Permanent 25 Oct 2024

Luanda, Angola

Accountant:

3 years experience at least, with a high skills in accounting, microsoft office ...

3 years experience at least, with a high skills in accounting, microsoft office and data entry.
Characteristics need to fall in line with the other positions that we requested. Needs to be able to work with big teams and able to adapt and pivot through daily obstacles. problem solving is a very important characteristic, issues arise on a daily basis and they need to be noticed and resolved with urgency.

Apply Now

Don’t see a job for you? Register for our candidate portal