Senior Data Engineer

We are seeking an experienced Senior Data Engineer to join our team.
You will be responsible for designing, building, and optimising large-scale data systems to support analytics, AI/ML, and business decision-making. You will work closely with data scientists, analysts, and engineering teams to deliver scalable, efficient, and reliable data solutions across AWS.

WHAT WILL I BE DOING?

• Act as a subject matter expert in large-scale data engineering, data modeling, and warehousing.

• Design, implement, and optimise data architectures, schemas, and pipelines across cloud platforms (primarily AWS).

• Develop scalable ETL/ELT processes using tools such as AWS Glue, Redshift, Athena, and S3.

• Work with big data frameworks (Apache Spark, PySpark) to process and analyze large datasets.

• Build and manage workflow orchestration using Apache Airflow or AWS Step Functions.

• Apply best practices in software engineering: testing, version control, CI/CD.

• Collaborate with data scientists to operationalize ML models (MLOps) in production environments.

• Ensure performance, cost efficiency, scalability, and reliability of data systems.

• Mentor and guide junior data engineers, leading projects from concept to delivery.

• Produce technical documentation and knowledge sharing resources.

WHAT SKILLS AND EXPERIENCES DO I NEED?

• 7+ years of professional experience in data engineering or data science.

• Strong expertise in data modeling, data warehousing, and schema design for large-scale systems.

• Advanced proficiency in Python, SQL, and PySpark.

• Hands-on experience with AWS data services: Glue, Redshift, S3, Lambda, Athena.

• Experience with big data frameworks (Apache Spark), workflow orchestration (Airflow, Step Functions), and IaC (CloudFormation, Terraform).

• Solid foundation in algorithms, data structures, design patterns, and relational databases.

• Strong knowledge of software development best practices, testing, version control, and CI/CD pipelines.

• Familiarity with ML, NLP, or DL concepts; hands-on MLOps experience is a strong plus.

• MSc/PhD in Computer Science, AI, or related field is highly desirable.

• Excellent problem-solving and critical thinking skills, with the ability to quickly grasp new domains.

• Leadership experience in mentoring teams and driving projects end-to-end.