Description

Lead technical direction for data engineering initiatives, architecting scalable pipelines and mentoring a team of engineers.

This role is on-site.

Responsibilities

• Lead and mentor a team of data engineers, providing technical guidance and code reviews.
• Design, architect, and implement scalable data pipelines using AWS services including Glue, Lambda, Docker, Fargate, ECS, Batch, and Step Functions.
• Translate business requirements from stakeholders into detailed technical specifications and solutions.
• Implement and maintain CI/CD pipelines using Jenkins to automate testing and deployment workflows.
• Manage and optimize databases, including Redshift, RDS Aurora Postgres, and DB2.

Required Skills

• 12+ years of experience in a Tech Lead or Principal Data Engineer role.
• Extensive hands-on experience with AWS services: Glue, Lambda, Docker, Fargate, ECS, Batch, Step Functions, and CloudFormation.
• Strong proficiency in Python, SQL, and PySpark for building data processing workflows.
• In-depth knowledge of database systems, specifically Redshift, RDS Aurora Postgres, and DB2.
• Proven experience implementing CI/CD processes using Jenkins.
• Expertise in ETL processes, data modeling, and data architecture.
• Proven track record of collaborating with data science teams and cross-functional stakeholders.

Key Skills

Education

Any Graduate