Description

You will lead data engineering efforts with a focus on hands-on development, pipeline architecture, and AWS ecosystem management.

This role is on-site.

Responsibilities

• Develop and maintain scalable data pipelines using Python and PySpark.
• Manage ETL processes using Informatica or similar enterprise tools.
• Build and orchestrate complex workflows using Apache Airflow.
• Implement serverless functions and managed services within AWS, including Glue and Lambda.
• Pass a technical coding test demonstrating proficiency in data engineering concepts.

Required Skills

• 5+ years of professional data engineering experience.
• Expert-level scripting in Python and PySpark.
• Hands-on experience with AWS Glue and AWS Lambda.
• Proficiency in Snowflake and SQL for data warehousing.
• Experience with Informatica or other ETL/ELT tools.
• Knowledge of AWS Cloud infrastructure and CloudFormation.
• Experience with Airflow or similar orchestration frameworks.

Preferred Skills

• Experience managing large-scale data migrations within AWS environments.

Key Skills

Education

Any Graduate