Description

You will own the design and implementation of scalable data pipelines.

Responsibilities

• Design and build batch and streaming data pipelines using AWS services and orchestration frameworks.
• Translate canonical and semantic data models into physical data implementations with architects.
• Build pipelines to deliver clean data for analysts, BI tools, and ML workflows.
• Embed data validation, lineage, and anomaly detection into data pipelines.
• Mentor junior engineers and advocate for platform-first approaches across pods.

Required Skills

• 7+ years of experience in data engineering.
• Expertise in AWS services: Glue, Kinesis, Lambda, RDS, DynamoDB, S3.
• Proficiency with orchestration tools like Airflow and Step Functions.
• Strong skills in SQL, Python, and PySpark for data transformations.
• Experience with modern data platforms (Snowflake, Databricks, Redshift, Informatica).
• Proven ability to optimize pipelines for both batch and streaming use cases.
• Knowledge of data governance practices, including lineage and cataloging.

Key Skills

Education

Any Graduate