Description

Design and build scalable ETL and streaming data pipelines on AWS.

This role is on-site.

Responsibilities

• Design and develop scalable ETL pipelines using AWS cloud services.
• Build data ingestion frameworks for structured and unstructured (OCR-based) data.
• Orchestrate workflows using Airflow and build streaming data pipelines.
• Develop, optimize, and maintain SQL queries and data transformation logic.

Required Skills

• 8+ years of experience in data engineering.
• Strong proficiency in Python and PySpark.
• Expertise with SQL and data transformation logic.
• Hands-on experience with AWS ETL and data services.
• Experience with Airflow for workflow orchestration.
• Familiarity with AWS Glue, Lambda, and S3.

Preferred Skills

• Experience with AWS Redshift, EMR, and Kinesis.
• Understanding of CI/CD for data pipelines.
• Knowledge of data governance and security.

Key Skills

Education

Bachelor's degree