Description

You will design and develop scalable ETL pipelines using AWS cloud services.

Responsibilities

• Design and develop scalable ETL pipelines using AWS cloud services.
• Build data ingestion frameworks for structured and unstructured (OCR-based) data.
• Develop and optimize SQL queries and data transformation logic.
• Orchestrate workflows using Airflow.
• Build and maintain streaming data pipelines.

Required Skills

• 8+ years of experience in data engineering.
• Strong experience with AWS (ETL, data services).
• Expertise with structured and unstructured (OCR) data.
• Proficiency in SQL.
• Strong Python programming skills.
• Hands-on experience with PySpark.
• Experience with Airflow for workflow orchestration.
• Familiarity with AWS, Sql, Python, PySpark, Etl, Data Services, Airflow, Aws Glue, Lambda, S3.

Preferred Skills

• Experience with AWS Glue, Lambda, S3, Redshift, EMR, Kinesis.
• Understanding of CI/CD for data pipelines.
• Knowledge of data governance and security.

Key Skills

Education

Bachelor's degree