Description

You will build, scale, and deploy data pipelines and architecture to support analytics, marketing, and data science teams.

This role is on-site.

Responsibilities

• Manage end-to-end ETL activities, including extraction, transfer, and loading of data.
• Design and develop data and ML pipelines within the AI/ML ecosystem.
• Execute data ingestion, cleaning, and curation into data warehouses and platforms.
• Collaborate with DevOps and Architects to build scalable architectures for real-time and batch services.
• Troubleshoot performance issues regarding data ingestion, processing, and query execution on Redshift.

Required Skills

• 5+ years of experience in data engineering or data science roles.
• Strong Python and SQL coding skills.
• 2+ years of experience building and performing ETL on AWS Redshift.
• Proficiency with AWS data and ML technologies: Glue, MWAA, Data Pipeline, EMR, Athena, Redshift, and Lambda.
• Hands-on experience with orchestration tools like Airflow.
• Experience with distributed systems such as Spark.
• Knowledge of data extraction techniques including CDC or time/batch-based methods (Debezium, AWS DMS, or Kafka Connect).
• Solid understanding of Data Warehousing, Data Modelling, and Data Analysis.

Preferred Skills

• Experience working with Kafka.

Key Skills

Education

Any Graduate