Description

You will build, optimize, and maintain batch and real-time data ingestion pipelines.

This role is on-site.

Responsibilities

• Lead the design and implementation of scalable ETL processes across distributed systems.
• Develop and manage the data lake architecture for structured and unstructured data.
• Utilize Apache Airflow for workflow orchestration and scheduling.
• Integrate streaming data via Apache Kafka.
• Ensure data quality, lineage, governance, and compliance across all systems.

Required Skills

• 10+ years of professional experience in data engineering.
• Strong proficiency in Python and SQL.
• Hands-on experience with Apache Airflow, Apache Kafka, and AWS Glue.
• Deep understanding of ETL frameworks and data lake design.
• Experience with cloud-based architecture and data processing methodologies.
• Familiarity with data governance, security compliance, and data quality standards.

Key Skills

Education

Any Gradute