Description

You will own the design, build, and maintenance of data infrastructure.

Responsibilities

• Build, optimize, and maintain batch and real-time data ingestion pipelines.
• Lead the design and implementation of scalable ETL processes across distributed systems.
• Develop and manage the data lake architecture for structured and unstructured data.
• Utilize Apache Airflow for workflow orchestration and scheduling.
• Ensure data quality, lineage, governance, and compliance across all systems.

Required Skills

• 10+ years of professional experience in data engineering.
• Strong proficiency in Python and SQL.
• Hands-on experience with Apache Airflow and Apache Kafka.
• Experience utilizing AWS Glue for data transformation.
• Deep understanding of ETL frameworks and data lake design.
• Familiarity with cloud-based data architecture and real-time/batch processing.
• Experience enforcing data governance and security compliance.
• Ability to document data pipelines and product specifications.

Key Skills

Education

Any Gradute