Description

You will design and implement large-scale data pipelines and data integration workflows across structured and unstructured datasets.

Responsibilities

• Architect, design, and implement large-scale data pipelines and data integration workflows.
• Build, optimize, and maintain ETL/ELT processes for data ingestion, transformation, and delivery.
• Develop and manage data lakes, data warehouses, and analytics platforms using cloud technologies.
• Own production deployment, monitoring, debugging, performance tuning, and incident management for data pipelines.

Required Skills

• 12+ years of experience in Data Engineering or Data Architecture.
• Strong programming skills in Python, Java, or Scala.
• Expert proficiency in SQL and performance tuning for large datasets.
• Hands-on experience with Big Data ecosystems including Hadoop, Spark, Kafka, and Hive.
• Strong experience with Cloud platforms (AWS, Azure, or GCP) services.
• Experience with Data Warehouse/Data Lake/Lakehouse design and modeling (Kimball, Star schemas).
• Proficiency in CI/CD, Git, Docker, and Airflow or similar orchestration tools.
• Knowledge of data governance, security, and data quality frameworks.

Key Skills

Education

Bachelor's or Master's degrees