Description

Job Overview
We are seeking a Lead Data Engineer to design, develop, and lead scalable data pipelines and data platforms. The ideal candidate will have strong experience with Python, SQL, Spark, cloud platforms, ETL/ELT, and data warehousing.
Key Responsibilities
Lead the design and development of scalable ETL/ELT data pipelines.
Develop data processing solutions using Python, SQL, and PySpark.
Design and optimize data warehouses, data lakes, and lakehouse platforms.
Work with AWS, Azure, or GCP cloud environments.
Build and maintain pipelines using Databricks, Airflow, Kafka, or similar technologies.
Implement data quality, monitoring, security, and performance optimization.
Develop and maintain CI/CD pipelines and support DevOps practices.
Collaborate with architects, data scientists, analysts, and business teams.
Mentor data engineers and provide technical leadership.
Troubleshoot production issues and ensure reliable data delivery.
Required Skills
8+ years of experience in Data Engineering.
Strong hands-on experience with Python, SQL, and Apache Spark/PySpark.
Experience with ETL/ELT, data modeling, and data warehousing.
Experience with AWS, Azure, or GCP.
Experience with Databricks, Snowflake, Redshift, BigQuery, or Synapse.
Knowledge of Airflow, Kafka, Git, and CI/CD.
Strong communication, problem-solving, and leadership skills.
Preferred: Terraform, Docker/Kubernetes, dbt, Delta Lake, and Agile/Scrum experience

Key Skills

Education

Any Graduate