Description

We are looking for an experienced Senior Data Engineer with 10+ years of experience in designing, developing, and optimizing enterprise-scale data platforms and pipelines.

Key Responsibilities
Design and develop scalable ETL/ELT data pipelines
Build and optimize batch and real-time data processing solutions
Develop data pipelines using Python, PySpark, SQL, and Apache Spark
Work with Databricks, Delta Lake, and cloud data platforms
Design data models, data lakes, and data warehouse solutions
Integrate data from multiple structured and semi-structured sources
Implement data quality, validation, monitoring, and performance optimization
Develop CI/CD workflows and follow DevOps best practices
Collaborate with Data Architects, Data Scientists, Analysts, and business teams
Troubleshoot production issues and improve pipeline reliability

Required Skills
10+ years of experience in Data Engineering
Strong Python & SQL skills
Hands-on experience with PySpark / Apache Spark
Strong experience with Databricks & Delta Lake
Experience with AWS – S3, Glue, Redshift, Lambda
Strong knowledge of ETL/ELT and Data Warehousing
Experience with data modeling and large-scale data processing
Experience with Git, CI/CD, and Agile methodologies
Excellent communication and problem-solving skills

Preferred
AWS or Databricks certification
Experience with Airflow
Snowflake experience
Kafka / real-time streaming experience
Experience leading technical teams or mentoring engineers

Key Skills

Education

Any Graduate