Description

Lead the delivery of scalable data and analytics solutions while managing a team of junior and senior engineers.

This role is on-site.

Responsibilities

• Lead technical solution design, architecture discussions, and integration of new technologies.
• Build reusable frameworks, automated workflows, and libraries to support analytics products at scale.
• Implement CI/CD, test-driven development, and production deployment frameworks.
• Clean, prepare, and optimize data for ingestion and consumption while troubleshooting complex issues.
• Mentor data engineers through code reviews, design audits, and best practice implementation.

Required Skills

• Minimum 8 years of experience developing scalable Big Data applications on distributed platforms.
• Expertise in SQL, Spark, Python, Airflow, and Scala.
• Hands-on experience with cloud platforms including AWS, GCP, or Azure.
• Proficiency with EMR, Databricks (Delta Lake and Lakehouse Medallion architecture), and Airflow.
• Experience with data warehousing tools such as Snowflake, Presto, and SQL databases.
• Practical knowledge of Jenkins pipelines for CI/CD and building Docker images.
• Strong understanding of data modeling, governance, and data architecture.
• Experience working with streaming, serverless, and microservices architectures.

Preferred Skills

• Experience managing a team of junior and senior engineers.

Key Skills

Education

Any Graduate