Description

Key Skills: Databricks, SQL, AWS-Amazon Web Services, Airflow

Roles and Responsibilities:

• Design and develop scalable data pipelines and processing workflows using Databricks and Amazon Web Services.
• Build robust data ingestion, transformation, and integration solutions for structured and semi-structured data.
• Write and optimize complex SQL queries for data transformation, validation, and analytical workloads.
• Implement data quality checks, error handling, and operational controls across production data workflows.
• Collaborate with data architects, analysts, and application teams to deliver reliable datasets and cloud data solutions.

Skills Required:

• 8-12 years of relevant experience in data engineering, cloud data platforms, and enterprise analytics solutions.
• Strong hands-on experience with Amazon Web Services, including AWS cloud services used for data engineering solutions.
• Practical experience developing data engineering workloads on Databricks.
• Advanced SQL skills, including complex transformations, joins, aggregations, and query optimization.
• Experience designing scalable data pipelines, integrating data sources, and supporting production data platforms.

Good to Have:

• Experience with Apache Airflow for workflow orchestration and scheduling.

Education: B.Tech or B.E. degree in Computer Science, Information Technology, Engineering, or a related discipline

Key Skills

Education

Any Graduate