Description

Key Skills: Data Engineer, Azure Databricks, Pyspark, Python, Spark

Roles and Responsibilities:

• Design and implement scalable data engineering solutions using Azure Databricks.
• Develop and maintain data pipelines for ingestion, transformation, validation, and delivery.
• Process structured and semi-structured data for reporting, analytics, and downstream applications.
• Improve data pipeline reliability, throughput, maintainability, and operational support processes.
• Collaborate with delivery, analytics, and application teams to resolve data issues and deliver production-ready solutions.

Skills Required:

• 6 to 14 years of relevant experience in data engineering, including Azure Databricks experience.
• Strong hands-on experience with Azure Databricks and its data engineering capabilities.
• Professional experience delivering data engineering solutions in enterprise environments.
• Ability to design scalable data processing and transformation workflows for large datasets.
• Experience with data ingestion, pipeline development, data quality validation, and production support.

Good to Have:

• Experience with Apache Spark, PySpark, and Python for distributed data processing and automation.

Education: B.E., B.Tech, or B.Tech M.Tech Dual Degree

Key Skills

Education

Any Graduate