Description

You will own the design, development, and maintenance of ETL processes to ensure efficient data integration. Your work will involve writing complex SQL queries for extraction and reporting, while utilizing Python for data manipulation and automation. You will implement and manage data workflows in Databricks, collaborating with cross-functional teams to gather requirements and deliver solutions. You will also troubleshoot and optimize existing ETL processes for performance improvements.

Responsibilities

• Design and develop robust ETL processes for efficient data integration.
• Write complex SQL queries for data extraction and reporting.
• Implement and manage data workflows using Databricks.
• Troubleshoot and optimize existing ETL processes for performance.

Required Skills

• 10+ years of experience in data engineering roles.
• Strong proficiency in Python for data processing and automation.
• Hands-on experience with Databricks for data engineering and workflow management.
• Expertise in PySpark for big data transformations and distributed processing.
• Advanced SQL skills with the ability to write complex queries and optimize performance.
• Experience working with large datasets and distributed data processing.
• Understanding of data warehousing concepts and data modeling.

Preferred Skills

• Strong analytical and problem-solving skills.

Key Skills

Education

Any Graduate