Description

Key Skills: Azure Data Engineering, Python, PySpark, SQL, Database Technologies, AWS

Roles & Responsibilities:

• Design and develop scalable data pipelines on Azure.
• Build ETL/ELT workflows using PySpark and Python.
• Work with large datasets and optimize data processing jobs.
• Develop and manage data models and database solutions.
• Ensure data quality, consistency, and performance of pipelines.
• Implement data integration between multiple systems and sources.
• Work with SQL for querying, transformation, and performance tuning.
• Support production data pipelines and troubleshoot issues.
• Collaborate with business and engineering teams for data requirements.
• Maintain documentation for data workflows and processes.

Experience Required:

• 6-10 years of overall IT experience.
• Minimum 5 years of hands-on experience in Azure Data Engineering.
• Strong experience in Python and PySpark for data processing.
• Good knowledge of SQL and database systems.
• Experience building and maintaining data pipelines in Azure.
• Exposure to big data processing and distributed systems.
• AWS experience is an added advantage.
• Strong debugging and performance optimization skills.
• Experience working in production data environments.
• Immediate joiners preferred.

Education: Any Graduation

Key Skills

Education

Any Graduate