Description

You will design, build, and maintain scalable data pipelines and cloud solutions using Databricks, PySpark, and Azure services.

This role is on-site.

Responsibilities

• Design and implement scalable data solutions on Azure, AWS, or GCP.
• Develop and maintain data pipelines using Databricks and PySpark.
• Optimize SQL queries and manage Azure SQL Database, Synapse Analytics, and Azure Data Factory.
• Build CI/CD pipelines using Azure DevOps to streamline deployment.
• Ensure data integrity through rigorous testing and validation.

Required Skills

• 3-12 years of experience with Databricks and PySpark in enterprise environments.
• Strong experience managing cloud data platforms including Azure, AWS, or GCP.
• Experience with large-scale ETL processes, data lakes, and data warehouses.
• Proficiency in Azure DevOps for CI/CD pipeline development.
• Familiarity with data governance, metadata management, and data security practices.
• Exposure to Agile methodologies and DevOps practices.

Preferred Skills

• Experience with Synapse Analytics and Azure Data Factory.
• Background in data engineering consulting or cross-team collaboration.

Key Skills

Education

Any Graduate