Description

You will design, build, and maintain scalable data pipelines and warehousing solutions on the Azure cloud platform.

This role is on-site.

Responsibilities

• Design, develop, and maintain data pipelines using Azure Data Factory (ADF).
• Build and optimize Snowflake data warehousing solutions for performance and scalability.
• Leverage Databricks for data processing and transformation using Spark and Python or Scala.
• Manage data orchestration and batch process scheduling using Control-M.
• Implement data quality checks, validation processes, and security governance policies.

Required Skills

• 5+ years of experience in data engineering.
• Deep understanding of Azure cloud services and the data analytics domain.
• Proven experience building and managing complex pipelines with Azure Data Factory (ADF).
• Hands-on experience with Databricks, including Spark programming (Python or Scala) and Delta Lake.
• Extensive experience with Snowflake, including data modeling, SQL development, and performance tuning.
• Proficiency in SQL for querying, manipulation, and analysis.
• Experience with Control-M for workflow orchestration and monitoring.
• Strong proficiency in Python for automation and data manipulation.
• Experience with Git and version control workflows.

Preferred Skills

• Experience with CI/CD pipelines for data engineering deployments.
• Knowledge of Azure Synapse Analytics, ADLS, Azure Event Hubs, or Azure Functions.

Key Skills

Education

Any Gradute