Description

You will build and manage data pipelines within the Azure ecosystem.

Responsibilities

• Develop data processing workflows using PySpark and Spark.
• Build and maintain ETL pipelines using Azure Data Factory (ADF).
• Manage data transformations and processing within Azure Databricks (ADB).
• Write and optimize complex SQL queries for data manipulation.
• Operate within Azure Cloud Infrastructure to ensure data availability.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency in Python and Spark (PySpark).
• Hands-on experience with Azure Data Factory (ADF).
• Experience using Azure Databricks (ADB).
• Strong SQL skills for data engineering tasks.
• Working knowledge of Azure Cloud Infrastructure.
• Bachelor's degree or equivalent graduate degree.
• Must be a US Citizen or Green Card holder.

Key Skills

Education

Any Graduate