Description

You will design and build scalable data engineering solutions using Azure Databricks and related cloud services.

This role is remote.

Responsibilities

• Develop and maintain ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics, and Apache NiFi.
• Build and optimize data models using Star and Snowflake schemas within Azure Databricks and ADLS.
• Implement data governance, security, and quality frameworks using Azure AD, Key Vault, and VPC configurations.
• Manage big data infrastructure including Hadoop, Spark, Kafka, and on-premises clusters like Cloudera.
• Write efficient Python and SQL code for data processing and analytics tasks.

Required Skills

• 5+ years of experience in Data Engineering.
• Hands-on expertise with Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Databricks.
• Strong proficiency in Python and SQL.
• Experience with Azure Data Lake Storage (ADLS) and cloud compute/storage services.
• Knowledge of big data technologies: Hadoop, Spark, Kafka.
• Familiarity with ETL tools such as Apache NiFi, Talend, or Informatica.
• Understanding of data modeling techniques (Star/Snowflake schema, normalization).
• Experience with on-premises infrastructure management (Linux/Windows Server, Cloudera/Hortonworks).

Preferred Skills

• Experience implementing cloud security best practices and data governance frameworks.
• Exposure to on-premises security measures such as firewalls and VPNs.

Key Skills

Education

Any Graduate