Senior Data Engineer

Design and maintain scalable data pipelines and lakehouse architectures on Microsoft Azure to support enterprise analytics.

This role is remote.

Responsibilities

• Build and optimize ETL/ELT workflows using Azure Data Factory, Databricks, and Synapse Analytics.
• Develop big data processing solutions with Apache Spark, PySpark, and Scala for high-performance transformations.
• Implement data ingestion frameworks integrating databases, APIs, and streaming platforms like Kafka into Azure.
• Design data models including star and snowflake schemas to support BI workloads and reporting.
• Automate deployment pipelines using CI/CD tools and manage data governance, security, and compliance.

Required Skills

• 10+ years of experience in data engineering.
• Deep expertise with Azure Data Services: ADF, Databricks, Synapse, ADLS Gen2, and Azure SQL.
• Proficiency in Apache Spark, PySpark, Scala, and SQL for data transformation.
• Strong programming skills in Python and SQL.
• Experience with data visualization tools such as Power BI or Tableau.
• Knowledge of streaming technologies including Azure Event Hubs, Stream Analytics, or Kafka.
• Familiarity with version control (Git, GitHub, Bitbucket, GitLab) and CI/CD practices.

Preferred Skills

• Experience with data governance and compliance frameworks.