Description

You will design and implement scalable data solutions using the Azure ecosystem, owning the full lifecycle from business requirements to production deployment.

Responsibilities

• Build and maintain data pipelines, integrations, and transformations for efficient processing and storage.
• Design data solutions using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Translate business requirements into technical designs and scalable data models.
• Optimize data infrastructure for performance, scalability, and cost-efficiency.
• Mentor junior engineers and interns to foster technical skill development within the team.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in SQL and programming with Python or Scala.
• Hands-on experience with Spark.
• Deep understanding of ETL/ELT processes, data modeling, and data warehousing.
• Experience with Azure Data Factory and Azure Databricks.
• Working knowledge of Snowflake and SQL Server.
• Competency in data testing, validation, and reconciliation processes.
• Experience with version control using Git or GitHub.
• Degree in any graduate field.

Preferred Skills

• Experience with CI/CD pipelines and automated testing frameworks.
• Knowledge of streaming technologies including Kafka, EventHub, and Azure Stream Analytics.

Key Skills

Education

Any Graduate