Description

You will design and manage data architectures and pipelines within the Azure ecosystem.

This role is on-site.

Responsibilities

• Build and optimize Azure Data Factory and Databricks ETL pipelines.
• Develop Spark-based applications for large-scale data processing and analytics.
• Integrate real-time data processing using tools like Kusto.
• Enhance security monitoring and data governance using Microsoft Entra and Log Analytics.
• Implement data migrations and cloud analytics solutions across multi-cloud environments.

Required Skills

• 5+ years of experience in data engineering.
• Azure stack: Synapse, Data Factory, Data Lake, and Databricks.
• Big Data tools: Hadoop, Spark, Kafka, HBase, Hive, Sqoop, and Airflow.
• ETL/ELT frameworks: Informatica IICS, Microsoft Fabric, and Apache Spark (Scala/Python).
• Cloud platforms: AWS (S3, EMR, Redshift, Glue, Lambda) and Azure.
• Databases: SQL Server, Oracle, Cosmos DB, Cassandra, and MongoDB.
• Security: Microsoft Entra (AAD), RBAC, OAuth, Key Vault, and Azure Log Analytics.
• DevOps: Terraform, Jenkins, Git, Kubernetes, and Docker.
• Scripting: Python, Scala, and Shell Scripting.

Preferred Skills

• Experience with Snowflake and Adobe Analytics.
• Knowledge of Power BI and marketing analytics.

Key Skills

Education

Any Graduate