Description

You will engineer and maintain data solutions using Azure services, including ETL pipelines and data lake architectures.

This role is on-site.

Responsibilities

• Design, develop, and optimize ETL pipelines using Azure Data Factory.
• Write clean, modular, and scalable Python code in Databricks Notebooks for data processing.
• Implement and manage data lake and data warehouse solutions on Azure.
• Develop reusable frameworks and automation scripts to improve data processing efficiency.
• Monitor, debug, and tune data workflows for performance and reliability.

Required Skills

• 4+ years of hands-on experience with Azure cloud services.
• Strong experience with PySpark and Spark SQL for distributed data processing.
• Proficiency in Python and ETL processes.
• Experience with Databricks and Azure Data Factory.
• Experience working with big data ecosystems like Hadoop, Hive, and HDFS.
• Knowledge of CI/CD pipelines and Git version control.
• Experience with SQL and relational databases.
• Experience with Azure storage solutions like ADLS.

Preferred Skills

• Experience designing reusable frameworks for data processing efficiency.

Key Skills

Education

Any Gradute