Description

You will design and maintain data integration pipelines using Azure, Python, and NodeJS.

This role is on-site.

Responsibilities

• Implement Azure Logic App flows to ingest data from client systems into cloud data stores.
• Configure Azure Functions using NodeJS and SQL to extract, transform, and load data from APIs and objects.
• Develop Python-based ETL pipelines to process various data formats and insert them into SQL databases.
• Design and implement ETL processes using Apache Spark in standalone mode.
• Deploy and manage ETL workflows within Docker containers to ensure scalability.

Required Skills

• 5+ years of experience implementing ETL processes in Azure cloud environments.
• Hands-on experience with Azure Logic Apps and Azure Functions.
• Proficiency in NodeJS and Python for data processing and pipeline development.
• Experience with Apache Spark and PySpark.
• Experience using Docker for deployment and Git CI/CD pipelines.
• Working knowledge of both Windows and Linux operating systems.

Preferred Skills

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Strong communication and interpersonal skills.

Key Skills

Education

Any Graduate