Description

You will lead data workflow migrations and database architecture initiatives, focusing on transitioning CI/CD pipelines and optimizing data storage.

This role is on-site.

Responsibilities

• Migrate Jenkins-based pipelines to Apache Airflow for improved task orchestration and scheduling.
• Design and implement scalable data workflows using Python and Airflow.
• Architect and optimize data storage solutions using MongoDB and relational databases (MySQL/PostgreSQL).
• Collaborate with cross-functional teams to ensure data integration and delivery.
• Ensure data quality, performance, and reliability across all processes.

Required Skills

• 3-5 years of experience as a Data Engineer.
• Strong expertise in Apache Airflow and Python.
• Experience with Jenkins and CI/CD pipeline management.
• Proficiency in MongoDB and relational databases (MySQL/PostgreSQL).
• Understanding of data pipelines and workflow orchestration.

Preferred Skills

• Experience with Docker, AWS, GCP, Spark, Git, or REST APIs.
• Strong analytical thinking and problem-solving abilities.

Key Skills

Education

Any Graduate