Description

You will build and maintain scalable data pipelines to ensure data availability for analytical purposes.

This role is hybrid.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using Informatica and PySpark.
• Migrate existing Informatica ETL processes to PySpark.
• Automate workflows and orchestrate complex pipelines using Apache Airflow.
• Write complex SQL queries to extract, clean, and transform data.
• Optimize data processes for performance and scalability in cloud or hybrid environments.

Required Skills

• 7+ years of hands-on experience in data engineering roles.
• Strong proficiency with Informatica for ETL development.
• Advanced programming skills in Python and experience using PySpark for big data processing.
• Proven experience with Apache Airflow for workflow orchestration.
• Expertise in writing complex SQL queries.
• Experience implementing CI/CD processes and version control.
• Solid understanding of data engineering principles and data modeling.

Preferred Skills

• Experience with cloud platforms including AWS, GCP, or Azure.
• Knowledge of Kubernetes.
• AWS Solutions Architect certification.

Key Skills

Education

Any Graduate