Description

You will build and maintain data engineering solutions at scale.

Responsibilities

• Design, build, and maintain scalable data pipelines using Python, PySpark, and Airflow.
• Develop and optimize ETL workflows on Cloudera Data Platform (CDP).
• Implement data quality checks, monitoring, and alerting mechanisms for pipelines.
• Ensure data security, governance, and compliance across all data pipelines.
• Contribute to the architecture and design of the core data platform.

Required Skills

• 5+ years of professional experience in data engineering.
• Expertise in Python and PySpark.
• Hands-on experience with Apache Airflow.
• Working knowledge of Cloudera Data Platform (CDP).
• Familiarity with DevOps practices for workflow automation.
• Experience troubleshooting and resolving issues in production data pipelines.
• Understanding of data governance and security principles.

Key Skills

Education

Any Graduate