Description

You will design and develop scalable data processing systems and pipelines.

This role is on-site.

Responsibilities

• Design and develop scalable data processing systems using PySpark and Hadoop ecosystem tools.
• Build, manage, and optimize data pipelines and workflows using Apache Airflow.
• Work with Cloudera platforms for efficient data storage, processing, and retrieval.
• Develop and maintain ETL processes for large-scale data processing.
• Collaborate with data scientists and analysts to understand requirements and deliver data solutions.

Required Skills

• 5-9 years of experience in big data or data engineering roles.
• Strong hands-on experience with PySpark, Hadoop Ecosystem, and Cloudera.
• Experience in workflow orchestration using Apache Airflow.
• Proficiency in Python and data processing frameworks.
• Knowledge of Spark and SQL for data transformation and querying.
• Experience building and optimizing large-scale data pipelines.
• Understanding of data governance, quality, and security practices.

Preferred Skills

• Strong analytical and problem-solving skills.
• Communication skills.

Key Skills

Education

Any Graduate