Description

You will lead the design and implementation of core data solutions.

Responsibilities

• Design and implement data solutions using Cloudera HUE and CDP.
• Integrate Apache Iceberg and Spark into existing data pipelines.
• Guide and mentor junior developers on PySpark best practices.
• Collaborate with teams to gather data requirements and build scalable workflows.
• Optimize data pipelines for performance and efficiency while maintaining documentation and ensuring data quality.

Required Skills

• 7+ years of professional experience in data engineering.
• Proficiency in PySpark and Spark-based data engineering.
• Hands-on experience with Cloudera Data Platform and Apache Iceberg.
• Strong understanding of data architecture principles.
• Experience with Spark and Apache technologies.
• Demonstrated ability to conduct code reviews and resolve complex data issues.
• Excellent problem-solving, communication, and collaboration skills.

Key Skills

Education

Any Graduate