Description

You will design and develop software applications within the Hadoop ecosystem to support data-driven decision making.

Responsibilities

• Design and develop software applications using the Hadoop ecosystem and Python.
• Load and manipulate large datasets into Hadoop and GCP using Spark and Hive.
• Analyze business needs and profile large datasets to build custom data models.
• Develop and extend design patterns, processes, standards, and reusable components for data engineering functions.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency with Apache Spark and PySpark.
• Experience with Hive and HDFS.
• Strong Python programming skills.
• Competency in Unix/Shell Scripting.
• Hands-on experience with Hadoop.
• Experience working with GCP.

Preferred Skills

• Master’s degree in Computer Science, Engineering, Information Technology, or a related field, or an equivalent combination of education, training, and experience.

Key Skills

Education

Any Graduate