Description

Build and maintain scalable data solutions using Python and the Hadoop ecosystem.

This role is on-site.

Responsibilities

• Build and maintain data pipelines using pySpark and Apache Spark.
• Manage large datasets across Hive, Impala, and HDFS.
• Develop complex queries and data structures using SQL, SQL Server, and Oracle.
• Implement data workflows using Pentaho and Oozie.
• Apply data science and analytics techniques to extract insights from distributed data.

Required Skills

• 5+ years of professional experience in data development.
• Proficiency in Python development.
• Hands-on experience with pySpark and Apache Spark.
• Strong command of SQL, SQL Server, and Oracle.
• Experience with Hadoop ecosystem tools including Hive, Hue, Impala, and HDFS.
• Practical knowledge of CDSW and Anaconda environments.
• Familiarity with workflow orchestration via Pentaho and Oozie.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate