Description

You will develop and enhance data capabilities within an Agile team. You own the release pipeline, manage Kafka-based Java libraries, and execute data engineering tasks.

Responsibilities

• Develop code and perform unit testing for new functions and app enhancements.
• Execute data engineering tasks including ingestion, ETL, and aggregation using Python.
• Manage Kafka-based dependent Java libraries.
• Collaborate directly with Architects and Product Owners on new deployments.
• Participate in daily standups, sprint planning, and sprint retrospectives.

Required Skills

• 5 years of experience in Data Engineering and Machine Learning.
• Proficiency in Python for ETL and data aggregation.
• Experience with Scala for object-oriented data processing.
• Hands-on experience with the Hadoop technology stack and utilities.
• Experience managing Kafka-based Java libraries.
• Working knowledge of Hive, PySpark, and Hadoop.
• Experience with Mainframe job scheduling using CA7.
• Degree in any graduate field.

Preferred Skills

• Familiarity with Oozie, Yarn, Impala, HDFS, HBase, Hue, and Beeline.

Key Skills

Education

Any Gradute