Description

You will design, develop, and deploy Big Data solutions and data ingestion tasks within an SDLC framework.

Responsibilities

• Design and model data ingestion tasks using approved toolsets.
• Develop automated monitoring tools using Python, Shell, Java, or Scala.
• Execute data conversion and migration tasks into the Big Data platform.
• Provide effort estimates, progress reports, and L3 support for delivered projects.
• Partner with multiple teams and manage technical communication with external vendors.

Required Skills

• 5+ years of experience as a Big Data Engineer or in a similar role.
• Proficiency in Python and backend programming (Java, scripting).
• Hands-on experience with Apache Kafka.
• Experience with Avro, Parquet, HBase, Hive, Impala, and Arcadia.
• Expertise in data migration and data enrichment within the Hadoop ecosystem.
• Working knowledge of relational and non-relational databases including Oracle, SAP, MySQL, NoSQL, Hadoop, and MongoDB.
• Ability to design solutions independently based on high-level architecture.

Key Skills

Education

Any Graduate