Description

You will develop and maintain Big Data architectures within the Hadoop stack.

Responsibilities

• Write Spark and Scala code to ingest data from SFTP, mainframe, RDBMS, and Kafka sources.
• Develop data ingestion processes using Ni-Fi and Spark.
• Transform data using business rules and load results into Hive, HBase, and RDBMS tables.
• Execute data migrations from relational databases to HDFS clusters.
• Perform application performance tuning, troubleshooting, and data store analysis.
• Translate functional and technical requirements into detailed designs while ensuring security and data entitlement compliance.

Required Skills

• 5+ years of experience in Big Data development.
• Proficiency with Hadoop stack, including HDFS clusters and Hive.
• Strong experience with Spark and Scala.
• Hands-on experience with Ni-Fi for data ingestion.
• Experience working with Kafka, Mainframe, and RDBMS sources.
• Ability to work with JSON and disparate datasets in multiple formats.
• Bachelor’s degree in Computer Science, Information Technology, or a closely related field.

Key Skills

Education

Any Graduate