Description

Build and maintain distributed data processing solutions and ETL pipelines.

Responsibilities

• Develop solutions using J2E, Angular, JMS, and JAXB.
• Design and implement data models and complex SQL queries for RDBMS and NoSQL databases.
• Build batch jobs and distributed processing workflows using Spark-Scala and Java.
• Manage data integration using SQOOP, Oozie, and Kafka.
• Write and maintain stored procedures, UNIX shell scripts, and Linux-based automation.

Required Skills

• 5+ years of experience in core application development and SOA architecture.
• Proficiency in Apache Hadoop, Hive, HBase, HDFS, YARN, and MapReduce.
• Hands-on experience with Spark, including Spark-SQL, Data Frames, and RDD.
• Strong programming skills in Java, Spark-Scala, and PL/SQL.
• Experience with Oracle, JDBC, and database design.
• Working knowledge of XML, JSON, JUnit, and DbUnit.
• Competency with Version Control tools and CI/CD pipelines.
• Strong MS Excel and UNIX/Linux OS skills.
• Bachelor's degree in a relevant field or commensurate experience.

Preferred Skills

• Knowledge of distributed architectures, data warehousing, and cloud computing.
• Experience with Apache Accumulo, Flume, ZooKeeper, or Snowflake.
• Understanding of machine learning fundamentals for massive data set platforms.

Key Skills

Education

Bachelor's degree