Description

You will build and maintain scalable data transformation applications using Apache Spark.

Responsibilities

• Develop and maintain high-performance data transformation applications using Apache Spark.
• Design deliverables that adhere to business requirements, design principles, and patterns.
• Integrate code within CI/CD pipelines using Scala or Java.
• Create JUnit tests to ensure code coverage meets defined standards.
• Review code modules developed by junior engineers.

Required Skills

• 5+ years of hands-on development experience in Java or Scala.
• Proficiency with Apache Spark frameworks and Maven.
• Experience with Unix Shell scripting and Unix File system commands.
• Working knowledge of HDFS commands.
• Experience with query languages including Oracle SQL, Hive SQL, Spark SQL, Impala, and HBase DB.
• Knowledge of data ingestion tools such as Sqoop and Kafka.
• Experience using Eclipse IDE, Teccia Client, and Oracle SQL Developer.
• Familiarity with the broader Big Data ecosystem components.

Preferred Skills

• Strong customer management and communication skills.

Key Skills

Education

ANY GRADUATE