Description

You will design, implement, and maintain big data solutions within a Hadoop environment.

Responsibilities

• Design and develop high-performance Spark jobs for data transformation, cleansing, and enrichment.
• Tune Spark jobs for optimal performance and resource utilization while monitoring cluster health.
• Write code for moderately complex system designs, including APIs and cross-platform programs.
• Review code developed by other engineers and drive programming standards.
• Debug production issues, perform root cause analysis, and write unit and integration tests.

Required Skills

• 5-8 years of professional experience in IT development and programming within a Hadoop environment.
• Proficiency in Spark and Scala for big data processing.
• Hands-on experience with Ab Initio.
• Experience with Hadoop ecosystems.
• Strong understanding of ETL processes and complex data set optimization.
• Proficiency in more than one object-oriented programming language.
• Experience with versioning tools, debugging tools, and the systems development life cycle (SDLC).
• Ability to write detailed technical specifications and manage change management procedures.

Preferred Skills

• Bachelor's degree in an IT-related field or equivalent work experience.

Key Skills

Education

Bachelor's degree