Description

Design and build data lakes and integration layers within the Hadoop ecosystem.

Responsibilities

• Collaborate with business teams to define data requirements and interface with source systems.
• Extract data from RDBMS and SAS applications using APIs.
• Build and manage ingestion pipelines to load data into Hadoop using Spark.
• Design and architect analytics solutions on Hadoop.
• Investigate and resolve data and system issues to provide ongoing support.

Required Skills

• 10+ years of experience building DW/ETL applications.
• 5+ years of experience working with the Hadoop ecosystem.
• Proven experience designing and building data lakes on Hadoop.
• Strong proficiency with Spark, Hive, and Python.
• Expert-level SQL knowledge.
• Experience with Sqoop and Flume.
• Hands-on experience handling multiple data formats including CSV, TXT, XML, and JSON.

Preferred Skills

• Bachelor's degree in Computer Science.

Key Skills

Education

Bachelor's degree in Computer Science