Description

You will build and maintain ETL pipelines to process complex data sets.

This role is remote.

Responsibilities

• Build ETL pipelines capable of handling disorganized Big Data from various sources.
• Identify and define opportunities for process improvement in collaboration with management.
• Create technical solutions for problems encountered within the ETL pipeline.
• Prepare technical documentation for future reference.

Required Skills

• 5+ years of professional experience in data engineering or ETL development.
• Bachelor's degree in Computer Science, Electrical Engineering, or Information Technology.
• Proficiency in at least one high-level programming language (Python, Java, JavaScript, or C++).
• Experience with Hadoop and Spark.
• Familiarity with Kafka on-premises architecture and ELK.
• Understanding of cross-cluster replication, index lifecycle management, and hot-warm architectures.

Preferred Skills

• Experience with HPCC or ECL.

Key Skills

Education

Bachelor's degree