Description

You will build and maintain ETL pipelines to process complex data sets.

Responsibilities

• Prioritize business and information needs in collaboration with management.
• Identify and define opportunities for process improvement.
• Develop ETL pipelines capable of handling disorganized Big Data from various sources.
• Create technical solutions for problems encountered within the ETL pipeline.
• Prepare technical documentation for future reference.

Required Skills

• 5+ years of professional experience.
• Bachelor's degree in Computer Science, Electrical Engineering, or Information Technology.
• Proficiency in at least one high-level programming language (Python, Java, JavaScript, C++).
• Experience working with complex data sets.
• Familiarity with Kafka on-premises architecture and ELK.
• Understanding of cross-cluster replication, index lifecycle management, and hot-warm architectures.
• Experience with Python, Java, Javascript, C++, Hadoop, or Spark.

Preferred Skills

• Experience with HPCC or ECL.

Key Skills

Education

Bachelor's degree