Description

You will design, build, and maintain large-scale, fault-tolerant data pipelines using the Hadoop ecosystem.

This role is on-site.

Responsibilities

• Design and develop scalable data workflows and pipelines.
• Automate data extraction, transformation, and loading (ETL) processes.
• Analyze existing data architecture and recommend performance improvements.
• Collaborate with data scientists and stakeholders to define data requirements.
• Maintain data quality, security, and governance standards.

Required Skills

• 5+ years of professional experience in data engineering within Hadoop ecosystems.
• Deep proficiency with HDFS and MapReduce.
• Experience with Apache Spark, Hive, and Pig.
• Strong programming skills in Python, Scala, or Java.
• Familiarity with ETL tools and pipeline frameworks.
• Knowledge of SQL and NoSQL databases, specifically HBase and Cassandra.
• Experience with Apache Kafka for streaming data.
• Proficiency with Git for version control.

Preferred Skills

• Bachelor's or Master's degree in Computer Science or related field.
• Experience optimizing data workflows for performance and scalability.

Key Skills

Education

Bachelor's or Master's degrees