Description

You will design and build data infrastructure and pipelines.

Responsibilities

• Develop and maintain large-scale ETL and DW projects and pipelines.
• Implement real-time data streaming and batch orchestration solutions.
• Ensure data quality, reconciliation, and adherence to data governance concepts.
• Troubleshoot data processing issues and independently devise solutions.

Required Skills

• 12+ years of professional experience in Data Engineering.
• Strong proficiency in Scala, Spark, SQL, and Hadoop.
• Hands-on experience with Kafka for data streaming.
• Deep understanding of Big Data architecture and distributed systems.
• Proven experience optimizing Hive and SQL queries.
• Experience building and managing production data pipelines.
• Knowledge of streaming frameworks such as Spark Streaming or Kafka Streams.
• Familiarity with Data Governance principles.

Preferred Skills

• Experience with Aerospike.

Key Skills

Education

Any Gradute