Description

You will lead data engineering efforts, building and managing pipelines while coordinating with offshore teams.

This role is on-site.

Responsibilities

• Lead data engineering initiatives and establish core engineering principles for pipeline development.
• Implement and maintain web crawling tools for data acquisition.
• Manage end-to-end data pipelines using scalable frameworks.
• Communicate technical requirements and provide status updates to offshore teams.

Required Skills

• 8+ years of experience in data engineering.
• Proficiency in Python, Java, and Scala.
• Strong knowledge of Apache Kafka and ETL fundamentals.
• Experience with Data Warehousing concepts and solid SQL understanding.
• Familiarity with Hive, HDFS, and Spark (PySpark).

Key Skills

Education

Any Gradute