Description

You will own the design and maintenance of scalable data pipelines and API integrations.

This role is hybrid.

Responsibilities

• Develop and maintain scalable data pipelines to handle increasing data volume.
• Build and integrate new APIs for external data sources.
• Collaborate with analytics teams to refine data models for business intelligence tools.
• Implement monitoring processes to ensure production data accuracy and availability.
• Define data assets and write Spark, SparkSQL, and HiveSQL jobs to populate models.

Required Skills

• 10+ years of professional experience in data engineering.
• Expert-level proficiency in Apache Spark and SparkSQL.
• Strong experience with HiveSQL for data processing.
• Proven track record designing and implementing API integrations.
• Ability to design and evaluate data lineage tools.
• Experience defining and documenting complex data models.
• Strong background in implementing data quality frameworks.

Preferred Skills

• Experience with distributed computing frameworks beyond Spark.
• Familiarity with cloud-native data warehousing solutions.

Key Skills

Education

Any Graduate