Description

You will design and architect scalable data ingestion pipelines processing service and repair data from multiple sources, including external dealer streams.

Responsibilities

• Design and architect scalable data ingestion pipelines for service and repair data.
• Ingest real-time data using Kafka and ensure reliable, high-throughput data flow.
• Utilize Google Dataflow for data cleansing, normalization, and transformation.
• Model and optimize data storage in Snowflake for efficient querying and reporting.
• Implement real-time reporting by pushing transformed data through APIs.

Required Skills

• 5+ years of experience as a Data Architect or similar role in data-intensive environments.
• Strong expertise in data ingestion technologies, specifically Kafka.
• Hands-on experience with Google Dataflow (Apache Beam) for data processing.
• Deep knowledge of cloud data warehousing, with proficiency in Snowflake.
• Experience creating and maintaining dashboards using Tableau.
• Solid understanding of data modeling techniques (star/snowflake schema, normalized forms).
• Familiarity with API integration for real-time data delivery.
• Proficiency in SQL, Python, or Java.

Preferred Skills

• Experience in the automotive or truck industry, particularly Aftersales service data.
• Knowledge of additional cloud platforms like AWS, GCP, or Azure.

Key Skills

Education

Any Gradute