Description

Design and maintain scalable data infrastructure for analytics and machine learning.

This role is on-site.

Responsibilities

• Architect and build data pipelines for structured and unstructured data using Spark, Hadoop, and Kafka.
• Develop and optimize ETL/ELT processes and data models to ensure data reliability and availability.
• Manage integrations from diverse sources, including databases and APIs, for batch and real-time processing.
• Define and enforce data governance, security standards, and quality metrics across the platform.
• Mentor junior engineers and troubleshoot complex infrastructure issues in cloud environments.

Required Skills

• 5+ years of experience in data engineering, data modeling, and ETL/ELT development.
• Deep expertise with big data technologies: Spark, Hadoop, and Kafka.
• Proficiency in designing and optimizing data pipelines on cloud platforms.
• Strong background in working with databases and external APIs.
• Experience collaborating with data scientists and cross-functional teams.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Experience with real-time data processing and streaming architectures.
• Familiarity with machine learning workflows and advanced analytics.

Key Skills

Education

Bachelor's or Master's degrees