Description

You will design and scale data architectures and analytics solutions for consumer-focused industries, owning the development of real-time, streaming, batch, and API-based data pipelines.

Responsibilities

• Build and maintain scalable data pipelines using Python, Scala, and SQL.
• Tune PySpark jobs and manage Databricks clusters for security, deployment, and performance.
• Implement data governance policies including lineage, quality checks, and classification.
• Develop modular, testable code using Java, Spring Boot, and JUnit.
• Break large solutions into releasable milestones and integrate stakeholder feedback.

Required Skills

• 6+ years of experience in data engineering.
• Proficiency in Python, Scala, and SQL.
• Strong PySpark skills with experience tuning Spark jobs.
• Hands-on experience with Databricks, including security, clusters, user management, and performance tuning.
• Experience with Hadoop platforms to build big data products.
• Programming proficiency in Java and Spring Boot.
• Familiarity with RESTful APIs and microservices architectures.
• Experience working with CI/CD pipelines.

Preferred Skills

• Bachelor's degree in Computer Science.

Key Skills

Education

Bachelor's degree in Computer Science