Description

You will build and maintain data processing pipelines and infrastructure.

This role is on-site.

Responsibilities

• Develop and optimize data ingestion and transformation jobs.
• Orchestrate complex data workflows using workflow management tools.
• Manage and scale big data processing jobs across distributed systems.
• Implement and maintain data lake concepts.
• Build Node.js APIs for data services.

Required Skills

• 5+ years of professional experience in data engineering.
• Proficiency in Java, Python, and Scala.
• Strong working knowledge of Spark.
• Experience with Big Data technologies including Hadoop and Hive.
• Familiarity with container orchestration using Kubernetes.
• Understanding of Data Lake architecture.
• Familiarity with Vertex AI concepts.

Preferred Skills

• Experience with Node.js API development.

Key Skills

Education

Any Gradute