Description

You will build and manage large-scale data processing pipelines using the Hadoop ecosystem.

Responsibilities

• Process large datasets using Spark and Hadoop distributed frameworks.
• Develop data pipelines using Scala and Python.
• Write and optimize complex SQL queries against RDBMS.
• Maintain data integrity and performance across distributed systems.

Required Skills

• 3+ years of experience with Scala.
• 3+ years of experience with Python.
• 3+ years of experience with Spark or PySpark.
• 3+ years of experience with Hadoop distributed frameworks and the Hadoop ecosystem.
• 3+ years of experience with SQL and RDBMS.
• Bachelor’s degree or foreign equivalent from an accredited institution.
• 5+ years of total professional experience.

Key Skills

Education

Any Graduate