Description

You will design and build distributed data platforms and manage large-scale data processing workflows.

Responsibilities

• Design distributed data platforms in an architect capacity.
• Write complex SQL queries across multiple platforms.
• Manipulate large datasets using Python, PySpark, or Scala.
• Collaborate daily with data scientists and machine learning engineers.
• Orchestrate data workflows using open-source tools.

Required Skills

• 5+ years of experience in data science or data engineering.
• 3+ years of experience with distributed technologies including Spark, Yarn, Hadoop, and Hive.
• Advanced SQL proficiency.
• Hands-on experience with Python, PySpark, or Scala.
• Experience using Pandas, NumPy, or Koalas for data manipulation.
• Experience with open-source orchestration tools like Apache Airflow or Azkaban.
• Any Graduate degree.

Key Skills

Education

Any Graduate