Description

You will build and maintain data processing pipelines using Scala and Spark.

Responsibilities

  • Develop and optimize data processing logic using Scala and Apache Spark.
  • Execute Spark code within the Databricks framework.
  • Write and tune SQL queries for efficient data manipulation.
  • Collaborate with team members to resolve technical challenges.

Required Skills

  • 5+ years of professional experience in data development.
  • Strong proficiency in Scala programming.
  • Hands-on experience with Apache Spark and Spark-SQL.
  • Experience with PySpark.
  • Working knowledge of Databricks.
  • Solid understanding of SQL.
  • Foundational knowledge of Hadoop ecosystems.
  • Degree in any graduate field.

Preferred Skills

  • Experience with ETL processes.

Education

Any Gradute