Description

You will build and manage data engineering pipelines using Scala-Spark.

Responsibilities

• Design and develop ingestion and ETL pipelines within Databricks.
• Configure Databricks workspaces and manage cluster settings.
• Handle job scheduling and workflow management for data processes.
• Develop ETL jobs using Scala-Spark.

Required Skills

• 8+ years of experience in Scala-Spark data engineering.
• Hands-on experience designing ETL pipelines.
• Proficiency with Databricks platform.
• Experience with Bigdata technologies.
• Expertise in Scala and PySpark.
• Familiarity with Hadoop ecosystem.
• Knowledge of ETL processes.

Key Skills

Education

Bachelor’s degree