You will build and maintain data processing pipelines using Scala and Spark.
Responsibilities
- Develop and optimize data processing logic using Scala and Apache Spark.
- Execute Spark code within the Databricks framework.
- Write and tune SQL queries for efficient data manipulation.
- Collaborate with team members to resolve technical challenges.
Required Skills
- 5+ years of professional experience in data development.
- Strong proficiency in Scala programming.
- Hands-on experience with Apache Spark and Spark-SQL.
- Experience with PySpark.
- Working knowledge of Databricks.
- Solid understanding of SQL.
- Foundational knowledge of Hadoop ecosystems.
- Degree in any graduate field.
Preferred Skills
- Experience with ETL processes.