Description
You will build and maintain data processing pipelines using Spark and Scala.
Responsibilities
- Develop data processing logic using PySpark and Scala.
- Implement scalable data pipelines within the Spark framework.
- Optimize existing data workflows for efficiency and performance.
Required Skills
- 5+ years of experience in data engineering roles.
- Expertise in Spark.
- Proficiency in PySpark.
- Strong programming skills in Scala.
- Bachelor's degree or equivalent graduate-level education.