You will build and maintain data pipelines to support large-scale processing tasks.
Responsibilities
- Develop and manage scalable data pipelines.
- Execute data transformation and processing workflows.
- Write and optimize code within Databricks Notebooks.
- Manage version control and code collaboration using Git and GitHub.
Required Skills
- 3+ years of experience in data engineering.
- Proficiency in Python or Scala programming.
- Hands-on experience with Apache Spark.
- Experience working within Databricks environments.
- Strong understanding of data transformation logic.
- Competency with Git/GitHub for version control.
- Degree in any field of study.