Description
You will build and maintain data pipelines and orchestration workflows within a Databricks environment.
This role is on-site.
Responsibilities
- Develop and manage data workflows using Databricks orchestration.
- Implement data lake architectures utilizing Delta Lake and Unity Catalog.
- Build and maintain data integrations via Databricks Connect and Databricks APIs.
- Deploy and manage data pipelines through CI/CD tools.
Required Skills
- 10+ years of experience in data engineering roles.
- Extensive experience with Databricks, including Delta Lake and Unity Catalog.
- Proficiency with Databricks Connect and Databricks APIs.
- Strong Python programming skills.
- Experience with AWS cloud infrastructure.
- Working knowledge of JAVA.
- Hands-on experience with CI/CD tools and Databricks workflow orchestration.
Preferred Skills