You will design and optimize large-scale data platforms and analytics architectures.
Responsibilities
- Deliver hands-on development using Databricks to build scalable data solutions.
- Optimize data pipelines for performance and scalability.
- Implement CI/CD workflows for production deployments.
- Apply MLOps principles to support machine learning workflows.
- Manage distributed computing tasks using Spark.
Required Skills
- 15+ years of total IT experience.
- 7+ years of experience in data engineering, data platforms, and analytics.
- Deep experience with Spark and Spark runtime internals.
- Hands-on Databricks development and platform feature expertise.
- Working knowledge of at least one cloud platform: AWS, Azure, or GCP.
- Experience with CI/CD for production environments.
- Working knowledge of MLOps.
- Completed data engineering professional certification and required coursework.
- Degree in any field (Any Graduate).