Description

You will own the design, development, and optimization of complex data pipelines and applications within Databricks on Google Cloud Platform.

This role is remote.

Responsibilities

• Analyze business requirements to design and implement complex application enhancements.
• Optimize and troubleshoot Databricks workflows, including notebooks, clusters, and jobs.
• Lead project participation as a Developer or Technical Lead, ensuring delivery meets scope and timelines.
• Build and orchestrate data pipelines for batch and streaming ingestion, transformation, and validation.
• Communicate project status and provide technical documentation to stakeholders.

Required Skills

• 7+ years of professional developer experience.
• 3+ years of specific experience with Databricks technology.
• Deep understanding of Spark core concepts and proficiency in Python/PySpark.
• Strong data engineering skills: data ingestion, transformation, and quality validation.
• Expertise with GCP services: Google Cloud Storage, BigQuery, Pub/Sub, and Dataflow.
• Hands-on experience building data pipelines and orchestration within an enterprise SDLC.
• Proven problem-solving and root cause analysis capabilities.

Preferred Skills

• Master’s degree in Information Technology or Computer Science.
• Experience with PostgreSQL alongside Databricks and Python/PySpark.

Key Skills

Education

Any Graduate