Description

You will design and implement scalable data solutions using Databricks and cloud-based architectures.

Responsibilities

• Develop data pipelines using PySpark within Databricks environments.
• Build and deploy cloud-based solutions that ingest data from sources such as DB2.
• Implement ETL processes for large-scale data integration projects.
• Optimize SQL queries and manage data within Delta Lake and Databricks Workspaces.
• Manage data lake and data warehouse implementations on the cloud.

Required Skills

• 3+ years of hands-on experience delivering data solutions.
• Proficiency in PySpark and Databricks (Notebooks, Delta Lake, APIs).
• Strong programming skills in Python and Scala.
• Advanced SQL and query optimization expertise.
• Experience with ETL implementation and data integration.
• Proven ability to build and deploy cloud-based solutions at scale.
• Any Graduate degree.

Preferred Skills

• Experience with AWS services including S3, Redshift, and Secrets Manager.
• Orchestration experience using Airflow or Step Functions.
• Familiarity with Qlik Replicate, Qlik Compose, Terraform, or CI/CD tools.

Key Skills

Education

Any Graduate