Description

You will build and maintain data architectures using Databricks and AWS.

Responsibilities

• Develop and maintain Spark and Python code for data processing.
• Manage Databricks Unity Catalog, cluster management, and deployments.
• Troubleshoot data pipelines and Spark execution issues.
• Deploy and manage workloads using Docker and Kubernetes.
• Implement data warehousing and data lakehouse fundamentals.

Required Skills

• 5+ years of relevant experience.
• Databricks Unity Catalog and cluster management.
• Strong Spark and Python coding skills.
• AWS services including S3, Lambda, and EMR.
• Docker and Kubernetes.
• Data warehousing and data lakehouse fundamentals.
• Databricks Engineer certification.

Preferred Skills

• Experience with Tableau or QlikSense.

Key Skills

Education

Any Graduate