Description

You will design, build, and maintain data architecture and pipelines within the AWS Databricks platform.

Responsibilities

• Develop analytics solutions using Databricks, AWS services, Python, and SQL.
• Analyze data and develop strategies for populating data lakes.
• Write complex code using SQL, Spark, and Python to handle heterogeneous data wrangling.
• Support and develop REST APIs in Python using the FastAPI framework.
• Manage source code using GitHub.

Required Skills

• Heavy expertise in Databricks.
• Proficiency in Python and SQL.
• Experience with Spark.
• Hands-on experience with AWS services.
• Ability to perform complex coding and data wrangling.
• Experience developing REST APIs with FastAPI.
• Proficiency with GitHub for source code management.

Preferred Skills

• Any graduate degree.

Key Skills

Education

Any graduate