Description

Build and maintain scalable data pipelines and API integrations using Databricks and AWS.

This role is hybrid.

Responsibilities

• Build and maintain ETL workflows using native Databricks capabilities and AWS services.
• Develop SFTP pipelines and automated file ingestion mechanisms.
• Create error handling, notifications, and monitoring workflows for data flows.
• Maintain scripts, GitHub repositories, and implement low-complexity ingestions.
• Test pipelines and document data flows.

Required Skills

• 3+ years of work experience with Amazon Web Services (AWS).
• 2+ years of work experience with Apache Spark.
• 2+ years of work experience with Databricks Products.
• 4+ years of experience in Technology, Information, and Internet.
• Proficiency in SQL and Python.
• Experience with GitHub Actions for CI/CD.
• Familiarity with Jira and Agile Development methodologies.

Preferred Skills

• Experience with Azure cloud services.
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree