Description

Specialized in building scalable pipelines using GitHub, optimizing ETL workflows using native Databricks capabilities and Azure/ Amazon web services

- Build and maintain API integrations

- Develop SFTP pipelines and automated file ingestion

- Create error handling, notifications, and monitoring workflows

- Implement low-complexity ingestions (e.g., file drops, partner data shares)

- Maintain scripts and GitHub repositories

- Test pipelines and Document flows

Requirements added by the job poster

• 3+ years of work experience with Amazon Web Services (AWS)

• 2+ years of work experience with Apache Spark

• 4+ years of Technology, Information and Internet experience

• 2+ years of work experience with Databricks Products

Key Skills

Education

Bachelor's degree