Description

Specialized in building scalable pipelines using GitHub, optimizing ETL workflows using native Databricks capabilities and Amazon web services

- Build and maintain API integrations

- Develop SFTP pipelines and automated file ingestion

- Create error handling, notifications, and monitoring workflows

- Implement low-complexity ingestions (e.g., file drops, partner data shares)

- Maintain scripts and GitHub repositories

- Test pipelines and Document flows

Skills:

1. Hands on experience on Data bricks, AWS Serverless stack (APIGW, Lambda, S3, Glue)
2. RDS,SQL, PostgtreSQL
3. Python
4. Working knowledge of APIs
5. Exposure to working with AI Agents
6. Data products

SQL – Must Have

1. Window functions (ROW_NUMBER, RANK, LEAD, LAG).

2. joins and query optimization

Key Skills

Education

Bachelor's degree