Description
You design, build, and maintain scalable data pipelines for API ingestion and analytics. You own the full lifecycle from API development to data warehousing in Snowflake, ensuring high-quality data delivery for BI tools.
This role is remote.
Responsibilities
- Design and maintain scalable data pipelines for API data ingestion and processing.
- Build and manage APIs, including authentication, error handling, and data parsing.
- Develop and optimize data models in Snowflake and relational databases (Postgres).
- Use Databricks (PySpark, notebooks) for data processing and pipeline orchestration.
- Collaborate with analytics teams to deliver clean datasets for Tableau reporting.
Required Skills
- 5+ years as a Data Engineer with strong API development and integration experience.
- Strong SQL skills, including database design, query optimization, and performance tuning.
- Hands-on experience with Postgres or similar relational databases.
- Experience with Snowflake (data loading, querying, performance optimization).
- Experience with Databricks (ETL/ELT, PySpark, notebooks).
- Proficiency in Python for data engineering tasks.
- Experience working in cloud environments (AWS, Azure, or GCP).
- Strong understanding of data warehousing concepts and best practices.
Preferred Skills
- Experience with ETL/orchestration tools (Airflow, Fivetran, dbt).
- Familiarity with containerization (Docker).
- Experience supporting Tableau dashboards or BI developers.