Description
You will design, develop, and optimize ETL workflows and data pipelines, ensuring data quality and integrity across ingestion processes.
This role is on-site.
Responsibilities
- Implement data ingestion from APIs, databases, and flat files.
- Monitor and troubleshoot ETL job performance issues.
- Automate data workflows and implement CI/CD practices for deployment.
- Collaborate with data architects and stakeholders on data requirements.
Required Skills
- 12+ years of experience in ETL development and data engineering.
- Hands-on experience with Snowflake, including data modeling, performance tuning, and SQL scripting.
- Proficiency in AWS services: S3, Lambda, Glue, Redshift, CloudWatch.
- Strong programming skills in Python or Scala for data processing.
- Experience with orchestration tools like Apache Airflow or AWS Step Functions.
- Familiarity with version control systems (Git) and CI/CD pipelines.
Preferred Skills
- Bachelor's degree in Computer Science or related field.
- Experience with API integration and flat file processing.