Description

You will build and maintain scalable data pipelines to support batch and streaming ingestion and transformation.

Responsibilities

• Build scalable data pipelines to ingest data from sources like Flat Files, SQL, AWS RDS, and S3 into Snowflake.
• Develop complex SQL queries and optimize them for performance and organization.
• Create unit and integration tests and implement automated build and deployment processes.
• Deploy, monitor, and maintain production systems while participating in code reviews.
• Collaborate with product owners, architects, and analysts within an agile scrum environment.

Required Skills

• 5+ years of data engineering experience.
• 5+ years of hands-on experience with SQL and Snowflake.
• 2+ years of ETL development experience using DBT.
• 1+ year of hands-on experience using Git and Python.
• Experience building data hubs and data marts.
• Proficiency with AWS RDS and S3.
• Ability to write complex transformations and optimize queries.
• Degree in IT, Computer Science, or Engineering.

Preferred Skills

• ELT development using Matillion.
• Experience with Azure DevOps and CI/CD pipelines.
• Experience with AWS and Control M.

Key Skills

Education

Any Graduate