Description

You will design and oversee data pipeline architecture to support large-scale analysis and product development.

Responsibilities

• Design and maintain scalable data pipelines for reliable collection and processing.
• Develop and optimize data architecture to support new products and initiatives.
• Transform raw data into analyzable formats for Business Intelligence.
• Implement improvements in data reliability, efficiency, and security.
• Collaborate with data analysts and scientists to enhance data delivery.

Required Skills

• 7+ years of experience in software development or data engineering.
• 5+ years of professional experience with DBT and Airflow.
• Proficiency in AWS Cloud and Snowflake.
• Expertise in Astro/Airflow ETL for pipeline management.
• Strong foundation in SQL and data modeling.
• Experience with relational, columnar, and document datastores.
• Proven ability to build and optimize big data pipelines and architectures.

Preferred Skills

• Experience handling unstructured datasets and process improvement.

Key Skills

Education

Any Graduate