You will build and maintain data infrastructure to support data-driven decision-making.
Responsibilities
Design and build ETL/ELT data pipelines for efficient data ingestion and transformation from various sources into AWS data warehouses and data lakes.
Architect, build, and optimize scalable data architectures using data lakes (S3, Delta Lake, Iceberg) and data warehouses (Redshift, Snowflake) on AWS.
Collaborate with data scientists and analysts to design data models and schemas based on data requirements.
Implement data quality and governance practices to ensure data accuracy and compliance.
Troubleshoot complex data pipeline failures and implement system improvements.
Required Skills
5+ years of professional experience in data engineering.
Expertise in ETL processes.
Hands-on experience with AWS cloud computing services.
Proficiency with data formats including JSON, CSV, Parquet, and Avro.
Experience designing solutions for both batch and streaming data.
Strong working knowledge of data warehousing concepts, specifically Redshift and Snowflake.
Experience in data management and data processing within an IT context.