Description

Design and build scalable data lake and warehouse architectures for near real-time processing. Own the end-to-end solution from ingestion to consumption.

Responsibilities

• Design repeatable solution architectures and data ingestion pipelines for ERP systems like SAP.
• Manage data integration using Databricks, Snowflake, or equivalent platforms.
• Develop data models using Star, Snowflake, and Flattened schemas for OLTP and OLAP access patterns.
• Triage, debug, and fix technical issues related to data lakes and warehouses.
• Lead hands-on prototyping of new technology solutions and participate in major architectural decisions.

Required Skills

• 5+ years operating on AWS Cloud building data lake and data warehousing architectures.
• 5+ years building data warehouses on Snowflake, Redshift, HANA, Teradata, or Exasol.
• 3+ years with AWS data services: S3, Glue, Lake Formation, EMR, Kinesis, RDS, and DMS.
• 3+ years in data modeling and 3+ years with Spark or equivalent big data technologies.
• 3+ years building Delta Lakes using Databricks.
• 3+ years with ETL tools such as Talend, Informatica, or SAP Data Services.
• 3+ years in Python, R, Scala, or Java.
• 3+ years integrating data from ERP systems like SAP.
• Bachelor's degree in Computer Science, IT, Data Science, Data Analytics, or related field.

Preferred Skills

• Experience with AWS Bedrock.

Key Skills

Education

Any Graduate