Description

You will design, implement, and optimize large-scale data systems and cloud-based platforms.

This role is hybrid.

Responsibilities

• Lead the design and development of scalable data architectures on AWS.
• Build and optimize complex batch and real-time data pipelines.
• Architect and manage Data Lakes ensuring ACID compliance and schema evolution.
• Manage Snowflake for cloud data warehousing and query optimization.
• Develop data models and Tableau dashboards for business stakeholders.

Required Skills

• 5+ years of experience in Data Engineering or large-scale distributed data systems.
• Proficiency in Apache Spark using Scala and PySpark.
• Hands-on experience with Kafka Streams using Java for real-time processing.
• Deep knowledge of AWS services: S3, Glue, EMR, Lambda, Redshift, and Athena.
• Experience implementing Apache Iceberg within Data Lake architectures.
• Proficiency in Snowflake for data modeling and warehousing.
• Advanced SQL skills for querying relational and NoSQL databases.
• Bachelor's or Master's degree in a relevant field.

Preferred Skills

• Experience with CI/CD implementation.

Key Skills

Education

Bachelor's or Master's degrees