Description

You will own the architecture and implementation of large-scale data platforms.

Responsibilities

• Design and implement large-scale data automation frameworks.
• Define and enforce data quality engineering principles, methodologies, and tools.
• Architect solutions across major cloud data platforms (AWS, Azure, GCP).
• Lead and mentor technical teams on data platform architecture.

Required Skills

• 15+ years of progressive software engineering experience, with 5+ years in a Technical Architect or Lead Data Architect capacity.
• Expert-level proficiency with Apache Spark (PySpark, Scala, or Java), including performance tuning and streaming.
• Deep architectural understanding of distributed storage systems (Hadoop, S3, Delta Lake, Iceberg).
• Expert-level hands-on experience with Python and Advanced SQL for data engineering and validation.
• Proficiency with streaming technologies like Apache Kafka.
• Extensive design experience on AWS, Azure, or GCP data services.
• Strong understanding of SDLC and integrating quality gates into CI/CD pipelines.

Key Skills

Education

Bachelor's or Master's degrees