Description

You will architect and implement large-scale big data solutions across major cloud ecosystems. This role is on-site.

Responsibilities

• Define, design, and implement large-scale data automation frameworks.
• Engineer and embed data quality principles into pipelines, handling profiling, validation, and anomaly detection.
• Design and implement data platform solutions across AWS, Azure, and GCP.
• Lead technical teams and mentor engineers toward technical excellence.
• Apply advanced SQL for complex data analysis, validation, and optimization across data lake structures.

Required Skills

• 15+ years of progressive experience in software engineering.
• 5+ years in a Technical Architect, Lead Data Architect, or Principal Data Engineer role focused on data governance or platform architecture.
• Expert-level proficiency with Apache Spark (PySpark, Scala, or Java), including Spark SQL and advanced tuning.
• Deep understanding of distributed storage using Hadoop, HDFS, S3, Delta Lake, or Apache Iceberg.
• Expert-level hands-on experience with Python for data engineering and automation.
• Extensive experience designing data solutions on AWS, Azure, or GCP.
• Demonstrated expertise in data quality engineering methodologies.
• Strong grasp of SDLC and integrating quality gates into CI/CD pipelines.

Preferred Skills

• Any Graduate

Key Skills

Education

Any Graduate