Description

Lead the architecture and development of an enterprise-scale data platform in a greenfield GCP environment.

Responsibilities

• Architect core components using microservices to abstract infrastructure complexities.
• Develop data platform SDKs, libraries, and connector frameworks for on-prem and cloud sources.
• Optimize data storage, processing, and querying performance for large-scale datasets while managing costs.
• Implement security patterns, data quality frameworks, and observability practices.
• Collaborate with cloud and security architects to align platform development with technology strategy.

Required Skills

• 10+ years of experience in modern cloud data engineering and software engineering.
• Proven track record of architecting enterprise-scale data platforms in greenfield environments.
• Expertise in building end-to-end data platforms specifically within the GCP ecosystem.
• Proficiency with BigQuery, Cloud Functions, Cloud Run, Dataform, Dataflow, Dataproc, and PubSub.
• Strong programming skills in Python and SQL.
• Experience with orchestration using Airflow.
• Hands-on experience with microservices using Kubernetes and Docker.
• Experience designing batch and real-time streaming infrastructure and workloads.
• Deep understanding of data lakehouse architectures, data modeling, and DataOps principles.

Preferred Skills

• Experience with Data Mesh architecture and building semantic layers for data platforms.
• Experience building scalable IoT architectures.

Key Skills

Education

Any Gradute