← Back to jobs
San Francisco, CA, USA
No related jobs found
Key Requirements
✅ 14–15+ years of experience in Data Engineering and Data Architecture
✅ Strong hands-on expertise with the Databricks Platform
✅ Deep technical experience in:
• PySpark
• Spark SQL
• Delta Lake
• Databricks Workflows
✅ Proven experience designing and architecting large-scale enterprise data platforms on at least one hyperscaler cloud:
☁️ AWS
• S3
• Glue
• Redshift
• Kinesis
• EMR
☁️ Azure
• Azure Data Factory (ADF)
• ADLS
• Synapse
• Event Hubs
☁️ Google Cloud Platform (GCP)
• Dataflow
• BigQuery
• Pub/Sub
✅ Advanced coding expertise in Python and SQL with strong experience in code optimization, reviews, and engineering best practices.
✅ Strong knowledge of:
• Data Modeling
• Dimensional Modeling
• Lakehouse Architecture
• Modern Data Design Patterns
AI & Modern Data Platform Experience
✅ Understanding of the evolving AI ecosystem, including:
• Large Language Models (LLMs)
• Generative AI
• Enterprise AI Platforms
• AI Coding Assistants
✅ Hands-on experience with AI productivity tools:
• GitHub Copilot
• ChatGPT
• Claude
• Cursor
• Similar AI-assisted development platforms
✅ Strong understanding of AI/ML concepts and how modern data platforms enable AI-powered products, advanced analytics, and business intelligence solutions
Bachelor's degree
No related jobs found
← Back to jobs