Description

Required Skills • 8+ years of Data Engineering experience. • Strong hands-on experience with Databricks, Apache Spark, and PySpark. • Advanced proficiency in Python and SQL. • Experience designing and developing ETL/Data Ingestion Pipelines. • Strong knowledge of Data Lake and Medallion Architecture. • Experience developing and consuming REST APIs using FastAPI. • Hands-on experience with AWS, Azure, and GCP. • Experience with BigQuery, AWS Athena, Azure Data Lake, and Cosmos DB. • Proficiency with Git and CI/CD workflows. Preferred Skills • Experience with LangChain, LangGraph, or Agentic AI frameworks. • Knowledge of cloud cost optimization or FinOps concepts. • Experience building AI-powered automation solutions. Keywords: Databricks, PySpark, Spark, Python, SQL, FastAPI, LangChain, LangGraph, Agentic AI, ETL, Data Pipeline, Data Lake, Medallion Architecture, AWS, Azure, GCP, BigQuery, Athena, Cosmos DB, Git, CI/CD

Key Skills

Education

Bachelor's degree