Description

• Design, develop, and maintain modular Python applications, reusable utility frameworks, APIs, and data solutions on Databricks.
• Build and optimize curated datasets and semantic data models to support reporting, analytics, and self-service BI use cases.
• Develop data transformation and processing workflows using Databricks, Spark, Python, and SQL.
• Configure, maintain, and optimize Databricks Genie/AI-BI Spaces, ensuring high-quality natural language query experiences for business users.
• Define metadata, business instructions, semantic definitions, and governance standards within Genie environments.
• Build and maintain data assets using Databricks SQL and Unity Catalog.
• Collaborate with business stakeholders to understand analytical requirements and translate them into scalable data solutions.
• Monitor, troubleshoot, and optimize application performance, query execution, and data processing workloads.
• Ensure adherence to coding standards, security policies, and data governance best practices.
• Support production deployments, incident resolution, and continuous improvement initiatives.

Qualifications:
Must-Have Skills

• 2-4 years of experience in Databricks development and data engineering.
• Strong programming expertise in Python.
• Strong hands-on experience with SQL and Databricks SQL.
• Experience developing modular applications, utilities, reusable libraries, and APIs.
• Knowledge of Apache Spark and distributed data processing concepts.
• Experience building curated datasets and semantic layers for analytics consumption.
• Hands-on experience with Unity Catalog for governance, lineage, and access management.
• Exposure to configuring and optimizing Databricks Genie / AI-BI Spaces.
• Understanding of metadata management, prompt/instruction configuration, and natural language query optimization.
• Strong debugging, troubleshooting, and performance optimization skills.

Good-to-Have Skills

• Experience with Delta Lake.
• Exposure to ETL/ELT pipeline development.
• Familiarity with Azure or AWS cloud environments.
• Experience with CI/CD practices and deployment automation.
• Databricks certification is an added advantage.
• Knowledge of data visualization and BI platforms such as Power BI or Tableau

Key Skills

Education

Bachelor's degree