← Back to jobs

Prophecy Technologies Logo
Databricks Consultant

Prophecy Technologies

 

Houston, TX, USA

Posted On: Just posted
Experience: 7+ years
Availability: Hybrid
Openings: 1
Category: Databricks Consultant
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Design, develop, and implement scalable data solutions on the Databricks platform for enterprise stakeholders.

This role is hybrid.

Responsibilities

  • Design and develop data pipelines using Databricks, Apache Spark, and PySpark.
  • Build and maintain ETL/ELT processes for large-scale data ingestion and transformation.
  • Implement data lake and lakehouse architectures on Databricks.
  • Optimize Spark jobs and Databricks workloads for performance and cost efficiency.
  • Implement data quality, governance, security, and monitoring standards.

Required Skills

  • Strong hands-on experience with Databricks and 2+ years of implementation experience.
  • Expertise in Apache Spark, PySpark, and SQL.
  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Knowledge of Delta Lake, Unity Catalog, and Databricks Workflows.
  • Strong understanding of ETL/ELT frameworks and data modeling.
  • Familiarity with CI/CD, Git, and DevOps practices.
  • Bachelor's degree in Computer Science, IT, Engineering, or related field.
  • 7+ years of total experience in Data Engineering or Big Data.

Preferred Skills

  • Experience with Azure Data Factory (ADF), Azure Synapse, or AWS Glue.
  • Knowledge of Machine Learning and MLOps on Databricks.
  • Experience with streaming technologies such as Kafka and Structured Streaming.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs