← Back to jobs

Prophecy Technologies Logo
Databricks Data Engineer

Prophecy Technologies

 

Hyderabad, Telangana, India

Posted On: Just posted
Experience: 5+ years
Availability: Onsite
Openings: 1
Category: Databricks data engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Role Overview:

We are looking for an experienced Data Engineer with strong hands-on expertise in Databricks and Snowflake to design, develop, and maintain scalable data engineering solutions. The candidate should have experience working with modern cloud-based data platforms, data pipelines, and orchestration tools, along with exposure to legacy data environments.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Databricks and PySpark.
  • Work on data ingestion, transformation, processing, and loading into Snowflake.
  • Develop and optimize complex SQL queries, data models, and Snowflake objects.
  • Build and manage ETL/ELT workflows and data integration processes.
  • Use Apache Airflow for workflow orchestration, scheduling, and monitoring.
  • Work with Unix/Linux environments, including shell scripting and job scheduling.
  • Support and maintain existing legacy ETL processes and integrate them with modern data platforms.
  • Perform data validation, troubleshooting, performance tuning, and production support.
  • Collaborate with cross-functional teams to deliver reliable and efficient data solutions.

Required Skills:

  • Strong hands-on experience with Databricks and Snowflake.
  • Good knowledge of PySpark and Python.
  • Strong SQL skills, including query optimization and performance tuning.
  • Experience in developing and managing ETL/ELT data pipelines.
  • Working knowledge of Apache Airflow for workflow orchestration.
  • Good understanding of Unix/Linux commands and shell scripting.

Qualifications:

  • 5+ years of experience

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs