← Back to jobs

VDart Logo
PySpark Architect

VDart

 

United States

Posted On: 30+ days ago
Experience: 12+ years
Availability: Onsite
Openings: 1
Category: Databricks/Pyspark Architect
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

Architect and implement advanced analytics solutions using Azure Databricks Fabric.

Responsibilities

  • Lead the design and implementation of advanced analytics solutions.
  • Develop data pipelines and ETL processes using Azure Databricks, PySpark, and Azure Data Factory.
  • Integrate Azure Databricks with Azure Data Lake, Synapse, and Data Factory.
  • Oversee end-to-end data solution implementation aligned with business requirements.
  • Provide technical leadership and mentor the data engineering team.

Required Skills

  • 12+ years of expertise developing data ingestion and transformation pipelines.
  • Strong experience with Azure Databricks, including cluster management and notebook development.
  • Proficiency in big data technologies like Hadoop and PySpark.
  • Deep understanding of Azure services: Azure Data Lake, Synapse, and Data Factory.
  • Strong SQL skills and familiarity with NoSQL databases.
  • Experience with ETL/ELT processes, data warehousing, and data lakes.
  • Familiarity with CI/CD pipelines and Git version control.

Preferred Skills

  • Bachelor's degree in Computer Science or related field.

Education

Bachelor's degree

Related Jobs

No related jobs found

← Back to jobs