← Back to jobs

Nestor Technologies. Logo
PySpark Tech Lead

Nestor Technologies.

 

Pleasanton, CA, USA

Posted On: 4 days ago
Experience: 5+ years
Availability: Onsite
Openings: 1
Category: Pyspark Developer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

Lead the design and implementation of large-scale data engineering and analytics solutions.

There is no remote, hybrid, or on-site flag set to 1; work mode is not specified.

Responsibilities

  • Build and operate large-scale data warehouses and data lakes.
  • Design, code, and optimize ETL processes and data pipelines for low-latency streaming.
  • Refactor existing Python code to PySpark and implement NVIDIA Clara optimizations.
  • Develop back-end components and integrate data storage solutions like SQL and MongoDB.
  • Manage data quality, track lineage, and improve data discoverability.

Required Skills

  • 10+ years of relevant experience in data engineering or software development.
  • 8+ years of experience as a Python, PySpark, and SQL developer.
  • Expertise in writing Python and PySpark code from scratch to ingest and transform data.
  • Proficiency in SQL, relational databases, and normalization.
  • Extensive experience developing, maintaining, and managing Python code.
  • Experience connecting to diverse data sources for Business Intelligence.
  • Hands-on experience with NVIDIA Clara.

Preferred Skills

  • Ability to write scalable code and perform application refactoring.
  • Proven track record in testing, debugging, and integrating server-side logic.

Education

ANY GRADUATE

Related Jobs

No related jobs found

← Back to jobs