Description

Lead the design and implementation of data engineering and analytics solutions using Python and PySpark.

Responsibilities

  • Build and operate large-scale data warehouses and data lakes.
  • Design, code, and optimize ETL processes for low-latency streaming and processing.
  • Refactor Python code to PySpark to improve scalability and performance.
  • Ensure data quality, track data lineage, and improve data discoverability.
  • Coordinate with development teams to define requirements and prioritize feature requests.

Required Skills

  • 5+ years of experience in data engineering or backend development.
  • Expertise in Python programming and PySpark.
  • Experience building scalable data pipelines and ETL optimizations.
  • Strong background in integrating data storage solutions and reprogramming databases.
  • Proven ability to test and debug complex applications.
  • Experience working within Agile and DevOps environments.
  • Ability to coordinate projects and communicate effectively with senior leadership.
  • Experience developing back-end components and integrating server-side logic.

Key Skills
Education

ANY GRADUATE

Back To Jobs