Description

Lead the design and implementation of large-scale data engineering and analytics solutions.

Responsibilities

• Build and operate large-scale data warehouses and data lakes.
• Design, code, and optimize ETL processes and data pipelines for low-latency streaming and processing.
• Refactor existing Python code to PySpark and implement NVIDIA Clara optimizations.
• Develop back-end components and integrate data storage solutions like SQL and MongoDB.
• Manage data quality, track lineage, and improve data discoverability.

Required Skills

• 10+ years of relevant experience in data engineering or software development.
• 8+ years of experience as a Python, PySpark, and SQL developer.
• Expertise in writing Python and PySpark code from scratch to ingest and transform data.
• Proficiency in SQL, relational databases, and normalization.
• Extensive experience developing, maintaining, and managing Python code.
• Experience connecting to diverse data sources for Business Intelligence.
• Hands-on experience with NVIDIA Clara.
• Ability to write scalable code and perform application refactoring.
• Proven track record in testing, debugging, and integrating server-side logic.

Key Skills

Education

ANY GRADUATE