Description

You will lead the design and implementation of complex data solutions.

This role is on-site.

Responsibilities

• Architect scalable data pipelines using Spark and related frameworks.
• Develop and optimize data processing logic using PySpark and Spark SQL.
• Manage and implement data structures utilizing Delta Lake.
• Solve complex data problems through coding and architectural decisions.

Required Skills

• 12+ years of professional experience in data engineering.
• Expert proficiency in Databricks.
• Strong command of PySpark and Spark SQL.
• Hands-on experience with Delta Lake.
• Familiarity with AWS cloud environment.
• Proven ability to solve complex data problems through coding and architecture.

Key Skills

Education

Any Gradute