Description

Design and implement enterprise-level big data solutions and perform analysis on large datasets. You will own the development of data processing pipelines and large-scale data engineering workflows.

Responsibilities

• Develop data processing pipelines for large volumes of data using Spark and Data Frames.
• Build and maintain large-scale data engineering workflows.
• Deliver production-ready big data solutions within a cloud environment.
• Perform deep analysis on massive datasets to drive technical decisions.

Required Skills

• 10+ years of experience as a Big Data Engineer.
• Expertise in Spark and Data Frames for large-scale data processing.
• Proficiency in Java, Python, and Scala.
• Hands-on experience with PySpark.
• Experience with GCP and Big Query.
• Working knowledge of Hive and Pig.
• Strong SQL skills.
• Experience with AWS and large-scale data engineering.

Preferred Skills

• Degree in Computer Science, Engineering, or equivalent experience.

Key Skills

Education

Any Graduate