Description

You will develop and optimize PySpark applications to process large-scale datasets.

Responsibilities

• Develop and optimize PySpark applications for data processing.
• Write and optimize complex SQL queries for relational databases.
• Analyze technical problems and implement efficient data solutions.
• Collaborate with team members to deliver technical requirements.

Required Skills

• 2+ years of hands-on experience as a PySpark Developer.
• Proficiency in PySpark, including Spark SQL, DataFrames, and RDDs.
• Experience with Spark Streaming.
• Strong knowledge of SQL and relational database management.
• Ability to write and optimize complex SQL queries.
• Analytical and problem-solving skills.
• Any graduate degree.

Preferred Skills

• Familiarity with big data platforms such as Hadoop, Hive, or AWS EMR.

Key Skills

Education

Any graduate