Description

Design, develop, and maintain data solutions and back-end services using Python and PySpark.

This role is on-site.

Responsibilities

• Develop Python and PySpark programs for data analysis and custom rule engines.
• Gather data from HBase and implement solutions using PySpark.
• Apply business transformations using Apache Spark DataFrames and RDDs.
• Perform read/write operations using Hive Context objects.
• Develop back-end services and APIs, optimizing for performance and security.

Required Skills

• 5+ years of professional experience.
• Strong proficiency in Python.
• Hands-on experience with Apache Spark and PySpark.
• Experience building APIs and back-end services.
• Working knowledge of HBase and Hive.
• Ability to design custom frameworks and rules engines.
• Experience troubleshooting and resolving software defects.

Preferred Skills

• Background in building data analysis pipelines.
• Experience with large-scale data transformations.

Key Skills

Education

Any Gradute