Description

You will design, develop, and maintain data solutions using Python and Spark. You will own the full lifecycle of data processing, from ingestion to transformation and delivery.

Responsibilities

• Design and implement custom rule engines and frameworks using Python.
• Develop PySpark programs to extract data from HBase and apply business transformations via DataFrames and RDDs.
• Build and maintain back-end services, APIs, and database integrations.
• Optimize applications for performance, security, and maintainability.
• Troubleshoot and resolve software defects and production issues.

Required Skills

• 5+ years of professional experience with Python.
• Strong proficiency in Apache Spark and PySpark.
• Experience developing custom frameworks, particularly rule engines.
• Hands-on experience with HBase for data retrieval.
• Proficiency in designing and integrating back-end APIs and services.
• Ability to optimize code for performance and maintainability.
• Experience with Hive Context for read/write operations.
• Bachelor's degree in any discipline.

Key Skills

Education

Any Graduate