Description

You design and develop scalable integrations with Apache Spark Engine and Spark Flow for the Unity platform, building and consuming RESTful APIs to enable seamless system interoperability.

This role is on-site.

Responsibilities

• Develop scalable integrations using Apache Spark Engine and Spark Flow.
• Build and integrate RESTful APIs and microservices for system interoperability.
• Process and manage high-volume data using large-scale distributed compute frameworks.
• Drive performance tuning, optimization, and scalability improvements.
• Debug complex issues and solve problems within big data ecosystems.

Required Skills

• 5+ years of experience with Apache Spark, Hadoop, Hive, SQL, and Kafka.
• Hands-on experience building and integrating APIs and microservices.
• Exposure to cloud platforms including AWS, Azure, or GCP.
• Bachelor's degree in a relevant field.
• Strong problem-solving and debugging skills.
• Experience with large-scale distributed compute frameworks.
• Ability to drive performance tuning and optimization.

Preferred Skills

• Familiarity with Spark Flow for advanced workflow management.
• Experience with multiple cloud providers (AWS, Azure, GCP).

Key Skills

Education

Bachelor's degree