Description

You will design and implement big data solutions onsite in Scottsdale, AZ, focusing on stream processing and data engineering.

Responsibilities

• Design and implement data solutions using Hadoop and Hive.
• Develop data processing pipelines using PySpark and Java.
• Manage job execution and scheduling using Shell scripting and CRON.
• Communicate directly with clients to gather and understand technical requirements.
• Support Kafka architectural implementations and stream data processing.

Required Skills

• 10+ years of experience in Big Data environments.
• In-depth understanding of Hadoop basics and Hive.
• 5+ years of hands-on experience with Java/J2EE.
• Proficiency with PySpark.
• Experience with Kafka and architectural patterns.
• Shell scripting skills, including CRON scheduling and command exit status capturing.
• Bachelor's degree in Computer Science.

Preferred Skills

• Experience with AWS.
• Understanding of stream data processing.

Key Skills

Education

Bachelor's degree in Computer Science