Description

You will build and maintain batch and streaming data solutions within a Big Data ecosystem.

Responsibilities

• Design and develop batch and streaming solutions using Big Data technologies.
• Collaborate with architects to design secure, scalable data architectures.
• Assess technologies and approaches for data ingestion, transformation, and storage.
• Develop software using open source technologies to interface with distributed and relational data sources.
• Work with cross-functional teams to identify functional and system requirements.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Hands-on experience with Hadoop, Spark, PySpark, and Scala.
• Experience implementing real-time or near real-time data ingestion.
• Proficiency with Agile and Scrum methodologies.
• Strong problem-solving skills and ability to manage multiple priorities.
• Effective oral and written communication skills for explaining technical problems.
• Degree in Computer Science, Information Systems, or a related field.

Key Skills

Education

Any Graduate