Description

You will design and build batch and streaming data solutions within a Big Data ecosystem.

This role is hybrid.

Responsibilities

• Design and develop scalable data architectures using Big Data technologies.
• Implement real-time and near real-time data ingestion pipelines.
• Develop software using open-source technologies to interface with distributed and relational data sources.
• Collaborate with architects to assess technologies for data transformation and storage.
• Work with cross-functional teams to define functional and system requirements.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Hands-on experience with Hadoop and Spark.
• Proficiency in PySpark and Scala.
• Experience implementing real-time or near real-time data ingestion.
• Proficiency with Agile and Scrum methodologies.
• Strong problem-solving skills with the ability to manage multiple priorities.
• Effective oral and written communication skills for explaining technical problems.

Preferred Skills

• Degree in Computer Science, Information Systems, or a related field.

Key Skills

Education

Any Graduate