Description

You will build and maintain scalable data systems and pipelines.

Responsibilities

• Develop and implement scalable solutions using Spark, Scala, and Big Data Hadoop.
• Manage system integrations and optimize data pipelines.
• Gather business requirements and design functional specifications.
• Collaborate with business stakeholders and technical teams to align technical solutions with business goals.
• Conduct system testing and deliver user training.

Required Skills

• 10+ years of experience in data engineering.
• Strong proficiency in Spark, Scala, and Spark Streaming.
• Hands-on experience with Kafka and Cassandra.
• Advanced and basic SQL skills.
• Knowledge of Python and Unix shell scripting.
• Experience with Big Data Hadoop ecosystems.
• Expertise in business process mapping and requirements gathering.
• Experience working within Agile development methodologies.
• Bachelor's degree in any field.

Preferred Skills

• AWS experience.

Key Skills

Education

Any Gradute