Description
You will build and manage scalable data solutions and pipelines.
This role is on-site.
Responsibilities
- Develop and implement scalable solutions using Spark, Scala, and Hadoop.
- Manage system integrations and optimize data pipelines.
- Gather business requirements and design functional specifications.
- Collaborate with stakeholders to align technical solutions with business goals.
- Conduct system testing and deliver user training.
Required Skills
- 5+ years of experience in data engineering.
- Strong proficiency in Spark, Scala, and Spark Streaming.
- Hands-on experience with Kafka and Cassandra.
- Advanced and basic SQL skills.
- Knowledge of Big Data Hadoop ecosystems.
- Proficiency in Python and Unix shell scripting.
- Experience with business process mapping and requirements gathering.
- Familiarity with Agile development methodologies.
Preferred Skills
- Experience working within AWS environments.