Description
You will build scalable applications using Scala and Spark to process big data.
Responsibilities
- Design and develop Spark applications within the Hadoop ecosystem based on customer requirements.
- Optimize applications for maximum speed, scalability, and performance standards.
- Debug existing code and perform testing to ensure applications are secure and bug-free.
- Maintain code versioning and deployment using CI/CD processes.
- Collaborate with designers, testers, and system engineers throughout the development cycle.
Required Skills
- 5+ years of experience in Data Engineering.
- Strong proficiency in the Scala programming language.
- Hands-on experience building Spark applications.
- Experience working within the Hadoop ecosystem.
- Practical knowledge of Big Data technologies.
- Experience with CI/CD processes and code versioning.
- Competency in debugging and application testing.
- Strong communication skills.
- Bachelor's degree in Computer Science or a related field.