You will build and maintain large-scale data processing systems using Java and Spark.
Responsibilities
- Develop data pipelines using Spark and Java to process large datasets.
- Manage and optimize big data workflows within the Apache Hadoop ecosystem.
- Implement real-time data streaming solutions using Kafka.
- Write and optimize complex SQL queries for data extraction and analysis.
- Integrate and maintain APIs for data access and system connectivity.
Required Skills
- 5+ years of professional experience in data engineering.
- Strong proficiency in Java.
- Hands-on experience with Apache Spark.
- Experience working with Big Data technologies and Apache Hadoop.
- Expertise in Kafka for data streaming.
- Advanced SQL skills.
- Experience developing and consuming APIs.
- Bachelor's degree or equivalent experience.