You will develop and maintain data processing applications within the software development life cycle.
Responsibilities
- Build scalable microservices using Python or JVM languages.
- Collaborate with architects, engineers, data scientists, and analysts to implement new applications and enhancements.
- Conduct design and code reviews to ensure quality and compliance with standards.
- Partner with product and engineering leadership on delivery strategy, roadmaps, and timelines.
- Estimate the level of effort required to meet acceptance criteria.
Required Skills
- 5+ years of experience with Spark Core and Spark SQL.
- Expertise in Spark, Scala, and PySpark.
- Strong proficiency in SQL, Python, and shell scripting.
- Hands-on experience with Apache Kafka.
- Experience with Hive, Sqoop, and Hadoop.
- Working knowledge of NoSQL databases.
- Experience with Oracle, SQL Server, and other major databases.
- Ability to lead, guide, and mentor junior developers.
- Bachelor’s Degree in Computer Science, Computer Engineering, or a closely related field.
Preferred Skills
- Experience with Hadoop configuration and maintenance.