Description

You will build and maintain data processing systems using distributed technologies in Atlanta, GA.

You will own the development of batch and streaming data solutions, implementing real-time or near real-time data ingestion pipelines while applying programming best practices and working within Agile/Scrum methodologies.

Responsibilities

• Develop batch and streaming data solutions using Big Data technologies.
• Implement real-time or near real-time data ingestion pipelines.
• Apply programming best practices to data engineering workflows.
• Work within Agile/Scrum methodologies to deliver technical requirements.

Required Skills

• 8+ years of professional experience in data engineering.
• Hands-on experience with Spark, preferably using Scala.
• Proficiency in Java, Scala, or Python.
• Experience with Hadoop ecosystems.
• Experience with Kafka for data streaming.
• Practical knowledge of real-time or near real-time ingestion.
• Familiarity with Agile/Scrum frameworks.

Key Skills

Education

Not specified