Description

You will design, develop, and support Big Data applications within a distributed environment.

Responsibilities

• Conduct POCs and pilots to evaluate new solutions and summarize technical results.
• Participate in detailed technical design, implementation, and support of Big Data applications.
• Maintain standards compliance and align development artifacts with established engineering patterns and frameworks.
• Write and tune optimized Spark and Hive SQL to resolve poor performing queries.

Required Skills

• 3+ years of experience with Java and/or Scala, preferably using the Spring framework.
• Strong programming skills in Java or Scala.
• Proficiency in SQL and relational databases such as PostgreSQL, MySQL, SQL Server, or Oracle.
• Familiarity with Spark programming paradigms for both batch and stream-processing.
• Understanding of Spark data abstraction objects, optimal data formats, and optimization techniques.
• Experience with Python and Unix/Linux shells.
• Knowledge of common algorithms and data structures.
• Experience deploying to cloud platforms, specifically Pivotal Cloud Foundry or Cloud Foundry.
• Experience with CI/CD tools and pipelines including Jenkins, Maven, or Gradle.
• Familiarity with Agile/Scrum development methodologies.

Preferred Skills

• Experience with stream processing or queuing technologies like Spark Streaming, Kafka, Kinesis, or Flink.

Key Skills

Education

Any Graduate