Description

You will lead the development and maintenance of large-scale data applications using the Apache Spark framework in McLean, VA.

Responsibilities

• Develop, program, and maintain applications using the Apache Spark open source framework.
• Design and implement cloud-based solutions using AWS services including S3, Lambda, Step Functions, AMQ, SNS, SQS, and CloudWatch Events.
• Build and manage microservices using Spring Boot, REST APIs, and GraphQL.
• Design and implement queue-based architectures and streaming data platforms.
• Manage non-functional requirements including security, transactions, monitoring, and performance.

Required Skills

• 12+ years of experience in Big Data with a heavy data background.
• Expertise in Apache Spark, including Spark SQL, DataFrames, Datasets, and streaming.
• Strong programming proficiency in Java, Scala, or Python.
• Deep understanding of distributed systems and the Hadoop ecosystem.
• Hands-on experience with Kubernetes and ELK (Elasticsearch, Logstash, Kibana).
• Proficiency in NoSQL (MongoDB) and ORM frameworks like JPA or Hibernate.
• Experience with DevOps toolchains including Jenkins, Artifactory, Ansible, Chef, Puppet, or Spinnaker.
• Knowledge of build tools such as Maven or Gradle and the Atlassian Tool suite.
• Practical application of TDD/ATDD methodologies.

Preferred Skills

• Experience with Skill Development and mentoring engineering teams.

Key Skills

Education

Any Graduate