← Back to jobs

Compunnel Logo
Big Data Engineer

Compunnel

 

Costa Mesa, California, USA

Posted On: 11 days ago
Experience: 5+ years
Availability: Hybrid
Openings: 1
Category: Big Data Engineer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

You will design and support scalable data solutions on AWS.

This role is on-site.

Responsibilities

  • Design and develop scalable API services using Java, Scala, or Kotlin.
  • Build and optimize data pipelines using PySpark and EMR.
  • Manage distributed storage including Cassandra, ScyllaDB, and DynamoDB.
  • Implement orchestration with Apache Airflow and AWS Step Functions.
  • Maintain CI/CD pipelines and automate tasks via Linux shell scripting.

Required Skills

  • 5+ years in software engineering or big data roles.
  • Strong proficiency in Java, Scala, or Kotlin.
  • Deep experience with Spark, EMR, and Hadoop.
  • Hands-on PySpark and AWS services (EC2, ECS, Step Functions, DynamoDB).
  • Knowledge of Kafka for data messaging.
  • Experience with Linux environments and shell scripting.
  • Solid DevOps skills including infrastructure automation.

Preferred Skills

  • Experience with Airflow, Jenkins, AWS CodePipeline, or Artifactory.
  • Familiarity with Docker and ECS/EKS containerization.

Education

Any Gradute

Related Jobs

No related jobs found

← Back to jobs