← Back to jobs

Quantum Technologies LLC Logo
Senior Backend Engineer (Spark, Scala, Python, AWS/GCP)

Quantum Technologies LLC

 

Elk Grove, CA, USA

Posted On: Just posted
Experience: 5+ years
Availability: Onsite
Openings: 2
Category: Senior Backend Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will design, develop, and maintain scalable data pipelines and backend systems using Spark, Python, Scala, and Java. This role is on-site.

Responsibilities

  • Build and optimize ETL processes using SQL, DataFrames, and Spark.
  • Implement real-time data streaming pipelines with MSK/Kafka.
  • Manage data storage and retrieval using S3 and data lake technologies like Iceberg.
  • Troubleshoot pipeline issues and ensure data quality and security.
  • Collaborate with data scientists to deliver data-driven solutions.

Required Skills

  • 5+ years of backend development experience with a focus on data engineering.
  • Strong proficiency in Spark, Python, Scala, and Java.
  • Expertise in SQL and relational databases.
  • Experience with cloud technologies, preferably AWS or GCP.
  • Hands-on experience with message streaming platforms like MSK/Kafka.
  • Knowledge of S3 or similar object storage solutions.
  • Understanding of data lake technologies such as Iceberg.
  • Bachelor’s degree in computer science or equivalent experience.

Preferred Skills

  • Experience with data modeling, schema design, and data governance.
  • Familiarity with DevOps practices and CI/CD pipelines.
  • Relevant cloud certifications (e.g., AWS Certified Data Engineer).

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs