Description

You will build and maintain distributed systems and cloud infrastructure within an AWS environment.

Responsibilities

• Manage Kubernetes environments, specifically using AWS EKS.
• Develop data pipelines using Apache Spark and Spark Structured Streaming.
• Implement alerting, monitoring dashboards, and remediation automation for large-scale distributed systems.
• Optimize cloud infrastructure for automation, performance, and cost-savings.
• Configure AWS networking and storage components including VPC, NLB, Ingress, and S3.

Required Skills

• 5+ years of professional experience in software engineering.
• Proficiency in Java, Scala, or Python, with a preference for Java.
• Hands-on experience with Apache Spark and related data stores such as Iceberg, Delta, or Kafka.
• Deep understanding of file formats like Parquet.
• Experience managing Kubernetes environments on AWS.
• Strong knowledge of AWS services including EKS, EC2, S3, VPC, NLB, and Ingress.
• Practical experience with Python or Shell scripting.
• Solid understanding of distributed systems and cloud computing principles.
• Experience with SQL.

Preferred Skills

• Experience with Iceberg or Delta Lake.
• Proficiency in Scala.

Key Skills

Education

Any gradudate