Description

You will build and operate large-scale data infrastructure supporting millions of users at a 100+ PB scale.

Responsibilities

• Build and operate data infrastructure across on-premise and AWS environments.
• Scale and operationalize big data technologies including Spark, Kafka, Presto, Flink, and Hadoop.
• Maintain data infrastructure reliability and quality through monitoring, alerting, and incident response.
• Write code, maintain documentation, participate in code reviews, and mentor engineers.
• Reduce technical debt through continual investment in system stability.

Required Skills

• 5+ years of professional experience.
• Proficiency in Python, Java, or other scripting languages.
• Hands-on experience managing Kubernetes clusters or running distributed applications in Kubernetes.
• Experience with AWS technologies including EC2, S3, RDS, and IAM.
• Ability to debug complex issues within large-scale distributed systems.
• Experience with distributed systems such as Spark, Flink, Kafka, or Cassandra.
• Degree in Computer Science, Computer Engineering, or equivalent practical experience.

Preferred Skills

• Experience with Hadoop and Presto.

Key Skills

Education

Any Graduate