Description

Scale and operate distributed systems to support large-scale data processing. Automate infrastructure and build reliable, maintainable environments.

Responsibilities

• Scale and operate distributed systems including big data processing engines and distributed file systems.
• Manage resource management systems and Identity and Access Management protocols.
• Automate infrastructure using code and systems automation tools.
• Debug complex issues within large-scale distributed environments.
• Build reliable, maintainable, and easy-to-use infrastructure.

Required Skills

• 5+ years of professional experience.
• Any Graduate degree.
• 3+ years scaling distributed systems (Apache Hadoop, Apache Spark, HDFS, CEPH, or S3).
• 3+ years with infrastructure as code and systems automation.
• Experience with streaming systems (Apache Flink or Apache Kafka).
• Experience with resource management systems (Kubernetes or Apache Mesos).
• Experience with Identity and Access Management tools (Apache Ranger, Sentry, or OPA).
• Fluency in Java or a similar programming language.

Preferred Skills

• Experience with Spark and ETL processing pipelines.
• Experience with Helm charts, CI/CD technology, and systems security.
• Knowledge of identity protocols and encryption.

Key Skills

Education

Any Graduate