Description

You will own the stability, scalability, and performance of large-scale data pipelines and big data infrastructure.

Responsibilities

• Troubleshoot complex system and application stacks to resolve performance bottlenecks.
• Manage and optimize real-time streaming and data pipelines.
• Perform tuning of database schemas, SQL queries, and ETL jobs.
• Maintain and monitor enterprise metrics using Splunk, Druid, and Grafana.
• Debug network and server communication issues within the data stack.

Required Skills

• 10+ years of experience in Site Reliability Engineering or DevOps.
• Expert-level proficiency with Apache NiFi.
• Deep knowledge of Linux operating systems and Unix environments.
• Advanced scripting skills in Python and Shell.
• Operational experience with Big Data stacks, including the Hadoop ecosystem.
• Experience with Kafka and real-time streaming frameworks.
• Strong SQL skills and experience managing ETL processes.
• Proven ability to solve for system scalability and stability.
• Expertise in troubleshooting complex distributed systems.

Preferred Skills

• Experience with Apache Spark.

Key Skills

Education

Any Graduate