Description

Manage and optimize large-scale data pipelines and big data infrastructure.

This role is remote.

Responsibilities

• Maintain and troubleshoot complex system and application stacks to ensure stability.
• Solve for scalability, performance, and stability within big data environments.
• Manage real-time, streaming, and data pipelines using NiFi and Kafka.
• Perform performance tuning on database schemas, SQL, and ETL jobs.
• Monitor enterprise metrics using frameworks like Splunk, Druid, and Grafana.

Required Skills

• 10+ years of experience in Site Reliability Engineering or DevOps roles.
• Expert knowledge of Apache NiFi and the Hadoop ecosystem.
• Deep expertise in Linux and Unix operating systems.
• Strong scripting skills in Python and Shell.
• Proven experience troubleshooting network and server communication.
• Hands-on experience with SQL and database performance tuning.
• Ability to manage and monitor complex data stacks.

Preferred Skills

• Experience with Spark.
• Familiarity with Kafka for streaming data pipelines.

Key Skills

Education

Any Graduate