Description

You will own the stability and performance of data pipeline infrastructure using Datadog and Vector.dev.

Responsibilities

• Manage the setup, configuration, and maintenance of data pipelines.
• Monitor pipeline performance via Datadog to identify and resolve issues.
• Optimize pipelines for performance, scalability, and reliability under high-volume ingestion.
• Integrate diverse data sources by collaborating with data engineers and developers.
• Maintain technical documentation for configurations, processes, and troubleshooting.

Required Skills

• 5+ years of experience in managing data pipelines.
• Hands-on experience with Vector.dev for data pipeline management.
• Proficiency with Datadog for monitoring and observability.
• Experience with scripting languages including Python and Bash.
• Familiarity with cloud platforms such as AWS or Azure.
• Proven ability to structure logs and implement rate limiting and security within pipelines.
• Strong analytical skills for troubleshooting complex pipeline issues.
• Any Graduate degree.

Key Skills

Education

Any Graduate