Description

You will design and manage high-volume data pipelines and logging infrastructures. You will own the release pipeline and containerized application deployments.

Responsibilities

• Build Logstash pipelines to handle high-volume data flows within the ELK stack.
• Develop and maintain data pipelines using Apache NiFi, Airflow, AWS Glue, or Azure Data Factory.
• Implement data processing workflows using Google Cloud or Azure native services.
• Deploy and manage containerized applications using Docker and Kubernetes.
• Analyze datasets to identify patterns, correlate data points, and solve business use cases.

Required Skills

• 8+ years of professional experience, including 5+ years in data engineering projects.
• Hands-on experience with the ELK stack and Logstash.
• 2+ years of experience with Python and frameworks such as Django or FastAPI.
• Proficiency with data flow tools: Apache NiFi, Apache Airflow, AWS Glue, or Azure Data Factory.
• Experience working with Kubernetes, Docker, and containerized platforms.
• Practical knowledge of CI/CD tools.
• Bachelor's degree in Software Engineering, Computer Science, Mathematics, or Information Systems.

Preferred Skills

• Experience with Google Cloud or Azure native data services.

Key Skills

Education

ANY GRADUATE