Description

You will design, build, and manage high-volume data pipelines and logging infrastructures.

This role is on-site.

Responsibilities

• Build and maintain Logstash pipelines for high-volume data flows within the ELK stack.
• Develop data processing workflows using Apache NiFi, Airflow, AWS Glue, or Azure Data Factory.
• Deploy and manage containerized applications using Docker and Kubernetes.
• Own the release pipeline and containerized application deployments.
• Analyze datasets to identify patterns, correlate data points, and solve business use cases.

Required Skills

• 8+ years of professional experience, including 5+ years in data engineering.
• Hands-on experience with the ELK stack and Logstash.
• 2+ years of experience with Python and frameworks such as Django or FastAPI.
• Proficiency with data flow tools: Apache NiFi, Apache Airflow, AWS Glue, or Azure Data Factory.
• Experience working with Kubernetes, Docker, and containerized platforms.
• Practical knowledge of CI/CD tools.
• Bachelor's degree in Software Engineering, Computer Science, Mathematics, or Information Systems.

Preferred Skills

• Experience with Google Cloud or Azure native data services.

Key Skills

Education

ANY GRADUATE