Description

Manage log data platforms at the intersection of infrastructure and data engineering.

This role is on-site.

Responsibilities

• Develop ETL pipelines using Java, JavaScript, or Python on Unix to extract, transform, and load log data.
• Implement scalable, fault-tolerant solutions for data ingestion, processing, and storage.
• Automate platform management processes using Ansible or other scripting tools.
• Troubleshoot incidents, identify performance bottlenecks, and resolve root causes for data processing issues.
• Support the full systems engineering lifecycle, including design, testing, implementation, and documentation.

Required Skills

• 5+ years of experience in data engineering or DataOps roles.
• Expertise in AWS computing environments including ECS, EKS, EC2, and Lambda.
• 3-5 years of experience designing and deploying data lakes using S3, Firehose, IAM, and Terraform.
• Proficiency in Python, Java, or JavaScript for data pipeline development.
• Strong experience with Infrastructure as Code using Terraform and Ansible.
• Hands-on experience with CI/CD practices and version control using GitLab.
• Proficiency in distributed Linux environments.
• Experience implementing monitoring, logging, and alerting solutions such as Prometheus and Grafana.

Key Skills

Education

Any Gradute