Description

You will own the design and implementation of scalable observability infrastructure within AWS.

Responsibilities

• Develop and maintain tools for system monitoring, logging, and alerting.
• Collaborate with cross-functional teams to identify and resolve performance bottlenecks.
• Automate repetitive engineering tasks to improve efficiency.
• Monitor system SLAs and publish health check dashboards to leadership.

Required Skills

• 7+ years of professional experience in Data Engineering.
• 5+ years of experience with Spark, SQL, ETL Testing, AWS Glue, AWS Glue Catalog, and AWS Athena.
• Expertise in observability platforms, specifically Prometheus, Grafana, and ELK Stack.
• Proficiency with PySpark and AWS Glue.
• Strong understanding of distributed systems and microservices architecture.
• Experience with cloud platforms, particularly AWS.
• Knowledge of DevOps practices and tools.
• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or equivalent.

Key Skills

Education

Bachelor's or Master's degrees