You will own analytics implementation measuring the impact of GenAI-powered CI/CD services.
Responsibilities
Define KPIs (resolution time, code-proposal accuracy, cost impact, feedback/adoption) and augment DORA with diagnostic metrics.
Design, build, and operate data pipelines from CI/CD systems (Jenkins/Azure, GitHub, JaaS) into HANA models; publish datasets and dashboards in SAP SAC and Grafana.
Implement telemetry and guardrails for GenAI operations (hallucination/cost/latency metrics, SLAs) to ensure actionable observability.
Investigate and resolve data quality issues; define data contracts and coordinate fixes with data owners.
Run analyses and experiments on model/workflow changes; provide evidence-based recommendations for rollout decisions.
Required Skills
5+ years of strong experience in hands-on analytics for production systems (CI/CD, developer tooling, or platform services).
Strong SQL proficiency, with SAP HANA Cloud preferred.
Strong Python skills, including pandas/NumPy.
Demonstrated experience delivering SAC stories and/or Grafana dashboards with alerts and drill-downs.
Working knowledge of CI/CD telemetry and DORA (DevOps Research and Assessment) KPIs.
Proven ability to go beyond standard DORA metrics to isolate bottlenecks.
Demonstrated rigor in data quality and lineage (end-to-end traceability of data).
Clear communication skills and fluency in English.
Familiarity with GenAI/LLM observability metrics (hallucination, latency, cost).