Quality Engineering Demo

Engineering Metrics Agent

A metrics agent that scans Git, CI and Jira signals, retrieves metric definitions, and writes a source-backed trend report.

Runnable demo · Repo path: workshops/workshop4-engineering-metrics

Structure Blueprint

Engineering Metrics Agent blueprint

Clickable pattern simulator

Interactive Browser Demo

This simulator does not replace the CLI run, but it makes each step, state, log, gate and final output visible in the browser.

Live pipeline

State inspector

Execution log

Current output

Step-by-step Design

01

Scan signals

Start broad across lead time, failure rate and review load.

Progressive Discovery
02

Focus anomalies

Drill into metrics whose slope changed.

Progressive Discovery
03

Retrieve definitions

Bind each metric to the team's agreed definition.

RAG Pipeline
04

Build report

Generate trend, interpretation and likely cause.

Prompt Chaining
05

Check governance

Flag metrics that could be misused or lack source coverage.

Approval Gate
06

Expose trace

Show source rows, definition, slope and confidence.

Observability Harness

Screenshots

Terminal output: signal scan, anomaly focus, metric policy retrieval and trend report.
Terminal output: signal scan, anomaly focus, metric policy retrieval and trend report.

Pattern Mapping

PatternDesign role
Progressive DiscoveryDo not load every metric; forage, focus, then drill.
RAG PipelineMetric definitions need source-backed retrieval.
Observability HarnessTrend, source coverage and confidence are part of the product.
Approval GatePotentially misleading metrics should be flagged before publication.

Design Insights

Metrics need definitions

The agent should explain what a metric means before explaining why it moved.

Slope beats snapshot

A week-over-week slope catches quality drift earlier than a static threshold.

Governance prevents metric theatre

A report should warn when a metric can be gamed or lacks source coverage.

Run Path

cd workshops/workshop4-engineering-metrics python3 -m venv .venv source .venv/bin/activate pip install -r requirements.txt python src/main.py open visual/index.html
READMEworkshops/workshop4-engineering-metrics/README.md
Blueprintimages/training/visual/workshop4-engineering-metrics-blueprint.png