Dashboard

tracer ships a self-contained progress dashboard that scans your current status and artifacts, then renders a single interactive HTML page — open it locally, or publish it to Cloudflare Pages for remote viewing.

Live board: swe-tracer-databoard-eir.pages.dev

What it monitors

The page has four sidebar sections:

• Overview — KPI cards, programming-language distribution, and quality score histogram.
• Instances — instance-level table plus multi-dimensional segment analysis by programming language, domain, category, difficulty, source, model, scaffold, or job.
• Trajectories — searchable card explorer for failed, low-score, high-score, error-only, or random trajectories, with bounded preview and optional /api/traj full load.
• Operations — latest archived-run status from artifacts/index.yaml, searchable Harbor/SFT artifact tables, copy-path actions, and per-job eval breakdowns.

For each Harbor job it surfaces trial counts, error counts, per-eval reward means, and reward == 1.0 / 0.0 outcome counts. For each SFT dataset it surfaces token-length, turn-count, score distributions, tool-call error rates, and on-disk sizes.

Each generation also writes analysis data under dashboard/site/data/:

When operating through the tracer plugin, /tracer:dashboard covers both the visual dashboard and one-off SFT data/stat refreshes via scripts/convert_trajectories.sh.

Run it locally

The generator is dashboard/progress_monitor.py. It carries PEP 723 inline metadata and a uv run shebang, so it needs no pip install — just uv on PATH. Run from subblock/tracer/:

./dashboard/progress_monitor.py                              # one-shot generate
./dashboard/progress_monitor.py --serve --open               # generate + local preview
./dashboard/progress_monitor.py --loop 60 --serve --port 8765  # auto-refresh every 60s
./dashboard/progress_monitor.py --sample-limit 50            # smaller published page
./dashboard/progress_monitor.py --no-include-samples         # disable sample browser payload
./dashboard/progress_monitor.py --index-job <harbor-job>     # add an extra local Harbor batch to Instances/Trajectories
./dashboard/progress_monitor.py --local-mode public --public-no-samples  # metrics-only public payload

Then open dashboard/site/index.html directly, or visit http://127.0.0.1:8765/index.html. The page self-refreshes so an open tab stays current while --loop keeps writing snapshots.

Use the header's Black / White toggle to switch between light and dark monochrome themes. The selected theme is stored in browser localStorage; first load follows the system color-scheme preference.

Trajectory previews

The dashboard embeds bounded previews and trajectory cards by default, not full multi-GB data files. This keeps the HTML portable:

Use the defaults for local inspection. For public Cloudflare deploys, reduce --sample-limit or use --no-include-samples if the generated dashboard/site/index.html is too large or the sample content should not be published.

Publish to Cloudflare Pages

dashboard/run_cloudflare_pages_sync.sh loops the generator and deploys dashboard/site/ to Cloudflare Pages via wrangler, yielding a public *.pages.dev URL:

tmux new-session -d -s tracer-cf \
  "ENV_FILE=.env.cf bash dashboard/run_cloudflare_pages_sync.sh 2>&1 | tee /tmp/tracer_cf_sync.log"

Configuration is read from ~/.config/trajgen_progress_cloudflare.env (override with ENV_FILE). The required values are:

The generated dashboard/site/_worker.js handles GET /api/traj?r2_key=trajs/.... Bind the same R2 bucket to the Pages project as TRACER_TRAJ_BUCKET to enable full online trajectory loading. Without that binding, the public page still works for metrics and bounded previews, while Load full returns a controlled error.

The same loop optionally re-runs scripts/convert_trajectories.sh --skip-unchanged at most every CONVERT_EVERY_SECONDS, so the SFT stats on the board also stay fresh online without coupling heavy conversion to the deploy cadence.

For a lighter public page, set DASHBOARD_SAMPLE_LIMIT to a smaller value, DASHBOARD_INCLUDE_SAMPLES=0, DASHBOARD_LOCAL_MODE=public, or nonzero max fact limits in the sync environment.