memlnaut-nisps/.factory/library/user-testing.md
monkey-w1n5t0n 13112cf447 Add mission infrastructure for SolidJS migration
- Worker skill: solidjs-worker (SKILL.md)
- Services manifest (services.yaml)
- Init script (init.sh)
- Library: architecture.md, environment.md, user-testing.md, solidjs-patterns.md

Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
2026-04-07 08:49:52 +02:00

2.4 KiB
Raw Blame History

User Testing

Testing surface, required tools, and resource cost classification.


Validation Surface

Surface: Browser (web application) URL: http://localhost:5174 (Vite dev server) Comparison URL: http://localhost:7331/a-immersive.html (old playground app)

Primary testing tool: agent-browser Secondary tool: Playwright e2e tests via window.__nisps debug probe

Debug Probe Interface

When loaded with ?debug=1, window.__nisps exposes:

Method Returns Sync/Async
getOutputs() Float32Array(126) Sync
getLoss() number | null Sync
getWeights() Float32Array Sync
getExampleCount() number Sync
setInputs(x, y) void Sync
thumbsUp() void Sync
thumbsDown() void Sync
train() number (loss) Sync
trainAsync() Promise Async
randomise() void Sync
clearExamples() void Sync
saveState() void Sync
evalLoss() number | null Sync
inferBatch(points) Float32Array[] Sync
getLayerStats() object[] Sync

window.__nispsEoc is ALWAYS available (no ?debug=1 required):

  • trainingTarget getter/setter ('synth' | 'eoc')
  • imlEoc getter (WasmIML | null)

DOM Selectors for Validation

Key CSS selectors for UI state assertions:

  • .dock — right-side dock container
  • .drawer — drawer panels (.hidden when closed)
  • .heatmap-cell — heatmap parameter bars
  • .heatmap-cell-bar — bar width element
  • #status-text — status line text
  • .rl-btn — RL thumbs up/down buttons
  • .pill-opt[data-mode] — output mode pills
  • .joystick-container — joystick wrapper
  • #joy-map — joystick canvas
  • .noise-ring — noise indicator

Skip List

These assertions require physical hardware and cannot be validated in headless browser:

  • VAL-JOY-006 (Gamepad) — requires physical gamepad
  • VAL-MIDI-001 (MIDI output) — requires physical MIDI device
  • VAL-HAND-002 (Camera) — requires camera permission + gesture

Validation Concurrency

Machine specs: 62GB RAM, 12 CPUs, ~23GB available

agent-browser instances:

  • Each instance: ~300MB RAM (lightweight app)
  • Dev server: ~200MB RAM
  • Per-validator total: ~500MB
  • Usable headroom (70% of 23GB): ~16GB
  • Max concurrent: 5 validators (5 × 500MB = 2.5GB, well within budget)

Playwright tests: Run serially (single browser, single server)