75 lines
2.4 KiB
Markdown
75 lines
2.4 KiB
Markdown
|
|
# User Testing
|
|||
|
|
|
|||
|
|
Testing surface, required tools, and resource cost classification.
|
|||
|
|
|
|||
|
|
---
|
|||
|
|
|
|||
|
|
## Validation Surface
|
|||
|
|
|
|||
|
|
**Surface**: Browser (web application)
|
|||
|
|
**URL**: http://localhost:5174 (Vite dev server)
|
|||
|
|
**Comparison URL**: http://localhost:7331/a-immersive.html (old playground app)
|
|||
|
|
|
|||
|
|
**Primary testing tool**: agent-browser
|
|||
|
|
**Secondary tool**: Playwright e2e tests via `window.__nisps` debug probe
|
|||
|
|
|
|||
|
|
### Debug Probe Interface
|
|||
|
|
|
|||
|
|
When loaded with `?debug=1`, `window.__nisps` exposes:
|
|||
|
|
|
|||
|
|
| Method | Returns | Sync/Async |
|
|||
|
|
|--------|---------|------------|
|
|||
|
|
| getOutputs() | Float32Array(126) | Sync |
|
|||
|
|
| getLoss() | number \| null | Sync |
|
|||
|
|
| getWeights() | Float32Array | Sync |
|
|||
|
|
| getExampleCount() | number | Sync |
|
|||
|
|
| setInputs(x, y) | void | Sync |
|
|||
|
|
| thumbsUp() | void | Sync |
|
|||
|
|
| thumbsDown() | void | Sync |
|
|||
|
|
| train() | number (loss) | Sync |
|
|||
|
|
| trainAsync() | Promise<number> | Async |
|
|||
|
|
| randomise() | void | Sync |
|
|||
|
|
| clearExamples() | void | Sync |
|
|||
|
|
| saveState() | void | Sync |
|
|||
|
|
| evalLoss() | number \| null | Sync |
|
|||
|
|
| inferBatch(points) | Float32Array[] | Sync |
|
|||
|
|
| getLayerStats() | object[] | Sync |
|
|||
|
|
|
|||
|
|
`window.__nispsEoc` is ALWAYS available (no ?debug=1 required):
|
|||
|
|
- `trainingTarget` getter/setter ('synth' | 'eoc')
|
|||
|
|
- `imlEoc` getter (WasmIML | null)
|
|||
|
|
|
|||
|
|
### DOM Selectors for Validation
|
|||
|
|
|
|||
|
|
Key CSS selectors for UI state assertions:
|
|||
|
|
- `.dock` — right-side dock container
|
|||
|
|
- `.drawer` — drawer panels (`.hidden` when closed)
|
|||
|
|
- `.heatmap-cell` — heatmap parameter bars
|
|||
|
|
- `.heatmap-cell-bar` — bar width element
|
|||
|
|
- `#status-text` — status line text
|
|||
|
|
- `.rl-btn` — RL thumbs up/down buttons
|
|||
|
|
- `.pill-opt[data-mode]` — output mode pills
|
|||
|
|
- `.joystick-container` — joystick wrapper
|
|||
|
|
- `#joy-map` — joystick canvas
|
|||
|
|
- `.noise-ring` — noise indicator
|
|||
|
|
|
|||
|
|
### Skip List
|
|||
|
|
|
|||
|
|
These assertions require physical hardware and cannot be validated in headless browser:
|
|||
|
|
- VAL-JOY-006 (Gamepad) — requires physical gamepad
|
|||
|
|
- VAL-MIDI-001 (MIDI output) — requires physical MIDI device
|
|||
|
|
- VAL-HAND-002 (Camera) — requires camera permission + gesture
|
|||
|
|
|
|||
|
|
## Validation Concurrency
|
|||
|
|
|
|||
|
|
**Machine specs**: 62GB RAM, 12 CPUs, ~23GB available
|
|||
|
|
|
|||
|
|
**agent-browser instances**:
|
|||
|
|
- Each instance: ~300MB RAM (lightweight app)
|
|||
|
|
- Dev server: ~200MB RAM
|
|||
|
|
- Per-validator total: ~500MB
|
|||
|
|
- Usable headroom (70% of 23GB): ~16GB
|
|||
|
|
- Max concurrent: 5 validators (5 × 500MB = 2.5GB, well within budget)
|
|||
|
|
|
|||
|
|
**Playwright tests**: Run serially (single browser, single server)
|