- Worker skill: solidjs-worker (SKILL.md) - Services manifest (services.yaml) - Init script (init.sh) - Library: architecture.md, environment.md, user-testing.md, solidjs-patterns.md Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
74 lines
2.4 KiB
Markdown
74 lines
2.4 KiB
Markdown
# User Testing
|
||
|
||
Testing surface, required tools, and resource cost classification.
|
||
|
||
---
|
||
|
||
## Validation Surface
|
||
|
||
**Surface**: Browser (web application)
|
||
**URL**: http://localhost:5174 (Vite dev server)
|
||
**Comparison URL**: http://localhost:7331/a-immersive.html (old playground app)
|
||
|
||
**Primary testing tool**: agent-browser
|
||
**Secondary tool**: Playwright e2e tests via `window.__nisps` debug probe
|
||
|
||
### Debug Probe Interface
|
||
|
||
When loaded with `?debug=1`, `window.__nisps` exposes:
|
||
|
||
| Method | Returns | Sync/Async |
|
||
|--------|---------|------------|
|
||
| getOutputs() | Float32Array(126) | Sync |
|
||
| getLoss() | number \| null | Sync |
|
||
| getWeights() | Float32Array | Sync |
|
||
| getExampleCount() | number | Sync |
|
||
| setInputs(x, y) | void | Sync |
|
||
| thumbsUp() | void | Sync |
|
||
| thumbsDown() | void | Sync |
|
||
| train() | number (loss) | Sync |
|
||
| trainAsync() | Promise<number> | Async |
|
||
| randomise() | void | Sync |
|
||
| clearExamples() | void | Sync |
|
||
| saveState() | void | Sync |
|
||
| evalLoss() | number \| null | Sync |
|
||
| inferBatch(points) | Float32Array[] | Sync |
|
||
| getLayerStats() | object[] | Sync |
|
||
|
||
`window.__nispsEoc` is ALWAYS available (no ?debug=1 required):
|
||
- `trainingTarget` getter/setter ('synth' | 'eoc')
|
||
- `imlEoc` getter (WasmIML | null)
|
||
|
||
### DOM Selectors for Validation
|
||
|
||
Key CSS selectors for UI state assertions:
|
||
- `.dock` — right-side dock container
|
||
- `.drawer` — drawer panels (`.hidden` when closed)
|
||
- `.heatmap-cell` — heatmap parameter bars
|
||
- `.heatmap-cell-bar` — bar width element
|
||
- `#status-text` — status line text
|
||
- `.rl-btn` — RL thumbs up/down buttons
|
||
- `.pill-opt[data-mode]` — output mode pills
|
||
- `.joystick-container` — joystick wrapper
|
||
- `#joy-map` — joystick canvas
|
||
- `.noise-ring` — noise indicator
|
||
|
||
### Skip List
|
||
|
||
These assertions require physical hardware and cannot be validated in headless browser:
|
||
- VAL-JOY-006 (Gamepad) — requires physical gamepad
|
||
- VAL-MIDI-001 (MIDI output) — requires physical MIDI device
|
||
- VAL-HAND-002 (Camera) — requires camera permission + gesture
|
||
|
||
## Validation Concurrency
|
||
|
||
**Machine specs**: 62GB RAM, 12 CPUs, ~23GB available
|
||
|
||
**agent-browser instances**:
|
||
- Each instance: ~300MB RAM (lightweight app)
|
||
- Dev server: ~200MB RAM
|
||
- Per-validator total: ~500MB
|
||
- Usable headroom (70% of 23GB): ~16GB
|
||
- Max concurrent: 5 validators (5 × 500MB = 2.5GB, well within budget)
|
||
|
||
**Playwright tests**: Run serially (single browser, single server)
|