- Worker skill: solidjs-worker (SKILL.md) - Services manifest (services.yaml) - Init script (init.sh) - Library: architecture.md, environment.md, user-testing.md, solidjs-patterns.md Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
2.4 KiB
2.4 KiB
User Testing
Testing surface, required tools, and resource cost classification.
Validation Surface
Surface: Browser (web application) URL: http://localhost:5174 (Vite dev server) Comparison URL: http://localhost:7331/a-immersive.html (old playground app)
Primary testing tool: agent-browser
Secondary tool: Playwright e2e tests via window.__nisps debug probe
Debug Probe Interface
When loaded with ?debug=1, window.__nisps exposes:
| Method | Returns | Sync/Async |
|---|---|---|
| getOutputs() | Float32Array(126) | Sync |
| getLoss() | number | null | Sync |
| getWeights() | Float32Array | Sync |
| getExampleCount() | number | Sync |
| setInputs(x, y) | void | Sync |
| thumbsUp() | void | Sync |
| thumbsDown() | void | Sync |
| train() | number (loss) | Sync |
| trainAsync() | Promise | Async |
| randomise() | void | Sync |
| clearExamples() | void | Sync |
| saveState() | void | Sync |
| evalLoss() | number | null | Sync |
| inferBatch(points) | Float32Array[] | Sync |
| getLayerStats() | object[] | Sync |
window.__nispsEoc is ALWAYS available (no ?debug=1 required):
trainingTargetgetter/setter ('synth' | 'eoc')imlEocgetter (WasmIML | null)
DOM Selectors for Validation
Key CSS selectors for UI state assertions:
.dock— right-side dock container.drawer— drawer panels (.hiddenwhen closed).heatmap-cell— heatmap parameter bars.heatmap-cell-bar— bar width element#status-text— status line text.rl-btn— RL thumbs up/down buttons.pill-opt[data-mode]— output mode pills.joystick-container— joystick wrapper#joy-map— joystick canvas.noise-ring— noise indicator
Skip List
These assertions require physical hardware and cannot be validated in headless browser:
- VAL-JOY-006 (Gamepad) — requires physical gamepad
- VAL-MIDI-001 (MIDI output) — requires physical MIDI device
- VAL-HAND-002 (Camera) — requires camera permission + gesture
Validation Concurrency
Machine specs: 62GB RAM, 12 CPUs, ~23GB available
agent-browser instances:
- Each instance: ~300MB RAM (lightweight app)
- Dev server: ~200MB RAM
- Per-validator total: ~500MB
- Usable headroom (70% of 23GB): ~16GB
- Max concurrent: 5 validators (5 × 500MB = 2.5GB, well within budget)
Playwright tests: Run serially (single browser, single server)