No description
Hand tracking at 30fps was writing 126 params per frame to the C15 ring buffer (capacity 512), flooding it and starving arpeggiator noteOn/noteOff messages — causing stuck/dropped notes. Three-part fix: - Arpeggiator now runs in a dedicated Web Worker with direct SharedArrayBuffer access, bypassing the main thread entirely for note timing. Worker setInterval isn't subject to main thread jank. - RingBufferWriter uses CAS (Atomics.compareExchange) for multi-producer safety — both main thread (params) and worker (notes) write safely. - routeOutputs throttles synth parameter sends: dead-zone filter (0.2% change threshold) + rate cap (~20fps), reducing ring buffer pressure from ~3800 msg/s to ~50-100 msg/s of actual changes. |
||
|---|---|---|
| .beads | ||
| .vscode | ||
| data | ||
| modes | ||
| nisps-core | ||
| playground | ||
| src | ||
| voicespaces | ||
| .gitignore | ||
| .gitmodules | ||
| AGENTS.md | ||
| ChannelStripAudioApp.hpp | ||
| CLAUDE.md | ||
| IMLInterface.hpp | ||
| LICENSE | ||
| MEMLNaut-NISPS.ino | ||
| NISPS_CORE_EXTRACTION_PLAN.md | ||
| NISPS_CORE_TASKS.md | ||
| PAFSynthAudioApp.hpp | ||
| README.md | ||
| ThruAudioApp.hpp | ||
| XiasriAnalysis.cpp | ||
| XiasriAnalysis.hpp | ||
| XIASRIAudioApp.hpp | ||
Neural Interactive Shaping of Parameter Spaces
https://musicallyembodiedml.github.io/memlnaut/approaches/nisps
Web Playground
Try NISPS in your browser — no hardware required:
cd playground
python3 -m http.server
# Open http://localhost:8000
Train a neural network to map joystick positions to generative visuals through interactive machine learning. Two learning modes: direct example mapping and reinforcement learning with thumbs up/down feedback.
The playground UI includes an Expand toggle on the visual surface so you can make the canvas nearly full-screen while compressing parameter/control panels into a minimal strip beneath it.