Reference software UI: Nuklear + canvas_ity + pugl editors (desktop, WASM, MCU)#162
Open
jcelerier wants to merge 4 commits into
Open
Reference software UI: Nuklear + canvas_ity + pugl editors (desktop, WASM, MCU)#162jcelerier wants to merge 4 commits into
jcelerier wants to merge 4 commits into
Conversation
This was referenced Jul 6, 2026
jcelerier
force-pushed
the
ui-split-2-ui-core
branch
from
1e2e816 to
5afa08b
Compare
jcelerier
force-pushed
the
ui-split-3-soft-ui
branch
from
abc0bb8 to
18d4e35
Compare
… shell The reference editor for declarative layouts (halp DSL Tier A, custom paint() widgets Tier B): Nuklear runs the widget pass into a command queue replayed through canvas_ity (software vector rasterizer, one antialiased pipeline for widgets, text and custom painting) into an RGBA8 framebuffer. - headless-first: surface<T> is 'push events, pull pixels' (WASM, MCUs, tests); window_editor<T> wraps it in a pugl child view for the plug-in editor contract (host-parented, timer-driven, plain XPutImage/StretchDIBits/CALayer blits, no GPU). - idle frames are ~free: runtime.tick() returns a real dirty flag, the theme background covers the previous frame so there is no full clear, and a 16-tick heartbeat bounds staleness under host automation. - avnd_target_soft_ui() wires a target; avnd_make_ui_preview() runs any UI standalone; test_soft_ui covers layout, interaction gestures, bus round-trip, HiDPI (integer + live fractional re-scale) headlessly. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…ditor tests Targets with a declarative `struct ui` now get the reference editor in all three bindings (avnd_target_soft_ui; the prototype emits the Nuklear/canvas_ity implementation once per plug-in). End-to-end editor tests drive the same ClapUiPlug through each binding on Win32 and X11: embed in a real parent window, injected mouse drag, one gesture per drag, params/automation flow, message-bus round trip; the VST3 one also asserts the Linux IRunLoop timer protocol and a fractional setContentScaleFactor mid-session. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
The same soft runtime renders into a Canvas2D via putImageData (Module.SoftUI, bound with embind); the standalone page's canvas editor drives the same worklet instance as the generated DOM UI (params, outputs and dirty tracking unified). Headless coverage via node: gesture protocol, dirty tracking, external sync. Never add --embed-file to these modules: the same binary runs inside AudioWorkletGlobalScope where emscripten's FS init aborts — fonts ship next to the module. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
…ux validation notes surface<T> flushed to an LCD/e-paper is the whole port: the ESP32 shell and a PlatformIO Inkplate 2 project run the same helpers UI on real hardware. LINUX_VALIDATION.md records the full Linux/X11 validation round of this stack (validators, pluginval, editor tests) and the render-perf measurements for future work. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
jcelerier
force-pushed
the
ui-split-3-soft-ui
branch
from
18d4e35 to
35fc40a
Compare
jcelerier
force-pushed
the
ui-split-2-ui-core
branch
from
5afa08b to
02e4ebc
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The bundled reference editor on top of the UI base layer: plug-ins with a declarative
struct ui(halp layout DSL, custompaint()widgets) get a real editor in CLAP/VST2/VST3 with no GPU, no external UI framework: Nuklear (widgets, command queue) rendered through canvas_ity (software vector rasterizer) into an RGBA8 framebuffer, windowed via pugl (host-parented child windows, XPutImage/StretchDIBits/CALayer blits).What's in
binding/ui/soft/): headless-first —surface<T>is "push events, pull pixels" (tests, WASM, MCUs);window_editor<T>is the pugl desktop shell. Real dirty tracking (idle frames ~free), HiDPI incl. live fractional re-scale, instrument theme, font registry.avnd_target_soft_ui()on CLAP/VST2/VST3 targets; the editor seam from PR 2 picks it up viaAVND_SOFT_UI_EDITOR.avnd_make_ui_previewruns any UI standalone, no host.Module.SoftUI); the standalone page's canvas editor drives the same worklet instance as the DOM UI.Validation (Linux, clang 19 — see LINUX_VALIDATION.md)
Part 3/3; stacks on #161.
🤖 Generated with Claude Code