Public: anyone can read this; the crew can change it.
Migrated from github.com/Trevato/SO-ARM100
Mobile driving: pick a joint and drag one big slider (portrait), two thumb sticks (landscape); zero motion the instant a finger lifts #50
Landed in pull #60 · 5 runs · run
5 earlier comments · 1 event
Owner, 21:50Z, CHANGES THIS ISSUE: "on mobile i want to control with the 3d model and view the camera at the same time. that seems like the best input method. the sliders are good too. i dont know what the joystick is meant to do. maybe we can remove it."
New done (replaces the joystick plan):
- Primary input = drag the 3D model directly: touch a link of the arm and drag to move that joint (the model already supports dragging joints on desktop - bd7c03c "Fix dragging the 3D model's joints"); one finger rotates the touched joint, a two-finger drag on empty space orbits the view, pinch zooms. The target pose is drawn solid, the real arm's pose as a faint ghost, so the lag is visible.
- Streams live while dragging (same 30 Hz latest-wins path as #64/#54).
- Sliders stay as the precise second option (chip row J1..J6 + Grip, one slider), one tap away.
- REMOVE the virtual joysticks everywhere (mobile and desktop) and their code.
- Tests: a touch-drag on a joint link streams targets for that joint only; orbit and pinch do not send commands; no joystick elements remain.
REOPENED by the steward — owner, 2026-10-20 23:05Z: "remember i want the 3d model control on the bottom and the camera view on top on mobile so i can adjust the arm with my finger as the primary interface. also the new interface with the slider on mobile is mid. i dont want only one at a time. i preferred the old ui." and "the warnings are annoying especially on mobile. it covers most of the camera view."
Done (phone portrait, 390x844 and 412x915):
- Camera on TOP (full width, 16:9), the 3D model directly BELOW it filling the space down to the bottom bar — both always visible. The model is the primary control: touch a link and drag to move that joint, live; two-finger orbit, pinch zoom; target solid, real arm as a ghost.
- Sliders: ALL joints visible at once (the old UI), compact rows (label · slider · value), each with an intent mark and an actual mark; in a collapsible tray under the model — never one-at-a-time chips.
- Warnings/notices NEVER overlay the camera or the model: they collapse to one small pill in the status strip ("2 notes") that opens a sheet.
- No joysticks.
- Playwright screenshots at both viewports in the pull, and a test that the camera and model boxes do not overlap any notice.
Taken over by @vesper; stopped @quill.
Parked by the crew: the preview's deploy failed in the place it ran, not in the change, and it could not be run again (pull #81 closed). Planner: split this smaller, or rewrite what done looks like; a person can also say what to try.
Steward (a person): the parks were the preview test step hitting its 2-core default (browser tests), not this work. forge.json now gives the app and its checks 6 cores / 6 GiB (8190a910). Strikes reset - please run again.
Already done on main in 058825d (pull #60, same title): one big slider per joint in portrait and two thumb sticks in landscape, with zero motion on release. A person can close this; it now waits only on #90 (the mobile shell).
Owner, 2026-10-20 21:05Z: "mobile is slowly improving but really not amazing. press on the gas for mobile. i want to start sending this out!" and "there are also two stop buttons on mobile...". Borrow from Twitch/TikTok Live (video + chat overlay), DJI Fly / cloud-gaming touch overlays (Xbox Cloud, Steam Link), Apple Maps / Vaul bottom sheets with snap points (vaul MIT, shadcn Drawer), nipple.js virtual joystick (MIT). No new heavy deps unless they earn it. Test with playwright at 390x844 (iPhone) and 412x915 (Android), portrait + landscape, light/dark; screenshots of every state in the pull.
Portrait default: a chip row J1..J6 + Grip; one tall vertical slider (≥ 64 px wide) drives the selected joint, plus -/+ nudge buttons and hold-to-jog. Landscape: two virtual sticks (left J1/J2, right J3/J4, a toggle swaps to J5/J6), gripper a ≥ 72 px press-and-hold. Velocity-based with deadband; Pointer Events with setPointerCapture, per-pointerId tracking for two thumbs; send zero on pointerup/pointercancel/lostpointercapture/visibilitychange/blur; coalesce sends to 20-30 Hz; show command latency when > 250 ms. navigator.vibrate where supported (Android), visual feedback always. Screen Wake Lock while driving. Server-side limits (#11) still clamp. Tests: lifting the finger sends zero within one frame; two-thumb sticks drive independent joints; blur stops motion.