283 Commits

Author SHA1 Message Date
eust-w
f00e9b9506 ✨ Stage ego data on the workspace PVC and split workflows for the POC worker
Add the ego-stage lightweight operator: it downloads presigned BOS files
into the run (or a stable /workspace/ego-staging path), collects another
node's outputs, and registers files as artifacts with ids. Operators such
as SAM3.1 and hand removal only read local paths, and their own images
emit artifacts without ids, which the current worker rejects.

Rework scripts/ego_workflows.py around what the current worker runs
reliably: short chains, one consumer per stage, validators on the
operator-runner image, plus commands to register the stage operator,
stop runs, read logs/run details and download results.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 15:03:12 +08:00
eust-w
674397ca98 ✨ Run ego workflows on the current worker via presigned run inputs
Video QC now receives its video list as an inline workflow input whose
items carry 1h BOS presigned URLs, and WiLoR gets a fresh presigned
INPUT_URL before each run, so neither depends on the worker turning
bos:// source outputs into refs. Add logs/worker/artifacts commands for
diagnosing runs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 12:48:21 +08:00
eust-w
a4b933330a ✨ Add ego dataset workflow builder for the POC platform
scripts/ego_workflows.py inspects an egocentric LeRobot dataset on BOS
through the platform API and creates processing workflows for it:
integrity checks, left-camera video QC, WiLoR 3D hand pose, and
SAM3.1 + hand removal (node settings cloned from the proven egodex
pipeline). Source and upload nodes are bound to the org's storage
connection so the worker can turn bos:// outputs into object refs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 12:01:35 +08:00
eust-w
8780cd598c 🐛 Fix large model downloads and package drobotic-pull 1.0.1
The old shipped v1.0.0 used a 300-second whole-response deadline. Keep active transfers alive, validate ranged retries, filter BOS folder markers, and preserve accurate failure/progress reporting. Verify the Linux package with interrupted 4 GiB transfers, a 307-second stream, and the real 7.47 GiB checkpoint with matching SHA256 receipts.
2026-10-22 14:19:48 +08:00
eust-w
693519d093 🧪 Complete real BOS acceptance and fix client retry diagnostics 2026-10-13 20:28:36 +08:00
eust-w
2f0c0cf110 🧪 Expand native sync fault coverage and fix readiness reporting 2026-10-13 15:56:27 +08:00
eust-w
1717c2aa34 🧪 Validate optimized upload flow against POC Mongo and BOS 2026-10-13 02:13:59 +08:00
eust-w
793ffd8d31 ⚡ Skip confirmed files, stream ordered pages and finalize verified uploads 2026-10-13 01:58:10 +08:00
eust-w
716ce417a0 🚢 Deploy and validate isolated POC MD5 candidate with cutover inventory 2026-10-12 16:41:42 +08:00
eust-w
9a5f9ed547 ⚡ Use MD5-only upload integrity with explicit hash epoch migration 2026-10-12 15:34:26 +08:00
eust-w
b6862328e5 🐧 Validate installed Ubuntu uploads and fix BOS metadata identity casing 2026-10-12 11:27:51 +08:00
eust-w
3cfa871ce1 🧪 Verify drosync functionality and repair stale test fixtures 2026-10-12 10:37:47 +08:00
eust-w
ca976a8c17 🕒 Dispatch drosync uploads by capture time 2026-10-12 04:00:21 +08:00
eust-w
13ffd61780 🔒 Automatically scope storage for newly created organizations 2026-10-10 17:41:52 +08:00
eust-w
cb6c52e1bb 🧪 Support scoped BOS roots in POC acceptance 2026-10-10 16:55:15 +08:00
eust-w
6ebcd28921 🐛 Fix daily upload audit gaps in missing files and recovery 2026-10-08 20:43:51 +08:00
eust-w
9152bcf359 ✨ Complete daily upload workflows and bounded performance controls 2026-10-08 19:22:49 +08:00
eust-w
1044b507c8 🛠️ Repair resumable metadata and bounded BOS recovery 2026-10-08 15:08:01 +08:00
eust-w
95d94b3309 ✨ Complete drosync workflows and recovery safeguards 2026-10-08 12:25:38 +08:00
eust-w
62eadffab9 🚀 Harden drosync workflows and scale upload metadata 2026-10-03 02:48:48 +08:00
eust-w
bf0a961a32 ♻️ Consolidate drosync operations into single canonical entries 2026-10-01 00:05:09 +08:00
eust-w
7ca47c628b 🧹 Enforce current contracts and retire legacy runtime compatibility 2026-09-19 21:32:23 +08:00
eust-w
38d5a46f33 🧹 Remove legacy user roles and reject unsupported identities 2026-09-19 17:58:37 +08:00
eust-w
fe10b9c048 🧪 Add live drosync manifest boundary regression 2026-09-06 04:32:10 +08:00
eust-w
6a2056f67b 🧪 Add reproducible drosync POC abort regression and evidence 2026-09-05 23:10:58 +08:00
eust-w
4afdc1c869 🛠️ Refresh builtin runtime images safely 2026-08-17 16:04:44 +08:00
eust-w
37bca5fdbb 🗑️ Remove cached model inference feature 2026-07-30 01:29:39 +08:00
eust-w
03a58912b6 ✨ Add cached Hugging Face model inference jobs 2026-07-29 21:50:06 +08:00
eust-w
8151bdea5c 🔧 Make drosync HTTPS enforcement configurable 2026-07-29 02:50:00 +08:00
eust-w
fa2f864a30 🧪 Finalize drosync POC acceptance evidence 2026-07-29 02:17:06 +08:00
eust-w
20d1c25966 🔐 Persist drosync credentials in the daemon keychain 2026-07-29 01:36:49 +08:00
eust-w
419149c579 🔐 Add scoped drosync access keys and resumable uploads 2026-07-29 00:50:08 +08:00
eust-w
1ca8cfa5ff ✨ Implement drosync production v1 2026-07-28 20:43:46 +08:00
eust-w
9c925d4471 ♻️ Remove model-specific training report UI 2026-07-27 16:25:57 +08:00
eust-w
e53fc69a4e ⚡ Parallelize UBT asset uploads 2026-07-24 17:04:09 +08:00
eust-w
6f5a94030f 🚚 Add resumable UBT asset uploader 2026-07-24 16:07:52 +08:00
eust-w
561d802f0f 🏷️ Complete Hand Removal release metadata 2026-07-14 17:53:25 +08:00
d-robotics
adf3a7637e ✨ Add SAM3 ProPainter hand removal operator 2026-07-14 13:05:26 +08:00
eust-w
423824e2a4 🧪 gate acceptance fixtures and reuse workflows 2026-07-13 17:10:17 +08:00
eust-w
27ae12403f 🧠 wire shared memory deployment setting 2026-07-13 14:06:03 +08:00
eust-w
c6f5a86b17 🧠 add shared memory for training jobs 2026-07-13 13:57:46 +08:00
eust-w
6fe111021b 🚦 converge worker runs and harden POC acceptance 2026-07-13 12:31:36 +08:00
eust-w
c167ce095f 📝 make all mounts writable by default 2026-07-13 11:20:00 +08:00
eust-w
8e50a368c7 🩹 enable depth in RoboTwin evaluation 2026-07-13 04:20:54 +08:00
eust-w
f4f1fb6c77 ⚡ avoid redundant HoloBrain resume loading 2026-07-12 19:19:05 +08:00
eust-w
004cf54247 🧪 pin RoboTwin renderer in full acceptance 2026-07-12 18:46:40 +08:00
eust-w
67941d57ac 🖥️ support container-compatible RoboTwin rendering 2026-07-12 18:39:48 +08:00
eust-w
a96c5b27f8 🔧 add real RoboTwin planner fallback 2026-07-12 18:24:43 +08:00
eust-w
df4c3ddfde 🧠 complete full HoloBrain UR5 evaluation path 2026-07-12 17:55:25 +08:00
eust-w
8a5e3d831e 🐛 validate HoloBrain venv prefix 2026-07-11 03:51:27 +08:00