Compare commits

...

219 Commits
dev ... poc

Author SHA1 Message Date
eust-w
d5da39f5c6 🔖 Prepare POC rendering build with API-only rollout
Bump the workspace build version to 1.1.10 per the release policy.
Add poc.api-image to pin only the API container by digest, with server
 dry-run, POC/repository guards and a resource-version precondition.
Preserve all other deployments, operator pins, ConfigMaps and Secrets.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-11-05 05:09:20 +08:00
eust-w
f1d71164ae 🐛 Render assistant Markdown and validated topology diagrams
Replace plain-text replies with react-markdown and GFM tables, lists,
code and safe links. Recognize complete topology fences, JSON fences and
standalone graph data in source order without promoting ordinary JSON.
Render escaped SVG elements with cycle-safe layouts, zoom, node details
and accessible data tables; show incomplete graphs as recoverable errors.

Preserve finish_reason=length, prevent truncated tool calls from executing,
and give concise topology replies a 4096-token budget. Tighten the prompt
to return bounded, closed diagrams rather than an exhaustive node dump.

Add parser, model-completion and isolated browser regression coverage.
Fix existing frontend type declarations exposed by the React types now
provided with react-markdown, without changing workflow execution.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-11-04 21:19:41 +08:00
eust-w
f1e0b8b081 ✨ Render slash results as conversation and draw topology diagrams
Slash commands now answer in a short Chinese summary, with the raw payload
behind “查看原始结果”. Assistant replies parse ```ops-topology JSON into an
SVG diagram, and the system prompt asks the model to emit that block for
relationships and causal chains.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-11-04 18:26:37 +08:00
eust-w
cb1318cfd2 ✨ Show expandable assistant thinking and poll transcripts faster
Persist gateway reasoning_content on assistant messages and render it as a
collapsible “思考过程” panel, including tool-only turns that have no visible
answer yet. Frontend polling drops from 2s to 800ms so tool progress appears
sooner.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-11-04 18:17:13 +08:00
eust-w
41a08d1dc5 ✨ Resolve ops assistant chat from live AI settings
The product assistant now uses the same AI credentials as operator/workflow
generation (settings first, then process env) instead of freezing the
startup env. Natural-language chat therefore picks up /settings or ConfigMap
changes without a code change.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-11-04 17:33:39 +08:00
eust-w
f9dc135fd1 🐛 Probe /version via kubectl get --raw in kube-reachable preflight
In kubectl v1.31, `kubectl version --request-timeout=10s` fails to bind
in-cluster ServiceAccount flags and falls back to http://localhost:8080,
breaking in-cluster ops-runner preflights. Use `kubectl get --raw /version`,
which works both in-cluster and with KUBECONFIG.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-11-04 16:15:28 +08:00
eust-w
0802ff7c23 🐛 Take kubectl for the ops runner from an image instead of dl.k8s.io
The POC Kaniko build network cannot reach dl.k8s.io (TLS reset), so the
first ops-runner build failed. Copy /bin/kubectl from rancher/kubectl,
which the build pulls through the existing Docker Hub mirror.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-11-04 14:54:17 +08:00
eust-w
de2710015e ✨ Add in-product ops assistant on top of the ops catalog
The new 运维助手 page (/assistant) is the third entry point to the ops
catalog. "/" runs a catalog action directly; free text goes to a
tool-calling model when AI is configured. Every execution is authorized by
the action's tier against the caller's current role, recorded as an
assistantSteps audit record, and kept honest:

- HTTP actions are replayed in-process through the normal router as the
  user, so route role checks and organization scoping still apply.
- Script actions run droctl in an admin-only ops-runner Job
  (Dockerfile.ops-runner, ServiceAccount droboticflow-ops-runner with a
  Role limited to what product-surface scripts call: no pods/exec,
  secrets by name). They stay listed but not runnable until
  OPS_RUNNER_IMAGE is set.
- Mutating actions dry-run by default where the script supports it;
  confirm-required actions and every real mutation the model proposes
  wait for the user, and the user is re-loaded before each execution.
- Session claims and step finalization are compare-and-set so the two
  API replicas never double-run a model turn or a completion.

poc.configure-fixtures becomes CLI-only because it needs kubectl exec.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-11-04 12:49:08 +08:00
eust-w
7fa8ca0547 ✨ Add ops capability catalog with droctl CLI and Claude Code skill
One declarative catalog (ops/catalog/*.yaml) now describes every deploy,
acceptance, release, diagnose and platform action with typed args, tier-based
role mapping, preflight checks and honest per-surface availability.
scripts/generate_ops_catalog.py validates it and generates the Go catalog,
the Claude Code skill and slash commands, the product's TypeScript catalog
and docs/ops-catalog.md (--check is part of verify:local).

droctl runs any action with argument validation, preflights (branch, cluster
reachability via load-deploy-env.sh), confirm/admin gates and real dry-run
only where a script supports it. The Claude skill drives droctl so both share
one execution path.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-11-04 11:28:17 +08:00
eust-w
50cec2fe80 📦 Release drosync 1.1.9 to the public portable channel
Published with release.py; verified the user guide's fresh-install commands
verbatim on clean Ubuntu 22.04 and a public 1.1.7 -> 1.1.9 self-update.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 21:33:58 +08:00
eust-w
2ad3bce371 📝 Add Ubuntu upgrade-from-1.0.x and usage guide with 1.1.9 evidence
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 17:56:40 +08:00
eust-w
d0eb482d9f 🔖 Bump drosync to 1.1.9
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 17:37:04 +08:00
eust-w
48bdbb958f ✨ Let sudo drosync <command> reach the portable service daemon
Root used to look for state and the socket under /root and failed with exit
40 for every non-update command. On a verified portable install, root now
re-runs the command as the systemd service account with the service's
configuration, reusing the update broker's install and unit checks. Also add
clippy/rustfmt to the release builder for Linux lint runs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 17:37:03 +08:00
eust-w
4abcdbf8ba 🔖 Bump drosync to 1.1.8
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 17:08:41 +08:00
eust-w
a60b252acf 🐛 Let a fresh portable install start its daemon on clean Ubuntu
The default log path /var/log/drosync.log is not writable by the service
account, and `install -d` left a new account's ~/.local and ~/.local/share
root-owned, so the fallback log failed too and the daemon exited on start.
Create missing parents for the service user and keep the default log beside
its private state.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 17:08:41 +08:00
eust-w
9d430f7767 📦 Release drosync 1.1.7 to the public portable channel
Built, verified, published and smoke-upgraded from public 1.1.6 with the
one-command release driver; record the artifacts and evidence.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 17:00:17 +08:00
eust-w
b0480b19d3 📝 Document the one-command portable release driver
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 16:55:05 +08:00
eust-w
ef33652d64 🐛 Add python3 to the release builder and tag it by recipe hash
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 16:47:28 +08:00
eust-w
baab087c89 🐛 Build releases in a pinned Ubuntu 22.04 + Rust 1.89 builder image
The old deps image never contained a Rust toolchain. The driver now creates
the pinned image once from release-builder.Dockerfile and builds offline.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 16:41:58 +08:00
eust-w
3348aca787 🐛 Keep release build scratch inside the Colima-shared repository
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 16:38:45 +08:00
eust-w
8b412449ba 🐛 Copy release sources into a fresh container path and quiet crate vendoring
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 16:38:19 +08:00
eust-w
a25ba9a369 🔖 Bump drosync to 1.1.7
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 16:37:32 +08:00
eust-w
67eba1f348 ✨ Add one-command portable drosync release driver
bump/build/preflight/publish wrap the Ubuntu 22.04 amd64 offline container
build, exact bundle/GLIBC/trust-root verification and the existing signed
publish.py flow, so a release no longer needs hand-typed container commands.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 16:37:24 +08:00
eust-w
ee8ff920bb 🐛 Verify installed upload receipts against real BOS checkpoint heads
The device items endpoint intentionally omits expectedBase/committedVersion,
so the scenario rejected every real item. Take formal identities from the
fixture checkpoint, which HEADs each head object on BOS.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 15:12:21 +08:00
eust-w
97a108fa3d 🐛 Read the API's etag field when checking installed upload receipts
The object-sync item API serializes remote receipts as "etag", but the
installed scenario checked "eTag", so every real item looked receipt-less.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 15:09:11 +08:00
eust-w
575d88906b 🐛 Explain daemon socket permission failures and remove the stale endpoint
When chmod 0600 fails (e.g. a shared host mount), name the socket path and
the local-filesystem requirement instead of a bare os error 22, and remove
the bound socket so no unrestricted endpoint is left behind.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 15:07:46 +08:00
eust-w
48f8b044d6 🐛 Accept BOS notEnabled versioning status in acceptance fixture guard
Real BOS reports never-versioned buckets as "notEnabled" (lowercased by the
browser), which the guard rejected before any object was written.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 15:07:46 +08:00
eust-w
a97dea80dc 🐛 Give installed storage acceptance containers explicit DNS upstreams
Containers started on the internal bridge get no external nameservers, so a
later egress attach could not resolve bj.bcebos.com and the BOS preflight
failed with a client error before any object was written.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 15:05:46 +08:00
eust-w
be693e7ac4 🚨 Satisfy newer Clippy map_unwrap_or lint in portable updater tests
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 06:20:16 +08:00
eust-w
3f5c3dfb72 🧪 Guard installed drosync acceptance with bounded, replayable real BOS fixtures
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-01 06:06:08 +08:00
eust-w
a6de24030e 🧪 Record comprehensive drosync regression and environment limits
Validate the cleanup baseline with full Go race coverage, pinned Rust checks, 112 cross-platform end-to-end scenarios, Mongo capacity checks and the final real-BOS large-object chain. Preserve initial toolchain/filesystem failures, explicit coverage gaps and exact test-resource cleanup evidence without changing product code or deploying services.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-11-01 02:17:43 +08:00
eust-w
0a943abecc 🐛 Make staging cleanup idempotent without weakening deletion safety
Retire confirmed missing staging resources while rejecting ambiguous errors, noncanonical targets and malformed or already-retired Mongo keys. Validate Mongo 8.0.17 and real BOS default 64 MiB ranges, including replacement between ranges, and preserve regression and exact-resource cleanup evidence without deploying services or changing the client release.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-11-01 01:35:59 +08:00
eust-w
ae2cfd97cc 📝 Record read-only POC rollout preflight and rollback baselines
Capture API/coordinator health, configuration references, effective Mongo
permissions, bounded legacy receipt shapes and authenticated rollback
manifest digests without deploying or mutating production data.

Hold rollout pending existing staging-cleanup NoSuchKey hardening and
additional acceptance for Mongo 8.0 and multi-64MiB-range objects. Record
receipt size conflicts and the coordinator's stale image-reporting label.
Redact business identifiers, object paths, digest values and credentials.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-10-31 23:53:11 +08:00
eust-w
935f76ce88 🧪 Validate digest backfill with isolated Mongo and real BOS
Exercise real BSON optional fields, conditional head writes, concurrent
attesters, reconcile preservation, replacement cleanup and fenced claims
against disposable MongoDB 7. Verify conditional BOS ranges and HTTP 412,
then drive the real API/coordinator from legacy partial receipts through
attestation, completed sync and cleanup proofs with synthetic objects.

Cover idempotent retries, local-content conflicts, conflicting object MD5,
changed identity and missing trust anchors. Keep credentials on stdin and
out of persisted Mongo records; conditionally create private objects and
clean only exact test-owned keys. Record cleanup and environment failures.

All Go packages, vet and the real Mongo race tests pass. No production
runtime code, deployment, business archive or published client is changed.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-10-31 19:48:33 +08:00
eust-w
b6b70ea9f8 🔀 Integrate legacy digest backfill and conditional reconciliation
Merge claude/gracious-goldstine-134a9c, which includes the dependent
claude/relaxed-tharp-1e8af7 backfill prototype. Keep cloud-derived digest
attestations scope-bound, conditionally persisted and manually activated.
Prevent reconcile from overwriting receipts updated during its scan.

Verify all Go packages in the integrated tree, focused race tests and vet,
protocol generation, 20 Python tests, 26 macOS native scenarios and ten
pause repetitions each on macOS and offline Linux x86_64. Archive concise
integration evidence before the approved side-session cleanup.

No deployment, production backfill or client artifact changes. Real
Mongo/BOS semantic acceptance remains required before rollout.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-10-31 17:47:54 +08:00
eust-w
7f7516e17f 🧪 Merge and harden pause-resume acceptance
Integrate claude/happy-kilby-4915b3 and make its receiver gate deterministic:
fill both file slots before pausing, fail on hold timeout, accept buffered
sender progress, and reject new reservations, cancellation or retries.

Add eight fixture regressions. Reproduce the original delayed-reservation
false failure, then verify the corrected real CLI scenario. macOS runs
10 pause repetitions and the full 26-scenario matrix; offline Linux x86_64
runs 10 pause repetitions using the unchanged published 1.1.6 binaries.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-10-31 17:40:09 +08:00
eust-w
41627aeff1 📦 Record public portable drosync 1.1.6 publication
Publish the production-key Linux x86_64 bundle from 6c4c1557 to the
approved testxyz/downloads/drosync/portable prefix. Verify immutable
objects anonymously before creating the signed stable pointer; leave
the bucket ACL unchanged.

Record independent Ed25519 readback and a fresh systemd container that
downloads the public package, checks its trusted SHA256, installs it,
and confirms the real client recognizes the signed channel as current.
No field device or POC API was upgraded.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-10-31 08:09:49 +08:00
eust-w
6c4c15576e ✨ Add signed public self-updates for portable drosync 1.1.6
Separate portable releases from the native update channel with embedded
Ed25519 trust roots, bounded verified downloads, immutable release objects
and a compare-and-swap stable pointer. Keep installation manual.

Split the Linux CLI's privileged installer from service-user IPC and state
access. Reverify signed plans as root, validate both private archives before
stopping systemd, retain baseline recovery and confirm live binary readiness.
Preserve configuration, user, state and enablement through upgrades.

Validate 317 macOS and 320 Linux workspace tests, Clippy, publisher race
tests, and 18 real systemd update/rollback/failure scenarios. No field
devices or POC API are modified by this implementation.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-10-31 07:41:55 +08:00
eust-w
402bc70bcf 🐛 Stop reconcile from reverting receipts written during its scan
reconcileSpace lists a page of up to 1000 heads, HEADs each object, then
wrote the stale copy back with UpsertObjectSyncHead. A commit (new ETag,
MD5 and platformVersion) or a digest attestation (md5sum and
md5Attestation) that landed in that window was reverted, leaving the head
drifted or legacy again.

Reconcile now records its verdict with SetObjectSyncHeadDrifted. It sets
only drifted and updatedAt, and only while the head still has the
remoteETag, versionId, platformVersion and md5sum that reconcile read; a
changed head is skipped. The Mongo filter matches missing legacy fields
with $in [null, ""] like the attestation CAS, and never upserts. The
scanned/drifted counters and the end-of-run space capability are unchanged.

Tests run a real commit and a real digest backfill on a second coordinator
replica while reconcile's HEAD is in flight and check that both receipts
survive unchanged; genuinely drifted heads are still flagged. Store tests
cover each compared field and the Mongo filter. The design doc no longer
lists this as a follow-up.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 15:58:31 +08:00
eust-w
846b806ed5 🧪 Hold the pause-resume body mid-stream so the pause lands in flight
The native pause-resume scenario failed with both old and new builds
because the harness could not reliably see an upload in flight. Pause
itself behaved correctly.

Client progress counts bytes handed to the socket, and the daemon writes
it to SQLite once per second. Loopback buffers absorb about 1-3 MiB of a
body (sometimes over 5 MiB on Linux), so a 4 MiB PUT read as 0 or as
complete in nearly every sample. The trigger fired on the 3rd or 4th PUT
at best, later or never under load, and never on Linux. With
FILE_CONCURRENCY=2 and PUT_CONCURRENCY=1, the file queued behind the
in-flight PUT is already dispatched and finishes too, so a late pause
left nothing paused.

The fixture now holds the first direct body after 64 KiB until the
harness has paused. pause-resume uses the 12 MiB default size, so a held
body still reads as partial. The scenario asserts that the held object
arrives intact and that every received object was reserved before the
pause. The daemon already follows the documented contract: pause stops
new dispatch and lets in-flight objects finish.

pause-resume: macOS arm64 10/10, Linux arm64 10/10 (old harness 0/5 on
Linux). Full native matrix on macOS: 26/26.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 15:57:53 +08:00
eust-w
e341a5bc85 📝 Record the POC API upgrade for partial cleanup proofs
Built only the API image from 91641b52 with Kaniko and rolled it out to
droboticflow-api (revision 530 to 531). Health reports the new commit and
digest, both pods are ready, and coordinator and worker are untouched.
Correct the rollback target to the image that was actually running.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 15:49:28 +08:00
eust-w
a56882bedc ✨ Verify legacy SHA256-only archives and backfill their MD5 server-side
Archived heads from protocol v1 carry only a SHA-256 receipt, so every sync
that still holds those files ends partial and they can never be cleaned.

Add an administrator-approved digest backfill job run by the coordinator.
It reads each legacy object with conditional (If-Match) ranged GETs, hashes
MD5 and SHA-256 in one pass, cross-checks every surviving receipt (retired
head sha256, drosync object metadata, BOS stored digests), and records the
MD5 on the head with a compare-and-set write, a bound attestation and an
audit event. It never writes to BOS and never accepts a client digest.

The cleanup proof now accepts an object without drosync-md5sum metadata
only through an attestation bound to its live ETag, version and size. The
next ordinary sync plans those files unchanged, completes, and they become
cleanable; closed partial sessions are left untouched.

Includes the design doc comparing remediation options, store/coordinator/
API unit tests and an end-to-end recovery test on MemoryStore and fake
object storage. Nothing is deployed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 15:44:14 +08:00
eust-w
91641b5234 📝 Prepare drosync 1.1.5 release and POC API upgrade plan
Record the Linux x86_64 portable package built from 94541175, its
checksums, and isolated verification: release verify steps on macOS and a
real systemd install, 1.1.1 to 1.1.5 upgrade, rollback and re-upgrade on
Ubuntu 22.04 amd64. Plan an API-only POC rollout for partial cleanup
proofs with rollback to the current digest. Nothing deployed yet.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 15:25:38 +08:00
eust-w
945411753b 🔖 Bump drosync to 1.1.5 for the release package
First package that carries partial-session per-file cleanup, direct retry
after a cleanup restore, and settled-identity checks for same-size
rewrites. Only workspace crate versions change in the lockfile.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 15:22:02 +08:00
eust-w
143a24b1e9 ⚡ Enable BOSFS readahead on the shared workspace PV
The workspace mount had no readahead or parallel transfer options, so
bosfs read a file back at ~3-5 MB/s. A800 checkpoint publication hashes
each 2.7G file twice through the mount, taking ~1h per checkpoint and
tripping the 1800s per-file limit. Baidu's recommended general options
raise reads to ~370-390 MB/s (verified on 192.168.80.136); the live PV
was patched the same way.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 14:12:38 +08:00
eust-w
6d4ce7a50c 📝 Record parent commit in same-size rewrite evidence
The fix was committed on top of unrelated bosfs reaper commits. Name the
comparison baseline and the actual parent separately so the evidence does
not imply a3b0bfe2 is the parent.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 12:24:23 +08:00
eust-w
e6ad7ff079 🐛 Rehash sources whose metadata has not settled
Linux stamps writes from a coarse clock, so a same-size rewrite inside one
timestamp tick can keep size, mtime, ctime and inode identical. The scan
cache, daily report and pre-upload check treated that metadata as proof of
unchanged content.

Record when each hash started and trust identity alone only when the last
change was at least three seconds older. Unsettled or legacy cache entries
are rehashed, reports verify their MD5, and uploads re-read the source
before requesting or completing a transfer. Receipt evidence keeps an
optional observedAt beside the identity (schema 7 unchanged) and is
upgraded by a later settled scan; cleanup restores stay unsettled.

Linux arm64: 300 workspace tests pass serially and in parallel; the same
probe drops stale cache reuse from 188/500 and 351/500 to 0.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 12:23:48 +08:00
eust-w
bd21154d8c 🛡️ Harden bosfs-tmp-reaper against arg drift, dir races, and silent stalls
- skip the whole cycle when any bosfs process lacks credentials/<hash>
  so live caches are never mistaken for leaks after a plugin upgrade
- stop removing empty mount directories that kubelet may still bind-mount
- touch a heartbeat per completed cycle and restart on a stale one via
  livenessProbe, so a stalled or skipping reaper shows up as restarts

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 12:03:06 +08:00
eust-w
f29ec4bfae 🐛 Reap leaked bosfs temp files that evicted A800 training mounts
CCE csi-bosplugin writes bosfs.tmp.* under host /tmp/bosfs on the node
root disk and never removes them when a mount pod ends. Leaks filled the
A800 node root disk, kubelet evicted the bosfs FUSE pod mid-training and
runs failed with Errno 107. Add a DaemonSet that deletes temp files of
dead mounts not held open by any process, and document the failure mode.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 11:48:24 +08:00
eust-w
a3b0bfe29a 🧪 Complete isolated Linux cleanup recovery acceptance
Verify 36 cleanup tests and 12 native CLI/API scenarios using fresh build targets. Preserve the remaining full-workspace failure, reproduce pre-existing metadata recognition limits on the baseline, and document the authorized Colima recovery without deployment or device upgrades.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-29 20:16:18 +08:00
eust-w
e14c27fc14 🐛 Safely refresh source receipts after cleanup restoration
Bind recovery to the original receipt and scope, verify the held file and MD5, persist strict restart checkpoints, and atomically refresh identity without reusing cloud authorization. Cover direct retry, replacement protection, stale journals, and transactional failures; record Linux validation limits.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-29 18:13:03 +08:00
eust-w
9fa582bc89 🧪 Verify partial cleanup across native clients and real API routes
Add isolated current/legacy CLI and cleanup API comparisons, legacy MD5 planning coverage, and reproducible evidence. Record stale deployment identities and the need to refresh source receipts after failed cleanup restoration.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-29 12:36:52 +08:00
eust-w
0839974b71 📝 Clarify drosync Rust architecture, usage, and safe cleanup
Document source versus installed versions, client/server responsibilities, configuration, sync and cleanup workflows, development checks, and release boundaries.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-28 18:12:27 +08:00
eust-w
503a45e152 🐛 Allow verified per-file cleanup from partial sync sessions
Keep MD5 receipts, source identity, live object proofs, and lease expiry checks mandatory. Recheck quarantined content before deletion and cover mixed-session retention on macOS and Linux.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-28 15:58:21 +08:00
eust-w
6b3ed706c4 🐛 Correct ego CPU action checks and split report data flow
Validate the dataset's 78-dimensional actions, export split records instead of the leakage report, and render selected training episodes with supported template fields. Add regression coverage for record round-tripping, route counts, and empty reports.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-28 15:25:09 +08:00
WishForge Agent
789145750b ✨ WishForge checkpoint 42eedbd9-b178-4bf6-a908-32f468f63a28 2026-10-28 14:12:49 +08:00
eust-w
5b4716851e 📦 Publish the corrected split leakage validator for POC
Record the poc build from 93b106d5 and its registry-verified digest. Regenerate the catalog and repository manifests, and increment the build version to 1.1.4 per project policy.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-28 12:00:47 +08:00
eust-w
93b106d53e 🐛 Validate upstream split manifests in the leakage check and add ego CPU extra workflow
The leakage validator resolved an upstream dataset-split-manifest artifact to the
unsplit episodes file named in its sourcePath, so every row lacked a split. It now
reads the manifest itself when no SOURCE_PATH is set. ego-stage gains a media mode
that lists staged videos as a manifest, and ego_workflows.py adds the cpu_extra
workflow covering 13 more CPU operators.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 02:15:28 +08:00
eust-w
8a4fb683b7 📦 Republish all builtin operator images with missing digests
Rebuild the 66 builtin operator images whose catalog digests no longer
existed in CCR, plus 13 whose repo pins were equally stale (they only
worked live because the live catalog had been repinned by hand). Built
from poc with kaniko on the current bases (operator-runner d7a2fcea,
gpu-base/yolo-base c3eaecc) and recorded automatically by
record_operator_releases.py.

verify_operator_image_digests.py now reports 103/103 pinned builtin
images present. The live POC catalog was repinned for the 66 with
sync_live_builtin_operator_images.py; the 13 keep their working live
pins (several are Fanyu-line builds) until someone promotes them.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 20:16:44 +08:00
WishForge Agent
49ec357571 ✨ WishForge checkpoint 3ccafecd-36d9-4a0f-83cc-f420f54ccce2 2026-10-27 19:43:42 +08:00
eust-w
34b2cce34e 🔧 Record operator digests after every build and verify pinned images exist
Builtin operator images were rebuilt four times after 2026-06-29 but the
catalog kept the first digests: recording a release was a manual step
that nothing ran. Once the old tags were pruned from CCR, 66 builtin
operators pointed at manifests that no longer exist.

- build-poc-images-kaniko.sh now runs record_operator_releases.py after
  operator builds (POC_KANIKO_RECORD_RELEASES, default true): it resolves
  each pushed tag to its digest, writes release.json with the stable
  :builtin tag, regenerates the catalog and repository manifests, then
  runs verify_operator_image_digests.py on the built operators.
- verify_operator_image_digests.py fails when any pinned catalog digest is
  missing from the registry (usable in CI / before deploys).
- sync_live_builtin_operator_images.py promotes catalog digests to a
  running platform (the API keeps live digests over the catalog), only
  after confirming each digest exists; dry run unless --apply.
- scripts/lib/registry_client.py parses repo:tag@sha256 references and
  handles CCR's Bearer token challenge.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 19:19:02 +08:00
eust-w
67d662a404 📦 Republish nine CPU builtin operator images with missing digests
action_state_quality_validate, camera_calibration_validate,
dataset_split_manifest, embodiment_metadata_validate,
episode_boundary_validate, language_instruction_validate,
parquet_table_summary and video_target_clip pinned digests that do not
exist in CCR. Rebuild them from poc with kaniko on the current
operator-runner base (dataset_split_manifest includes the episode_index 0
fix) and record the new digests in release.json and the builtin catalog.
The live POC catalog was repinned to the same digests.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 18:34:13 +08:00
eust-w
54ff6545bd ✨ Add CPU-only ego workflows and an episode roll-up stage mode
Add "cpu_data" (Parquet summary, action/state quality, episode
boundaries, language instructions, embodiment metadata, split manifest)
and "cpu_video" (10s slicing, motion clipping) workflows that need no
GPU. The ego-stage operator gains an "episodes" mode that rolls this
dataset's per-subtask episodes.jsonl up to one row per episode with a
length, which the split manifest needs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 18:18:56 +08:00
eust-w
770d86d906 🐛 Keep LeRobot episode_index 0 in the dataset split manifest
_episode_id used `str(value or "")`, so an episode_index of 0 counted as
missing and fell back to the row number, giving inconsistent episode ids
(e.g. ['1', '2', 'episode-0']). Treat only None/blank values as missing.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 18:18:56 +08:00
WishForge Agent
4e3cf35f1b ✨ Integrate verified WishForge commit 0acb2c95ee52 2026-10-27 18:04:25 +08:00
eust-w
1094b75e76 ✨ Add the full ego pipeline and operator repinning to the workflow script
Define "full": stage -> LeRobot overview -> Parquet schema -> metadata
consistency -> frame alignment -> SAM3.1, joined with left-camera video
QC into mask collection -> ProPainter hand removal -> upload. Workflow
inputs bind the two root nodes. Drop the ineffective runner-image
override (builtin nodes are re-resolved from the catalog by the worker)
and add pin-operator to repin builtin operators to a pushed digest.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 17:36:46 +08:00
WishForge Agent
0acb2c95ee ✨ WishForge checkpoint 515b814a-8bde-4358-96fc-0b4712f890b3 2026-10-27 17:26:18 +08:00
WishForge Agent
770cd4c897 ✨ WishForge checkpoint 42e84089-6264-4a12-a2da-9189750bafb0 2026-10-27 17:17:51 +08:00
eust-w
0c776c04fb 📦 Republish LeRobot validator images whose pinned digests were missing
The builtin catalog pinned digests for lerobot_dataset_validate,
lerobot_metadata_consistency_validate and lerobot_video_alignment_validate
that no longer exist in CCR, so every run of them sat in ImagePullBackOff
(the reconciler race had been reporting this as missing Jobs).

Rebuild the three images from poc 30d91677 with kaniko on the current
operator-runner base (droboticflow-operator-runner@sha256:d7a2fcea...)
and record the new digests through update_operator_release_manifests.py
and the generators, keeping the stable :builtin tag convention.

Note: a registry check of the live catalog found 82 of 103 builtin
digests returning 404; only these three are republished here.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 16:58:20 +08:00
eust-w
30d916774c 🐛 Fail launches whose pod stays blocked instead of hanging the run
The reconciler used to be the only place that failed a node whose pod sat
in ImagePullBackOff/Unschedulable past WORKER_PENDING_FAILURE_SECONDS. Now
that it leaves runs with a live execution lease alone (0b365155), such a
node would wait for the full launch deadline.

Have Launch check the Job's pods (at most every 10s) and, once a pod has
been blocked for PendingFailureTimeout, delete the Job and return the
blocking reason and message. The executor passes the configured pending
threshold. On POC this surfaced builtin validator images that cannot be
pulled, which the reconciler race had been masking as missing Jobs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 16:25:24 +08:00
eust-w
0b365155e7 🐛 Stop the reconciler from recovering runs that are still executing
reconcileActiveRun inspected every running run whose current node had
been running for over 2 minutes and, when it saw no Job, deleted all of
the run's Jobs (TerminateRun) and re-queued it. It did this even while
another goroutine, in this process or in the other worker replica, was
executing the run and holding its lease. On POC that deleted live Jobs
("Kubernetes job is missing; recovery attempt N/3"), flipped nodes to
failed and back, and left runs queued under a lease nobody could claim.

Skip runs that this process is executing or whose execution lease is
held by any owner and not yet expired. A crashed owner's lease lapses,
so abandoned runs are still recovered.

Also give outputs without an id a deterministic run-node-port-name id
instead of failing the node. Custom images registered before ids were
required (SAM3 collect, hand removal v4) produced correct outputs that
the worker then discarded with "operator output id is required".

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 15:43:12 +08:00
WishForge Agent
314c615c00 ✨ WishForge checkpoint ee35e3fd-cd62-421e-8ff1-a222130f2b2f 2026-10-27 15:12:24 +08:00
eust-w
f00e9b9506 ✨ Stage ego data on the workspace PVC and split workflows for the POC worker
Add the ego-stage lightweight operator: it downloads presigned BOS files
into the run (or a stable /workspace/ego-staging path), collects another
node's outputs, and registers files as artifacts with ids. Operators such
as SAM3.1 and hand removal only read local paths, and their own images
emit artifacts without ids, which the current worker rejects.

Rework scripts/ego_workflows.py around what the current worker runs
reliably: short chains, one consumer per stage, validators on the
operator-runner image, plus commands to register the stage operator,
stop runs, read logs/run details and download results.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 15:03:12 +08:00
eust-w
674397ca98 ✨ Run ego workflows on the current worker via presigned run inputs
Video QC now receives its video list as an inline workflow input whose
items carry 1h BOS presigned URLs, and WiLoR gets a fresh presigned
INPUT_URL before each run, so neither depends on the worker turning
bos:// source outputs into refs. Add logs/worker/artifacts commands for
diagnosing runs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 12:48:21 +08:00
eust-w
a4b933330a ✨ Add ego dataset workflow builder for the POC platform
scripts/ego_workflows.py inspects an egocentric LeRobot dataset on BOS
through the platform API and creates processing workflows for it:
integrity checks, left-camera video QC, WiLoR 3D hand pose, and
SAM3.1 + hand removal (node settings cloned from the proven egodex
pipeline). Source and upload nodes are bound to the org's storage
connection so the worker can turn bos:// outputs into object refs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 12:01:35 +08:00
eust-w
fa213e0e7f 🐛 Restore BOS object refs for source-node outputs in the worker
Source operators (real_source, directory scan) list BOS objects without
downloading them and emit artifacts whose path is bos://bucket/key.
7ca47c62 removed the worker branch that turned those paths into object
refs, so every workflow reading mp4/parquet from BOS failed with
"artifact_externalization_failed: inaccessible operator staging file".

Convert bos:// outputs into object refs using the node's storage
connection (falling back to the artifact-storage policy), and validate
them like any other ref: the connection must belong to the run's
organization and the object must exist. The previous version skipped
both checks.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 11:59:25 +08:00
eust-w
f560f9b638 🔒 Fix tenant-isolation holes and stale-response races
Backend:
- Reject target=platform in the database browser; it let any org admin
  read every tenant's records (including password hashes) from the
  shared platform database. The UI never uses this target.
- Check run ownership before proxying /worker-api/runs/{id}/retry so an
  org cannot re-run another org's workflow.
- Resolve symlinks when reading lightweight operator files; a symlinked
  parent directory could expose files outside the code root.
- Remove uploaded image archives after import instead of leaving
  multi-GB tarballs on the shared workspace PVC.

Frontend:
- Ignore stale responses in the lightweight code editors (component and
  Operators page) so a slow load cannot put file A's content under file
  B, where Save would overwrite B. Stop re-listing on every file click.
- Ignore stale collection queries in the database browser so edits
  cannot be saved against the wrong collection.
- Ignore stale run-detail responses in the Monitoring modal.
- Join an in-flight workflow save instead of starting a second one that
  reports a false "server version changed" conflict.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 11:35:06 +08:00
eust-w
c9f5dc5f4d 🚨 Restore lint gates: rustfmt, clippy, gofmt and prettier
- Run cargo fmt across the drosync workspace.
- Fix clippy -D warnings failures (pedantic): collapse nested ifs with
  let-chains, replace wildcard imports, add #[must_use], use
  unsigned_abs() for clamped i64->u64 casts, rename Phase.phase field,
  and allow too_many_lines/too_many_arguments where the repo already does.
- gofmt internal/lightweight/lightweight_test.go.
- Prettier-format three frontend test files.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 11:35:06 +08:00
WishForge Agent
4142761b56 ✨ WishForge checkpoint 98132ff7-74fb-4267-9ed0-a37a4a4f8958 2026-10-26 22:49:34 +08:00
WishForge Agent
cd2ef2fea7 ✨ WishForge checkpoint b8be37e2-e3bc-404d-a44b-118bb68b64f6 2026-10-26 20:25:40 +08:00
WishForge Agent
40c7b51745 ✨ WishForge checkpoint 4f766ff3-e4bb-4711-bbff-d74709ea3662 2026-10-26 20:07:10 +08:00
WishForge Agent
a18918e559 ✨ WishForge checkpoint f8a87367-8797-4e3e-bf00-dec2f5bff090 2026-10-26 19:59:48 +08:00
WishForge Agent
2dc346aae3 ✨ WishForge checkpoint 73ce518e-f9c2-42c1-be75-a61eebb6edbf 2026-10-26 16:50:30 +08:00
WishForge Agent
b38f628455 ✨ WishForge checkpoint e4c55b06-58cd-4301-9589-6122c84f2649 2026-10-26 11:50:44 +08:00
WishForge Agent
72bab5d622 ✨ WishForge checkpoint 3778ea4c-198d-4c4a-be36-2bcb3736c6fd 2026-10-26 05:46:40 +08:00
WishForge Agent
4a8dc3bf4f ✨ WishForge checkpoint 3778ea4c-198d-4c4a-be36-2bcb3736c6fd 2026-10-26 05:44:26 +08:00
WishForge Agent
a89949dff4 ✨ WishForge checkpoint bf95a4c1-4f4f-4589-a19f-9e9a22cd678f 2026-10-26 03:19:26 +08:00
WishForge Agent
b1fde84ef9 ✨ WishForge checkpoint f6331c6e-a5d4-407e-b85f-74b522536e76 2026-10-26 02:29:59 +08:00
WishForge Agent
64a1869494 ✨ WishForge checkpoint bf0cbebf-287b-47a1-bfc2-68a1a9205c5c 2026-10-26 00:52:36 +08:00
WishForge Agent
2be15f098a ✨ WishForge checkpoint bf0cbebf-287b-47a1-bfc2-68a1a9205c5c 2026-10-26 00:50:35 +08:00
eust-w
1579c747ac 🧪 Verify public drobotic-pull package on clean Ubuntu 22.04
Record fresh public-download installation as a normal user, UBT authentication and real BOS transfer, 12 CLI regressions, interrupted 4 GiB resume with full SHA256, and a 307-second continuous response. Document the Colima amd64 emulation boundary and that no customer device was modified.
2026-10-22 15:20:02 +08:00
eust-w
f553e40494 📦 Document public downloads for drobotic-pull 1.0.1
Publish the existing verified archive and checksum as two public-read BOS objects under a versioned prefix. Record anonymous HTTPS readback, matching SHA256, and Linux version verification without changing bucket permissions.
2026-10-22 15:01:53 +08:00
WishForge Agent
7613677dfe Merge commit 'a3f5c7fd15e2ee6694aef0b8be9e09737381d3cb' into HEAD 2026-10-22 14:58:16 +08:00
eust-w
6a4e96c835 🧪 Record Ubuntu 22.04 installation failure and update validation 2026-10-22 14:55:42 +08:00
eust-w
8780cd598c 🐛 Fix large model downloads and package drobotic-pull 1.0.1
The old shipped v1.0.0 used a 300-second whole-response deadline. Keep active transfers alive, validate ranged retries, filter BOS folder markers, and preserve accurate failure/progress reporting. Verify the Linux package with interrupted 4 GiB transfers, a 307-second stream, and the real 7.47 GiB checkpoint with matching SHA256 receipts.
2026-10-22 14:19:48 +08:00
WishForge Agent
a3f5c7fd15 ✨ WishForge checkpoint f40620ef-d04c-4903-a7e9-0c81551b0830 2026-10-22 14:14:03 +08:00
WishForge Agent
6c02c882ef ✨ Improve POC status checks and retry controls 2026-10-22 13:59:11 +08:00
eust-w
b93232d31c 🐛 Fix partial-session receipt recovery in drosync 1.1.2 2026-10-22 13:07:11 +08:00
eust-w
96a1852348 🧪 Record drosync 1.1.1 real BOS regression and unresolved Linux risks 2026-10-16 11:29:17 +08:00
eust-w
b2a8df4f28 📦 Release drosync 1.1.1 with configuration docs and Linux compatibility tests 2026-10-16 10:05:58 +08:00
eust-w
4b53f0deca 📝 Update complete drosync 1.0.35 configuration and requirements guide 2026-10-16 06:20:07 +08:00
eust-w
a1fb6a451c 🧪 Record Linux glibc compatibility verification evidence 2026-10-16 06:18:14 +08:00
eust-w
ee9d7b4272 📦 Build drosync 1.0.35 for Linux x86_64 and verify glibc 2.39 2026-10-16 06:18:08 +08:00
eust-w
3072e1c105 📝 Normalize regression evidence formatting 2026-10-16 06:12:03 +08:00
eust-w
5ec5ea4ad4 🐛 Fix missing-source classification and fallback log path resolution 2026-10-16 06:11:36 +08:00
eust-w
8fc801c9d5 🧪 Audit daily upload requirements against real BOS 2026-10-16 05:12:51 +08:00
eust-w
17b6e0c1a4 🧾 Preserve POC migration and upload test evidence 2026-10-16 03:53:42 +08:00
eust-w
11bb5e1bf5 🚀 Consolidate POC control plane and verify real BOS uploads 2026-10-16 03:51:32 +08:00
eust-w
ac1e258f48 ✅ Record large-file completion after detailed progress rollout 2026-10-15 20:15:28 +08:00
eust-w
cae97006d0 📊 Show live scan and MD5 preparation stages in daily reports 2026-10-15 20:12:18 +08:00
eust-w
0aa8b4797c ✅ Enable parallel POC manual uploads and verify persistent recovery 2026-10-15 17:30:48 +08:00
eust-w
6234e5acd8 📝 Inventory POC cutover blockers and verify v2 candidate authentication 2026-10-15 16:56:43 +08:00
eust-w
2e46d60da9 📝 Record POC manual upload space and authentication blocker 2026-10-15 15:54:19 +08:00
eust-w
ae5fc2f1eb 📝 Document local drosync resident setup and pending cloud binding 2026-10-14 15:35:31 +08:00
eust-w
f536616e59 📊 Add file-level daily reports and exact missing-file lookup 2026-10-14 11:06:47 +08:00
eust-w
d87449c003 📊 Clarify daily report scope and correct binary size units 2026-10-13 21:36:54 +08:00
eust-w
693519d093 🧪 Complete real BOS acceptance and fix client retry diagnostics 2026-10-13 20:28:36 +08:00
eust-w
29e9012e97 📋 Preserve failing readiness and report reproductions 2026-10-13 15:59:34 +08:00
eust-w
2f0c0cf110 🧪 Expand native sync fault coverage and fix readiness reporting 2026-10-13 15:56:27 +08:00
eust-w
7ec402c225 📋 Preserve redacted client diagnostic log transcripts 2026-10-13 12:55:37 +08:00
eust-w
0f17fb05ae 🧭 Enhance client sync diagnostics and correlated logs 2026-10-13 12:54:15 +08:00
eust-w
03f8c67ce4 🧪 Validate multi-file BOS sync recovery and daily reports 2026-10-13 10:48:04 +08:00
eust-w
07443970c1 🧪 Verify macOS launchd startup and crash recovery 2026-10-13 04:37:44 +08:00
eust-w
0324c9af02 🧪 Verify Ubuntu 22.04 installation and real BOS uploads 2026-10-13 03:52:01 +08:00
eust-w
1717c2aa34 🧪 Validate optimized upload flow against POC Mongo and BOS 2026-10-13 02:13:59 +08:00
eust-w
793ffd8d31 ⚡ Skip confirmed files, stream ordered pages and finalize verified uploads 2026-10-13 01:58:10 +08:00
eust-w
716ce417a0 🚢 Deploy and validate isolated POC MD5 candidate with cutover inventory 2026-10-12 16:41:42 +08:00
eust-w
c4541228e4 📦 Prepare POC MD5 deployment candidate 1.0.25 2026-10-12 16:01:38 +08:00
eust-w
26da9e5094 🧪 Record MD5-only Ubuntu and real BOS acceptance 2026-10-12 15:43:15 +08:00
eust-w
9a5f9ed547 ⚡ Use MD5-only upload integrity with explicit hash epoch migration 2026-10-12 15:34:26 +08:00
eust-w
b6862328e5 🐧 Validate installed Ubuntu uploads and fix BOS metadata identity casing 2026-10-12 11:27:51 +08:00
eust-w
64f6c2ea64 📦 Prepare drosync Ubuntu 22.04 installation acceptance build 2026-10-12 10:58:42 +08:00
eust-w
a9bd309124 📋 Preserve drosync test execution logs 2026-10-12 10:37:58 +08:00
eust-w
3cfa871ce1 🧪 Verify drosync functionality and repair stale test fixtures 2026-10-12 10:37:47 +08:00
eust-w
2dc54070c2 ⚙️ Default drosync file and upload concurrency to four 2026-10-12 04:10:24 +08:00
eust-w
ca976a8c17 🕒 Dispatch drosync uploads by capture time 2026-10-12 04:00:21 +08:00
eust-w
ede4c61f82 🚀 Upload drosync files directly to final BOS paths 2026-10-12 03:35:15 +08:00
eust-w
fbb3cdf32b 📐 Add source-backed drosync system architecture diagram 2026-10-10 18:31:31 +08:00
eust-w
5d90885c5d 📝 Record deployed organization storage isolation acceptance 2026-10-10 18:06:20 +08:00
eust-w
3fb1157172 🔄 Automatically recover pending organization storage provisioning 2026-10-10 17:52:10 +08:00
eust-w
13ffd61780 🔒 Automatically scope storage for newly created organizations 2026-10-10 17:41:52 +08:00
eust-w
bcba368c82 📝 Record UBT scope validation and POC cutover blockers 2026-10-10 16:59:25 +08:00
eust-w
cb6c52e1bb 🧪 Support scoped BOS roots in POC acceptance 2026-10-10 16:55:15 +08:00
eust-w
e3f318f58d 🔒 Enforce organization storage roots across BOS workflows 2026-10-10 16:48:55 +08:00
eust-w
67996db45d 🛡️ Protect archived uploads and surface local hash conflicts 2026-10-10 16:46:02 +08:00
eust-w
b593d78392 📝 Audit reported upload timeout, ordering and metadata polling 2026-10-10 15:49:19 +08:00
eust-w
32ff9b065c 📊 Document daily upload completion and system architecture 2026-10-10 15:18:07 +08:00
eust-w
798aabe101 📝 Correct the remote prefix requirement comparison 2026-10-09 16:52:02 +08:00
eust-w
6f4d3ea35e 📝 Record POC artifacts and real BOS acceptance results 2026-10-09 14:12:30 +08:00
eust-w
7568df7fdd 🐛 Fix durable Linux cleanup and recovery in drosync 1.0.14 2026-10-09 13:36:18 +08:00
eust-w
871f70801d 🐛 Preserve Mongo lease identities for safe cleanup in 1.0.13 2026-10-09 13:06:57 +08:00
eust-w
7bad447d89 🐛 Fix duplicate upload length headers in drosync 1.0.12 2026-10-09 12:53:50 +08:00
eust-w
b5100f6660 📦 Prepare drosync 1.0.11 for POC rollout 2026-10-09 11:53:55 +08:00
eust-w
a7b62bef98 🗓️ Use calendar selection for the daily report date 2026-10-09 11:42:23 +08:00
eust-w
c8feea8f9c 🐛 Unify upload reporting and recovery across failure states 2026-10-09 11:31:10 +08:00
eust-w
6ebcd28921 🐛 Fix daily upload audit gaps in missing files and recovery 2026-10-08 20:43:51 +08:00
eust-w
9152bcf359 ✨ Complete daily upload workflows and bounded performance controls 2026-10-08 19:22:49 +08:00
eust-w
8a447d2532 📝 Clarify read-only audit credential boundary 2026-10-08 17:24:35 +08:00
eust-w
04b89ce305 📝 Explain active POC workloads and cancellation impact 2026-10-08 17:22:05 +08:00
eust-w
ade54848fc 🛠️ Correct cutover inventory and record POC migration prerequisites 2026-10-08 16:33:02 +08:00
eust-w
49a954610f 📝 Record POC image smoke tests and coordinated cutover gate 2026-10-08 15:35:18 +08:00
eust-w
1044b507c8 🛠️ Repair resumable metadata and bounded BOS recovery 2026-10-08 15:08:01 +08:00
eust-w
018730c993 📝 Audit remaining drosync metadata and timeout failures 2026-10-08 14:08:35 +08:00
eust-w
95d94b3309 ✨ Complete drosync workflows and recovery safeguards 2026-10-08 12:25:38 +08:00
eust-w
53a4d7db63 📝 Audit drosync feature workflows and closure gaps 2026-10-07 21:44:00 +08:00
eust-w
62eadffab9 🚀 Harden drosync workflows and scale upload metadata 2026-10-03 02:48:48 +08:00
eust-w
a9d72cf74c 📝 Audit drosync entry points, reliability, and performance 2026-10-03 00:43:39 +08:00
eust-w
bf0a961a32 ♻️ Consolidate drosync operations into single canonical entries 2026-10-01 00:05:09 +08:00
eust-w
885e79f251 ⚡ Optimize drosync commit progress polling and session summaries 2026-09-30 15:11:04 +08:00
eust-w
f7f9825ab6 🛡️ Handle missing local files and non-retryable transfer errors gracefully 2026-09-30 00:36:10 +08:00
eust-w
aac339438c ✨ fix(daemon): unify service user to ubt and load config from files 2026-09-23 11:57:01 +08:00
eust-w
2ca1c7367e 🧹 docs: remove external documentation files from repo and link to live Feishu documents 2026-09-23 05:18:51 +08:00
eust-w
0c9a60013a 📚 docs: complete external developer and user documentation suite for POC 2026-09-23 05:07:05 +08:00
eust-w
3512ce1ccb 📝 docs: add external documentation architecture plan and feishu blueprint 2026-09-23 04:59:53 +08:00
eust-w
65395bdd16 📚 docs: add drosync v1.0.1 deployment and operations guide 2026-09-23 04:41:45 +08:00
eust-w
1bb26f2af0 📦 chore(release): bump drosync to v1.0.1 and document versioning rule 2026-09-23 04:37:10 +08:00
eust-w
caccedd4a1 🔧 Improve clean-install script with daemon_meta table and container check 2026-09-23 04:31:31 +08:00
eust-w
47d9a6d0c0 ✨ Remove duplicate CLI entry points and consolidate daemon management to system service 2026-09-23 03:34:08 +08:00
eust-w
2241742d9c ✨ Prioritize system state_db and add web api endpoints for status, mappings, pause, and abort 2026-09-23 03:13:41 +08:00
eust-w
a95b074b1d ✨ Support dual system socket paths and system token fallback for single entry point 2026-09-23 03:06:53 +08:00
eust-w
1523d85492 ⚡️ Decouple abort from transfer gate to eliminate deadlock 2026-09-23 02:51:01 +08:00
eust-w
b4b0d32779 ✨ Fall back to system state_db in web dashboard 2026-09-23 02:47:10 +08:00
eust-w
9481e8ee57 ✨ Unify drosync daemon entry points with automatic system socket fallback 2026-09-23 02:27:57 +08:00
eust-w
8846ec3e7d ✨ feat(drosync): add clean installation script and stale session cleanup to linux installer 2026-09-22 20:13:36 +08:00
eust-w
8fb87fc356 ✨ fix(drosync): auto-abort stale incompatible journals and enhance session abort 2026-09-22 20:03:48 +08:00
eust-w
4b397140a4 📝 docs(drosync): update feishu manual with latest release download links 2026-09-22 15:00:42 +08:00
eust-w
4d2b6025d3 🐛 fix daily report missing match when mapping uses remote_prefix 2026-09-22 14:03:07 +08:00
eust-w
c31b12e609 ✨ respect DROSYNC_REPORT_DIR in web dashboard export endpoint 2026-09-21 17:18:41 +08:00
eust-w
73c90acd22 ✨ support DROSYNC_REPORT_DIR environment variable for global report output directory 2026-09-21 16:24:37 +08:00
eust-w
bb524b3ee2 📝 docs(drosync): update feishu manual with new download links and sync troubleshooting FAQ 2026-09-21 14:44:04 +08:00
eust-w
9f297d47b9 ✨ feat(drosync): support optional mapping_id, diagnostic zero-file hint, and web one-click sync 2026-09-21 14:33:25 +08:00
eust-w
549d2e65de 📝 docs(drosync): update feishu manual with latest web-report download links 2026-09-20 17:01:56 +08:00
eust-w
112ec4bdf9 📝 Clarify POC cutover maintenance requirements 2026-09-19 21:35:16 +08:00
eust-w
7ca47c628b 🧹 Enforce current contracts and retire legacy runtime compatibility 2026-09-19 21:32:23 +08:00
eust-w
e1c6c8b2f6 🧹 Remove retired drosync pairing implementation and schemas 2026-09-19 18:09:03 +08:00
eust-w
38d5a46f33 🧹 Remove legacy user roles and reject unsupported identities 2026-09-19 17:58:37 +08:00
eust-w
6464c33f2b 📝 docs: document POC role scenarios and actual permissions 2026-09-19 17:46:07 +08:00
eust-w
ebc1316fb6 📝 docs(drobotic-pull): update user manual with download links and resume features 2026-09-18 15:28:39 +08:00
eust-w
6e8295ae01 ✨ feat(drobotic-pull): support HTTP Range resume and idle stream timeout 2026-09-18 15:00:06 +08:00
eust-w
57396ba7eb 📚 docs: update drosync manual markdown and add standalone html version 2026-09-17 17:30:56 +08:00
eust-w
9245c40e50 ✨ feat: add local unauthenticated sync report dashboard with configurable port 2026-09-17 15:24:05 +08:00
eust-w
1a95cbdf10 📊 feat(drosync): add daily upload statistics report and web dashboard 2026-09-17 14:19:22 +08:00
eust-w
ecce5c8c2b 📚 Add drosync Feishu user manual and architecture documentation 2026-09-17 10:27:06 +08:00
eust-w
b5e67add36 📚 Add drobotic-pull user manual for Feishu documentation 2026-09-17 09:15:57 +08:00
eust-w
5f75cfccf3 🔧 Ignore Rust target directories and track Cargo.lock 2026-09-17 09:04:34 +08:00
eust-w
c01947857a ✨ Fix storage connection list parsing and default bucket resolution in drobotic-pull 2026-09-17 08:30:23 +08:00
eust-w
109290eeb1 ✨ Add drobotic-pull Rust tool and directory manifest API 2026-09-17 08:16:31 +08:00
eust-w
02c654c0ea 🐛 Resolve storage connection credentials from input bindings in worker 2026-09-07 19:52:43 +08:00
eust-w
eb1f49c146 🐛 Fix sessions respawning after mapping removal
- Add database guard in scheduler sync path to re-check mapping
  existence before calling sync_mapping, closing the race window
  between the 60s in-memory cache refresh and mapping.remove
- Abort orphaned non-terminal sessions when a mapping is removed
- Clear pending journal entry on mapping removal to prevent
  restart-triggered session creation
2026-09-07 17:47:42 +08:00
eust-w
fe10b9c048 🧪 Add live drosync manifest boundary regression 2026-09-06 04:32:10 +08:00
eust-w
6a2056f67b 🧪 Add reproducible drosync POC abort regression and evidence 2026-09-05 23:10:58 +08:00
eust-w
5b80cb68e0 🐛 Fix drosync aborted session lease cleanup and heartbeat guards 2026-09-05 22:39:34 +08:00
eust-w
1f994927c0 🔒 Preserve POC rollback baseline and drosync script permissions 2026-09-05 14:29:14 +08:00
eust-w
0d5578421e 🐛 Stabilize drosync automatic scheduling 2026-09-05 14:22:21 +08:00
eust-w
76cc571c49 📚 Add drosync Chinese user manual 2026-09-05 14:22:20 +08:00
eust-w
685671f390 🔒 Support headless drosync system services 2026-09-05 14:22:20 +08:00
eust-w
927b1f7163 📦 Harden drosync Linux packages 2026-09-05 14:22:20 +08:00
eust-w
0c02227082 ✨ Add bucket-based drosync mappings 2026-09-05 14:22:20 +08:00
eust-w
6ff9e55405 📦 Preserve drosync ARM64 packaging and signed updates 2026-09-05 14:22:20 +08:00
2294 changed files with 367626 additions and 43125 deletions

View File

@ -0,0 +1,539 @@
{
"schema_version": 1,
"diagram_type": "architecture",
"meta": {
"title": "DroboticFlow 系统架构与存储边界",
"locale": "zh-CN",
"output": ".archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"quality_profile": "showcase",
"repository": {
"url": "git@gitea.d-robotics.cc:longtao.wu/droboticflow.git",
"revision": "798aabe101f34c30e160f1771c474c90fc9c06e4",
"link_mode": "local-only"
}
},
"components": [
{
"id": "web",
"type": "frontend",
"label": "Web 业务界面",
"sublabel": "工作流·审核·存储",
"pos": [
40,
70
],
"size": [
230,
100
],
"sources": [
{
"path": "src/services/api/client.ts",
"line": 67,
"end_line": 105
},
{
"path": "internal/api/auth.go",
"line": 288,
"end_line": 316
},
{
"path": "internal/api/object_storage_browser.go",
"line": 2090,
"end_line": 2124
}
],
"tag": "登录与角色权限"
},
{
"id": "api",
"type": "backend",
"label": "Go API 控制面",
"sublabel": "业务管理·设备与上传授权",
"pos": [
440,
70
],
"size": [
240,
100
],
"sources": [
{
"path": "cmd/api/main.go",
"line": 83,
"end_line": 132
},
{
"path": "internal/api/object_sync.go",
"line": 2180,
"end_line": 2255
},
{
"path": "internal/api/object_storage_browser.go",
"line": 1194,
"end_line": 1224
}
],
"tag": "连接按组织校验"
},
{
"id": "mongo",
"type": "database",
"label": "MongoDB 控制状态",
"sublabel": "任务·Session·租约·审计",
"pos": [
850,
70
],
"size": [
260,
100
],
"sources": [
{
"path": "internal/store/object_sync.go",
"line": 884,
"end_line": 914
},
{
"path": "internal/store/mongo.go",
"line": 646,
"end_line": 684
},
{
"path": "internal/store/mongo.go",
"line": 1162,
"end_line": 1240
}
]
},
{
"id": "worker",
"type": "backend",
"label": "Go Worker 调度",
"sublabel": "轮询任务·维护运行状态",
"pos": [
1280,
70
],
"size": [
240,
100
],
"sources": [
{
"path": "cmd/worker/main.go",
"line": 79,
"end_line": 119
},
{
"path": "internal/worker/runtime.go",
"line": 432,
"end_line": 452
},
{
"path": "internal/worker/artifact_storage.go",
"line": 229,
"end_line": 320
}
]
},
{
"id": "cli",
"type": "frontend",
"label": "Drosync CLI",
"sublabel": "auth / mapping / sync / clean",
"pos": [
40,
400
],
"size": [
230,
100
],
"sources": [
{
"path": "tools/drosync/crates/cli/src/main.rs",
"line": 246,
"end_line": 264
},
{
"path": "tools/drosync/crates/cli/src/main.rs",
"line": 399,
"end_line": 481
}
],
"tag": "唯一操作入口"
},
{
"id": "daemon",
"type": "backend",
"label": "Rust Daemon",
"sublabel": "扫描·调度·上传·本地恢复",
"pos": [
440,
400
],
"size": [
240,
100
],
"sources": [
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 270,
"end_line": 318
},
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 719,
"end_line": 750
},
{
"path": "tools/drosync/crates/daemon/src/clean_service.rs",
"line": 67,
"end_line": 105
}
]
},
{
"id": "bos",
"type": "cloud",
"label": "BOS 对象存储",
"sublabel": "暂存·正式对象·发布·审计",
"pos": [
850,
400
],
"size": [
260,
115
],
"sources": [
{
"path": "internal/objectsync/coordinator.go",
"line": 813,
"end_line": 927
},
{
"path": "internal/api/object_storage_browser.go",
"line": 1316,
"end_line": 1358
},
{
"path": "internal/api/object_sync.go",
"line": 500,
"end_line": 516
}
],
"tag": "同桶权限可导致可见范围重叠"
},
{
"id": "job",
"type": "backend",
"label": "Kubernetes 算子 Job",
"sublabel": "Runner 或自定义容器",
"pos": [
1280,
400
],
"size": [
240,
100
],
"sources": [
{
"path": "internal/worker/executor.go",
"line": 841,
"end_line": 875
},
{
"path": "internal/k8s/launcher.go",
"line": 1372,
"end_line": 1408
},
{
"path": "internal/k8s/launcher.go",
"line": 568,
"end_line": 655
}
],
"tag": "CPU / GPU 调度"
},
{
"id": "files",
"type": "external",
"label": "采集源文件",
"sublabel": "本机目录·稳定文件扫描",
"pos": [
40,
740
],
"size": [
230,
100
],
"sources": [
{
"path": "tools/drosync/crates/core/src/lib.rs",
"line": 570,
"end_line": 696
}
]
},
{
"id": "sqlite",
"type": "database",
"label": "SQLite 本机状态",
"sublabel": "回执·检查点·文件进度",
"pos": [
440,
740
],
"size": [
240,
100
],
"sources": [
{
"path": "tools/drosync/crates/state/src/lib.rs",
"line": 66,
"end_line": 107
},
{
"path": "tools/drosync/crates/state/src/lib.rs",
"line": 609,
"end_line": 705
},
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 37,
"end_line": 74
}
]
},
{
"id": "coordinator",
"type": "backend",
"label": "Go Drosync 协调器",
"sublabel": "规划·提交·对账·清理",
"pos": [
850,
740
],
"size": [
260,
100
],
"sources": [
{
"path": "cmd/drosync-coordinator/main.go",
"line": 57,
"end_line": 95
},
{
"path": "internal/objectsync/coordinator.go",
"line": 775,
"end_line": 930
}
],
"tag": "租约与条件发布"
},
{
"id": "workspace",
"type": "database",
"label": "共享工作区 PVC",
"sublabel": "输入·结果·算子代码",
"pos": [
1280,
740
],
"size": [
240,
100
],
"sources": [
{
"path": "internal/worker/executor.go",
"line": 431,
"end_line": 468
},
{
"path": "internal/worker/executor.go",
"line": 694,
"end_line": 755
},
{
"path": "internal/k8s/launcher.go",
"line": 568,
"end_line": 700
}
]
}
],
"connections": [
{
"id": "web-api",
"from": "web",
"to": "api",
"label": "登录 / HTTP",
"variant": "default"
},
{
"id": "api-mongo",
"from": "api",
"to": "mongo",
"label": "业务状态",
"variant": "default"
},
{
"id": "worker-mongo",
"from": "worker",
"to": "mongo",
"label": "轮询 / 更新",
"variant": "default"
},
{
"id": "worker-job",
"from": "worker",
"to": "job",
"label": "创建 Job",
"variant": "default"
},
{
"id": "job-workspace",
"from": "job",
"to": "workspace",
"label": "挂载 PVC",
"variant": "default"
},
{
"id": "worker-workspace",
"from": "worker",
"to": "workspace",
"label": "写输入 / 读结果",
"variant": "default"
},
{
"id": "cli-daemon",
"from": "cli",
"to": "daemon",
"label": "本机 IPC",
"variant": "default"
},
{
"id": "files-daemon",
"from": "files",
"to": "daemon",
"label": "扫描 / 读取",
"variant": "default"
},
{
"id": "daemon-sqlite",
"from": "daemon",
"to": "sqlite",
"label": "持久化状态",
"variant": "default"
},
{
"id": "daemon-api",
"from": "daemon",
"to": "api",
"label": "设备凭据 / 元信息",
"variant": "security"
},
{
"id": "daemon-bos",
"from": "daemon",
"to": "bos",
"label": "预签名 PUT",
"variant": "emphasis"
},
{
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"variant": "default"
},
{
"id": "coordinator-bos",
"from": "coordinator",
"to": "bos",
"label": "校验 / 条件发布",
"variant": "default"
},
{
"id": "api-bos",
"from": "api",
"to": "bos",
"label": "浏览:前缀范围未隔离",
"variant": "security"
},
{
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"variant": "dashed"
},
{
"id": "worker-bos",
"from": "worker",
"to": "bos",
"label": "产物策略:BOS 落盘",
"variant": "dashed"
}
],
"boundaries": [
{
"kind": "region",
"label": "采集机 · 本地上传服务",
"wraps": [
"cli",
"daemon",
"files",
"sqlite"
],
"pad": 28
},
{
"kind": "region",
"label": "工作流执行与持久工作区",
"wraps": [
"job",
"workspace"
],
"pad": 28
}
],
"cards": [
{
"dot": "cyan",
"title": "两条主线",
"items": [
"业务:Web → API → MongoDB;Worker 轮询任务并创建算子 Job。",
"上传:CLI → daemon → API 获取授权;文件字节直接 PUT 到 BOS,协调器确认正式提交。"
]
},
{
"dot": "rose",
"title": "组织与存储的实际边界",
"items": [
"API 按组织过滤连接、Space 和 Session;连接记录隔离不等于底层对象隔离。",
"普通存储浏览未限定组织路径;工作流浏览还存在 bucket 绑定及 sourcePath 归属校验缺口。",
"两个组织的凭据若均可访问同一 bucket,仍可能看到相同对象;预签名 GET 在有效期内直接访问 BOS。"
]
},
{
"dot": "amber",
"title": "需求实现与现场交付",
"items": [
"七项每日上传需求已有代码及测试证据:配置、命令、并发、缺失跳过、清理、日志、逐文件进度。",
"客户端 1.0.14 / 候选服务端 1.0.13 的隔离真实 BOS 验收通过;POC 业务切换和采集机升级尚未完成。",
"本图固定于 poc 源码 798aabe1,描述代码架构,不表示新候选已在业务环境运行。"
]
}
]
}

View File

@ -0,0 +1,539 @@
{
"schema_version": 1,
"diagram_type": "architecture",
"meta": {
"title": "DroboticFlow 系统架构与存储边界",
"locale": "zh-CN",
"output": ".archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"quality_profile": "showcase",
"repository": {
"url": "git@gitea.d-robotics.cc:longtao.wu/droboticflow.git",
"revision": "798aabe101f34c30e160f1771c474c90fc9c06e4",
"link_mode": "local-only"
}
},
"components": [
{
"id": "web",
"type": "frontend",
"label": "Web 业务界面",
"sublabel": "工作流·审核·存储",
"pos": [
40,
70
],
"size": [
230,
100
],
"sources": [
{
"path": "src/services/api/client.ts",
"line": 67,
"end_line": 105
},
{
"path": "internal/api/auth.go",
"line": 288,
"end_line": 316
},
{
"path": "internal/api/object_storage_browser.go",
"line": 2090,
"end_line": 2124
}
],
"tag": "登录与角色权限"
},
{
"id": "api",
"type": "backend",
"label": "Go API 控制面",
"sublabel": "业务管理·设备与上传授权",
"pos": [
440,
70
],
"size": [
240,
100
],
"sources": [
{
"path": "cmd/api/main.go",
"line": 83,
"end_line": 132
},
{
"path": "internal/api/object_sync.go",
"line": 2180,
"end_line": 2255
},
{
"path": "internal/api/object_storage_browser.go",
"line": 1194,
"end_line": 1224
}
],
"tag": "连接按组织校验"
},
{
"id": "mongo",
"type": "database",
"label": "MongoDB 控制状态",
"sublabel": "任务·Session·租约·审计",
"pos": [
850,
70
],
"size": [
260,
100
],
"sources": [
{
"path": "internal/store/object_sync.go",
"line": 884,
"end_line": 914
},
{
"path": "internal/store/mongo.go",
"line": 646,
"end_line": 684
},
{
"path": "internal/store/mongo.go",
"line": 1162,
"end_line": 1240
}
]
},
{
"id": "worker",
"type": "backend",
"label": "Go Worker 调度",
"sublabel": "轮询任务·维护运行状态",
"pos": [
1280,
70
],
"size": [
240,
100
],
"sources": [
{
"path": "cmd/worker/main.go",
"line": 79,
"end_line": 119
},
{
"path": "internal/worker/runtime.go",
"line": 432,
"end_line": 452
},
{
"path": "internal/worker/artifact_storage.go",
"line": 229,
"end_line": 320
}
]
},
{
"id": "cli",
"type": "frontend",
"label": "Drosync CLI",
"sublabel": "auth / mapping / sync / clean",
"pos": [
40,
400
],
"size": [
230,
100
],
"sources": [
{
"path": "tools/drosync/crates/cli/src/main.rs",
"line": 246,
"end_line": 264
},
{
"path": "tools/drosync/crates/cli/src/main.rs",
"line": 399,
"end_line": 481
}
],
"tag": "唯一操作入口"
},
{
"id": "daemon",
"type": "backend",
"label": "Rust Daemon",
"sublabel": "扫描·调度·上传·本地恢复",
"pos": [
440,
400
],
"size": [
240,
100
],
"sources": [
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 270,
"end_line": 318
},
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 719,
"end_line": 750
},
{
"path": "tools/drosync/crates/daemon/src/clean_service.rs",
"line": 67,
"end_line": 105
}
]
},
{
"id": "bos",
"type": "cloud",
"label": "BOS 对象存储",
"sublabel": "暂存·正式对象·发布·审计",
"pos": [
850,
400
],
"size": [
260,
115
],
"sources": [
{
"path": "internal/objectsync/coordinator.go",
"line": 813,
"end_line": 927
},
{
"path": "internal/api/object_storage_browser.go",
"line": 1316,
"end_line": 1358
},
{
"path": "internal/api/object_sync.go",
"line": 500,
"end_line": 516
}
],
"tag": "同桶权限可导致可见范围重叠"
},
{
"id": "job",
"type": "backend",
"label": "Kubernetes 算子 Job",
"sublabel": "Runner 或自定义容器",
"pos": [
1280,
400
],
"size": [
240,
100
],
"sources": [
{
"path": "internal/worker/executor.go",
"line": 841,
"end_line": 875
},
{
"path": "internal/k8s/launcher.go",
"line": 1372,
"end_line": 1408
},
{
"path": "internal/k8s/launcher.go",
"line": 568,
"end_line": 655
}
],
"tag": "CPU / GPU 调度"
},
{
"id": "files",
"type": "external",
"label": "采集源文件",
"sublabel": "本机目录·稳定文件扫描",
"pos": [
40,
740
],
"size": [
230,
100
],
"sources": [
{
"path": "tools/drosync/crates/core/src/lib.rs",
"line": 570,
"end_line": 696
}
]
},
{
"id": "sqlite",
"type": "database",
"label": "SQLite 本机状态",
"sublabel": "回执·检查点·文件进度",
"pos": [
440,
740
],
"size": [
240,
100
],
"sources": [
{
"path": "tools/drosync/crates/state/src/lib.rs",
"line": 66,
"end_line": 107
},
{
"path": "tools/drosync/crates/state/src/lib.rs",
"line": 609,
"end_line": 705
},
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 37,
"end_line": 74
}
]
},
{
"id": "coordinator",
"type": "backend",
"label": "Go Drosync 协调器",
"sublabel": "规划·提交·对账·清理",
"pos": [
850,
740
],
"size": [
260,
100
],
"sources": [
{
"path": "cmd/drosync-coordinator/main.go",
"line": 57,
"end_line": 95
},
{
"path": "internal/objectsync/coordinator.go",
"line": 775,
"end_line": 930
}
],
"tag": "租约与条件发布"
},
{
"id": "workspace",
"type": "database",
"label": "共享工作区 PVC",
"sublabel": "输入·结果·算子代码",
"pos": [
1280,
740
],
"size": [
240,
100
],
"sources": [
{
"path": "internal/worker/executor.go",
"line": 431,
"end_line": 468
},
{
"path": "internal/worker/executor.go",
"line": 694,
"end_line": 755
},
{
"path": "internal/k8s/launcher.go",
"line": 568,
"end_line": 700
}
]
}
],
"connections": [
{
"id": "web-api",
"from": "web",
"to": "api",
"label": "登录 / HTTP",
"variant": "default"
},
{
"id": "api-mongo",
"from": "api",
"to": "mongo",
"label": "业务状态",
"variant": "default"
},
{
"id": "worker-mongo",
"from": "worker",
"to": "mongo",
"label": "轮询 / 更新",
"variant": "default"
},
{
"id": "worker-job",
"from": "worker",
"to": "job",
"label": "创建 Job",
"variant": "default"
},
{
"id": "job-workspace",
"from": "job",
"to": "workspace",
"label": "挂载 PVC",
"variant": "default"
},
{
"id": "worker-workspace",
"from": "worker",
"to": "workspace",
"label": "写输入 / 读结果",
"variant": "default"
},
{
"id": "cli-daemon",
"from": "cli",
"to": "daemon",
"label": "本机 IPC",
"variant": "default"
},
{
"id": "files-daemon",
"from": "files",
"to": "daemon",
"label": "扫描 / 读取",
"variant": "default"
},
{
"id": "daemon-sqlite",
"from": "daemon",
"to": "sqlite",
"label": "持久化状态",
"variant": "default"
},
{
"id": "daemon-api",
"from": "daemon",
"to": "api",
"label": "设备凭据 / 元信息",
"variant": "security"
},
{
"id": "daemon-bos",
"from": "daemon",
"to": "bos",
"label": "预签名 PUT",
"variant": "emphasis"
},
{
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"variant": "default"
},
{
"id": "coordinator-bos",
"from": "coordinator",
"to": "bos",
"label": "校验 / 条件发布",
"variant": "default"
},
{
"id": "api-bos",
"from": "api",
"to": "bos",
"label": "浏览:前缀范围未隔离",
"variant": "security"
},
{
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"variant": "dashed"
},
{
"id": "worker-bos",
"from": "worker",
"to": "bos",
"label": "产物策略:BOS 落盘",
"variant": "dashed"
}
],
"boundaries": [
{
"kind": "region",
"label": "采集机 · 本地上传服务",
"wraps": [
"cli",
"daemon",
"files",
"sqlite"
],
"pad": 28
},
{
"kind": "region",
"label": "工作流执行与持久工作区",
"wraps": [
"job",
"workspace"
],
"pad": 28
}
],
"cards": [
{
"dot": "cyan",
"title": "两条主线",
"items": [
"业务:Web → API → MongoDB;Worker 轮询任务并创建算子 Job。",
"上传:CLI → daemon → API 获取授权;文件字节直接 PUT 到 BOS,协调器确认正式提交。"
]
},
{
"dot": "rose",
"title": "组织与存储的实际边界",
"items": [
"API 按组织过滤连接、Space 和 Session;连接记录隔离不等于底层对象隔离。",
"普通存储浏览未限定组织路径;工作流浏览还存在 bucket 绑定及 sourcePath 归属校验缺口。",
"两个组织的凭据若均可访问同一 bucket,仍可能看到相同对象;预签名 GET 在有效期内直接访问 BOS。"
]
},
{
"dot": "amber",
"title": "需求实现与现场交付",
"items": [
"七项每日上传需求已有代码及测试证据:配置、命令、并发、缺失跳过、清理、日志、逐文件进度。",
"客户端 1.0.14 / 候选服务端 1.0.13 的隔离真实 BOS 验收通过;POC 业务切换和采集机升级尚未完成。",
"本图固定于 poc 源码 798aabe1,描述代码架构,不表示新候选已在业务环境运行。"
]
}
]
}

View File

@ -0,0 +1,721 @@
{
"schemaVersion": 1,
"ok": true,
"command": "browser-check",
"evidenceKind": "automated-browser",
"status": "pass",
"visualReview": "not-requested",
"provenance": "current",
"deliveryReceiptId": "bb780bee-355b-4237-bdbd-1f86791c9d2a",
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"state": {
"detail": "read",
"motion": "still"
},
"chrome": {
"status": "available",
"executable": "/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
},
"diagnostics": [],
"containment": {
"status": "pass",
"policy": "fit-or-reader-declared-readable-vertical-scroll",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"themeStates": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1600,
"height": 1000,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1920,
"height": 1080,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1440,
"height": 900,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
}
]
},
"readability": {
"status": "pass",
"minimumProjectedNodeTextPx": 6,
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"viewerChrome": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"captures": {
"status": "not-requested",
"screenshots": [],
"contactSheet": null
},
"sidecars": {
"receipt": "droboticflow-architecture.browser-check.json",
"files": []
}
}

View File

@ -0,0 +1,17 @@
{
"schemaVersion": 1,
"receiptId": "6fb4be46-e489-4474-aa02-50be096ecfa5",
"status": "current",
"command": "deliver",
"type": "architecture",
"input": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"output": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"specification": {
"sha256": "f03380112052a1ce6252e58ab6d63562188624844855c748aaf29cd244ae1919",
"bytes": 12002
},
"artifact": {
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
}
}

View File

@ -0,0 +1,243 @@
{
"schemaVersion": 1,
"ok": true,
"command": "finalize",
"status": "pass",
"type": "architecture",
"quality": "showcase",
"specification": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"sha256": "f03380112052a1ce6252e58ab6d63562188624844855c748aaf29cd244ae1919",
"bytes": 12002
},
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"gates": {
"validate": "pass",
"deliver": "pass",
"check": "pass",
"browser-check": "pass"
},
"diagnostics": [],
"diagnosticSummary": {
"total": 0,
"shown": 0,
"truncated": false
},
"evidence": {
"receipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.finalize.json",
"summaryReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.finalize-summary.json",
"browserCheckReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.browser-check.json"
},
"update": {
"status": "current",
"installedVersion": "3.0.1",
"availableVersion": "3.0.1",
"releaseNotes": null,
"checkedAt": "2026-10-09T12:28:15.117Z",
"source": "cache",
"noticeRequired": false,
"noticeText": null
},
"visualReview": "not-requested",
"durationMs": 6689,
"visualReviewRecommendation": {
"action": "inspect-route-readability",
"signals": {
"resolvedCrossovers": 5,
"routesOverSuggestedBends": 3,
"routesOverSuggestedStretch": 1
},
"reason": "Automated gates passed, but crossings or detours still need perceptual review before claiming visual quality.",
"affectedRoutes": {
"crossings": [
{
"left": {
"id": "daemon-api",
"from": "daemon",
"to": "api",
"label": "设备凭据 / 元信息",
"collectionIndex": 9,
"artifactIndex": 10
},
"right": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"point": [
560,
396
]
},
{
"left": {
"id": "daemon-bos",
"from": "daemon",
"to": "bos",
"label": "预签名 PUT",
"collectionIndex": 10,
"artifactIndex": 11
},
"right": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"point": [
847,
472.5499999999997
]
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "coordinator-bos",
"from": "coordinator",
"to": "bos",
"label": "校验 / 条件发布",
"collectionIndex": 12,
"artifactIndex": 13
},
"point": [
973,
608
],
"sharedNode": "coordinator"
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "api-bos",
"from": "api",
"to": "bos",
"label": "浏览:前缀范围未隔离",
"collectionIndex": 13,
"artifactIndex": 14
},
"point": [
847,
443.5
]
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"point": [
847,
457.5
]
}
],
"detours": [
{
"relationship": {
"id": "worker-workspace",
"from": "worker",
"to": "workspace",
"label": "写输入 / 读结果",
"collectionIndex": 5,
"artifactIndex": 6
},
"bends": 3,
"stretch": 1.065,
"directCorridorBlockers": [
{
"id": "job",
"label": "Kubernetes 算子 Job",
"box": [
1280,
400,
240,
100
]
}
]
},
{
"relationship": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"bends": 4,
"stretch": 1.461,
"directCorridorBlockers": [
{
"id": "bos",
"label": "BOS 对象存储",
"box": [
850,
400,
260,
115
]
}
]
},
{
"relationship": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"bends": 4,
"stretch": 1
}
],
"truncated": false
},
"hints": [
"daemon → api crosses web → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"daemon → bos crosses coordinator → mongo: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"coordinator → mongo and coordinator → bos cross next to coordinator: move node mongo or bos so the two reach coordinator from different sides (for example one level with it, one directly above or below it).",
"coordinator → mongo crosses api → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"coordinator → mongo crosses web → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"web → bos needs 4 bends: move node web or bos so they share a row or column with matching centers, or sit diagonally with a clear corner."
],
"repair": "Trace these relationships at the desktop viewport. For Architecture, use references/architecture-layout-repair.md: reflow a blocked main path or tangled connected scene, and repair an isolated defect locally only when the surrounding composition is accepted. Preserve all semantic content and user-fixed geometry. Rerun finalize once after the edit."
}
}

File diff suppressed because one or more lines are too long

View File

@ -0,0 +1,20 @@
{
"diagram_type": "architecture",
"output": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"specification_sha256": "f03380112052a1ce6252e58ab6d63562188624844855c748aaf29cd244ae1919",
"artifact_sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"validation": "showcase passed; 0 errors; 0 warnings",
"browser_evidence": "passed",
"visual_review": "passed",
"visual_review_scope": [
"1440x900 light/dark",
"2048x1320 light/dark"
],
"correction_rounds": 1,
"placement_review": "One placement attempt failed validation and was restored; final original geometry passed all automated gates.",
"observations": [
"No visible node or label clipping at inspected desktop viewports.",
"Five routed crossings use visible bridges; main upload and workflow paths remain traceable."
],
"update_notice_required": false
}

View File

@ -0,0 +1,224 @@
{
"schemaVersion": 1,
"ok": false,
"command": "finalize",
"status": "fail",
"type": "architecture",
"quality": "showcase",
"specification": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"sha256": "a89f40f81a32bda1f1e7f576766709568dd934e7def3becf5c8fe3e0221818d3",
"bytes": 12006
},
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"gates": {
"validate": "fail",
"deliver": "not-run",
"check": "not-run",
"browser-check": "not-run"
},
"failedStage": "validate",
"diagnostics": [
{
"code": "layout/constraint",
"severity": "error",
"message": "Component \"mongo\" falls outside the viewBox 1588x1268 — adjust pos/size or set a larger meta.viewBox.",
"subject": {
"diagramType": "architecture"
}
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"api-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 1,
"id": "api-mongo",
"from": "api",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
704,
-180
],
[
850,
-180
]
],
"points": [
[
680,
106
],
[
704,
106
],
[
704,
-180
],
[
850,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"worker-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 2,
"id": "worker-mongo",
"from": "worker",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
],
"points": [
[
1400,
400
],
[
1400,
273
],
[
1083,
273
],
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"coordinator-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 11,
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1195,
-180
],
[
1110,
-180
]
],
"points": [
[
1280,
113
],
[
1195,
113
],
[
1195,
-180
],
[
1110,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
}
],
"diagnosticSummary": {
"total": 4,
"shown": 4,
"truncated": false
},
"evidence": {
"receipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-2/droboticflow-architecture.finalize.json",
"summaryReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-2/droboticflow-architecture.finalize-summary.json"
},
"update": {
"status": "current",
"installedVersion": "3.0.1",
"availableVersion": "3.0.1",
"releaseNotes": null,
"checkedAt": "2026-10-09T12:28:15.117Z",
"source": "cache",
"noticeRequired": false,
"noticeText": null
},
"visualReview": "not-requested",
"durationMs": 345,
"nextAction": {
"action": "edit-in-place",
"candidate": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"constraint": "Preserve all semantics and user-fixed geometry. Use references/architecture-layout-repair.md to choose a local repair or connected-scene reflow; edit the existing candidate.",
"then": "finalize-once"
}
}

View File

@ -0,0 +1,433 @@
{
"schemaVersion": 1,
"ok": false,
"command": "finalize",
"status": "fail",
"type": "architecture",
"quality": "showcase",
"startedAt": "2026-10-10T07:10:44.685Z",
"specification": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"sha256": "a89f40f81a32bda1f1e7f576766709568dd934e7def3becf5c8fe3e0221818d3",
"bytes": 12006
},
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"stages": {
"validate": {
"status": "fail",
"exitCode": 1,
"durationMs": null,
"command": [
"/opt/homebrew/Cellar/node/26.7.0/bin/node",
"/Users/d-robotics/.codex/skills/archify/bin/archify.mjs",
"deliver",
"architecture",
"/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"--quality",
"showcase",
"--repo-root",
"/Users/d-robotics/temp/droboticflow",
"--json"
],
"receipt": {
"schemaVersion": 1,
"ok": false,
"command": "deliver",
"receiptId": "03b11a60-dc04-4aac-ac27-786e21143fd1",
"stage": "render",
"type": "architecture",
"input": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"output": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"error": "Architecture layout validation failed:\n- Component \"mongo\" falls outside the viewBox 1588x1268 — adjust pos/size or set a larger meta.viewBox.\n- Connection \"api-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.\n- Connection \"worker-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.\n- Connection \"coordinator-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"diagnostics": [
{
"code": "layout/constraint",
"severity": "error",
"message": "Component \"mongo\" falls outside the viewBox 1588x1268 — adjust pos/size or set a larger meta.viewBox.",
"subject": {
"diagramType": "architecture"
},
"evidence": {},
"supportedFixes": []
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"api-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 1,
"id": "api-mongo",
"from": "api",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
704,
-180
],
[
850,
-180
]
],
"points": [
[
680,
106
],
[
704,
106
],
[
704,
-180
],
[
850,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"worker-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 2,
"id": "worker-mongo",
"from": "worker",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
],
"points": [
[
1400,
400
],
[
1400,
273
],
[
1083,
273
],
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"coordinator-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 11,
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1195,
-180
],
[
1110,
-180
]
],
"points": [
[
1280,
113
],
[
1195,
113
],
[
1195,
-180
],
[
1110,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
}
],
"provenance": "failed",
"update": {
"status": "unavailable",
"installedVersion": null,
"availableVersion": null,
"releaseNotes": null,
"checkedAt": null,
"source": null,
"noticeRequired": false,
"noticeText": null,
"reason": "disabled"
}
},
"execution": "embedded-in-deliver"
},
"deliver": {
"status": "not-run",
"execution": "blocked-by-validate"
}
},
"diagnostics": [
{
"code": "layout/constraint",
"severity": "error",
"message": "Component \"mongo\" falls outside the viewBox 1588x1268 — adjust pos/size or set a larger meta.viewBox.",
"subject": {
"diagramType": "architecture"
},
"evidence": {},
"supportedFixes": []
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"api-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 1,
"id": "api-mongo",
"from": "api",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
704,
-180
],
[
850,
-180
]
],
"points": [
[
680,
106
],
[
704,
106
],
[
704,
-180
],
[
850,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"worker-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 2,
"id": "worker-mongo",
"from": "worker",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
],
"points": [
[
1400,
400
],
[
1400,
273
],
[
1083,
273
],
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"coordinator-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 11,
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1195,
-180
],
[
1110,
-180
]
],
"points": [
[
1280,
113
],
[
1195,
113
],
[
1195,
-180
],
[
1110,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
}
],
"evidence": {
"receipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-2/droboticflow-architecture.finalize.json",
"summaryReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-2/droboticflow-architecture.finalize-summary.json"
},
"visualReview": "not-requested",
"failedStage": "validate",
"finishedAt": "2026-10-10T07:10:45.030Z",
"durationMs": 345,
"update": {
"status": "current",
"installedVersion": "3.0.1",
"availableVersion": "3.0.1",
"releaseNotes": null,
"checkedAt": "2026-10-09T12:28:15.117Z",
"source": "cache",
"noticeRequired": false,
"noticeText": null
}
}

View File

@ -0,0 +1,722 @@
{
"schemaVersion": 1,
"ok": true,
"command": "browser-check",
"evidenceKind": "automated-browser",
"status": "pass",
"visualReview": "not-requested",
"provenance": "current",
"deliveryReceiptId": "6fb4be46-e489-4474-aa02-50be096ecfa5",
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"state": {
"detail": "read",
"motion": "still"
},
"chrome": {
"status": "available",
"executable": "/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
},
"diagnostics": [],
"containment": {
"status": "pass",
"policy": "fit-or-reader-declared-readable-vertical-scroll",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"themeStates": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1600,
"height": 1000,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1920,
"height": 1080,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1440,
"height": 900,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
}
]
},
"readability": {
"status": "pass",
"minimumProjectedNodeTextPx": 6,
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"viewerChrome": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"captures": {
"status": "not-requested",
"screenshots": [],
"contactSheet": null
},
"sidecars": {
"directory": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-3",
"receipt": "droboticflow-architecture.browser-check.json",
"files": []
}
}

View File

@ -0,0 +1,243 @@
{
"schemaVersion": 1,
"ok": true,
"command": "finalize",
"status": "pass",
"type": "architecture",
"quality": "showcase",
"specification": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"sha256": "f03380112052a1ce6252e58ab6d63562188624844855c748aaf29cd244ae1919",
"bytes": 12002
},
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"gates": {
"validate": "pass",
"deliver": "pass",
"check": "pass",
"browser-check": "pass"
},
"diagnostics": [],
"diagnosticSummary": {
"total": 0,
"shown": 0,
"truncated": false
},
"evidence": {
"receipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-3/droboticflow-architecture.finalize.json",
"summaryReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-3/droboticflow-architecture.finalize-summary.json",
"browserCheckReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-3/droboticflow-architecture.browser-check.json"
},
"update": {
"status": "current",
"installedVersion": "3.0.1",
"availableVersion": "3.0.1",
"releaseNotes": null,
"checkedAt": "2026-10-09T12:28:15.117Z",
"source": "cache",
"noticeRequired": false,
"noticeText": null
},
"visualReview": "not-requested",
"durationMs": 2572,
"visualReviewRecommendation": {
"action": "inspect-route-readability",
"signals": {
"resolvedCrossovers": 5,
"routesOverSuggestedBends": 3,
"routesOverSuggestedStretch": 1
},
"reason": "Automated gates passed, but crossings or detours still need perceptual review before claiming visual quality.",
"affectedRoutes": {
"crossings": [
{
"left": {
"id": "daemon-api",
"from": "daemon",
"to": "api",
"label": "设备凭据 / 元信息",
"collectionIndex": 9,
"artifactIndex": 10
},
"right": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"point": [
560,
396
]
},
{
"left": {
"id": "daemon-bos",
"from": "daemon",
"to": "bos",
"label": "预签名 PUT",
"collectionIndex": 10,
"artifactIndex": 11
},
"right": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"point": [
847,
472.5499999999997
]
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "coordinator-bos",
"from": "coordinator",
"to": "bos",
"label": "校验 / 条件发布",
"collectionIndex": 12,
"artifactIndex": 13
},
"point": [
973,
608
],
"sharedNode": "coordinator"
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "api-bos",
"from": "api",
"to": "bos",
"label": "浏览:前缀范围未隔离",
"collectionIndex": 13,
"artifactIndex": 14
},
"point": [
847,
443.5
]
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"point": [
847,
457.5
]
}
],
"detours": [
{
"relationship": {
"id": "worker-workspace",
"from": "worker",
"to": "workspace",
"label": "写输入 / 读结果",
"collectionIndex": 5,
"artifactIndex": 6
},
"bends": 3,
"stretch": 1.065,
"directCorridorBlockers": [
{
"id": "job",
"label": "Kubernetes 算子 Job",
"box": [
1280,
400,
240,
100
]
}
]
},
{
"relationship": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"bends": 4,
"stretch": 1.461,
"directCorridorBlockers": [
{
"id": "bos",
"label": "BOS 对象存储",
"box": [
850,
400,
260,
115
]
}
]
},
{
"relationship": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"bends": 4,
"stretch": 1
}
],
"truncated": false
},
"hints": [
"daemon → api crosses web → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"daemon → bos crosses coordinator → mongo: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"coordinator → mongo and coordinator → bos cross next to coordinator: move node mongo or bos so the two reach coordinator from different sides (for example one level with it, one directly above or below it).",
"coordinator → mongo crosses api → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"coordinator → mongo crosses web → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"web → bos needs 4 bends: move node web or bos so they share a row or column with matching centers, or sit diagonally with a clear corner."
],
"repair": "Trace these relationships at the desktop viewport. For Architecture, use references/architecture-layout-repair.md: reflow a blocked main path or tangled connected scene, and repair an isolated defect locally only when the surrounding composition is accepted. Preserve all semantic content and user-fixed geometry. Rerun finalize once after the edit."
}
}

View File

@ -0,0 +1,32 @@
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width,initial-scale=1">
<title>Archify automated browser evidence · droboticflow-architecture.html</title>
<style>
*{box-sizing:border-box}body{margin:0;padding:24px;background:#e9eef5;color:#172033;font:14px/1.5 ui-monospace,SFMono-Regular,Menlo,Consolas,monospace}header{max-width:1500px;margin:0 auto 18px}h1{margin:0 0 6px;font-size:20px}p{margin:0;color:#526176}.grid{max-width:1500px;margin:auto;display:grid;grid-template-columns:repeat(2,minmax(0,1fr));gap:18px}figure{margin:0;padding:10px;background:white;border:1px solid #c9d4e3;border-radius:12px;box-shadow:0 10px 30px rgba(15,23,42,.08)}img{display:block;width:100%;height:auto;border:1px solid #e2e8f0}figcaption{padding:9px 4px 2px;color:#526176}@media(max-width:900px){.grid{grid-template-columns:1fr}}
</style>
</head>
<body>
<header><h1>Automated browser evidence</h1><p>droboticflow-architecture.html · visual-check containment pass · perceptual visual review pending</p></header>
<main class="grid">
<figure>
<img src="droboticflow-architecture.visual-check.1440x900.light.png" alt="light 1440 by 900">
<figcaption><strong>LIGHT</strong> · 1440×900 · containment pass · readable vertical scroll</figcaption>
</figure>
<figure>
<img src="droboticflow-architecture.visual-check.1440x900.dark.png" alt="dark 1440 by 900">
<figcaption><strong>DARK</strong> · 1440×900 · containment pass · readable vertical scroll</figcaption>
</figure>
<figure>
<img src="droboticflow-architecture.visual-check.2048x1320.light.png" alt="light 2048 by 1320">
<figcaption><strong>LIGHT</strong> · 2048×1320 · containment pass</figcaption>
</figure>
<figure>
<img src="droboticflow-architecture.visual-check.2048x1320.dark.png" alt="dark 2048 by 1320">
<figcaption><strong>DARK</strong> · 2048×1320 · containment pass</figcaption>
</figure>
</main>
</body>
</html>

View File

@ -0,0 +1,962 @@
{
"schemaVersion": 1,
"ok": true,
"command": "visual-check",
"evidenceKind": "automated-browser",
"status": "pass",
"visualReview": "pending",
"provenance": "current",
"deliveryReceiptId": "6fb4be46-e489-4474-aa02-50be096ecfa5",
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"state": {
"detail": "read",
"motion": "still"
},
"chrome": {
"status": "available",
"executable": "/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
},
"diagnostics": [],
"containment": {
"status": "pass",
"policy": "fit-or-reader-declared-readable-vertical-scroll",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"themeStates": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1600,
"height": 1000,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1920,
"height": 1080,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1440,
"height": 900,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
}
]
},
"readability": {
"status": "pass",
"minimumProjectedNodeTextPx": 6,
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"viewerChrome": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"captures": {
"status": "pass",
"screenshots": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light",
"file": "droboticflow-architecture.visual-check.1440x900.light.png"
},
{
"width": 1440,
"height": 900,
"theme": "dark",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "dark",
"file": "droboticflow-architecture.visual-check.1440x900.dark.png"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light",
"file": "droboticflow-architecture.visual-check.2048x1320.light.png"
},
{
"width": 2048,
"height": 1320,
"theme": "dark",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "dark",
"file": "droboticflow-architecture.visual-check.2048x1320.dark.png"
}
],
"contactSheet": "droboticflow-architecture.visual-check.html"
},
"sidecars": {
"directory": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/visual-check",
"receipt": "droboticflow-architecture.visual-check.json",
"contactSheet": "droboticflow-architecture.visual-check.html",
"files": [
{
"sha256": "8acc344f4bb70c305f32f9cfd8b9cae7d8d8badc0d180b05aac940503c1ee0bf",
"bytes": 2050,
"file": "droboticflow-architecture.visual-check.html"
},
{
"sha256": "b72473121297f14c92dee4a72350191372c2b010526cbcc8ba1d6f4fd2ffba8b",
"bytes": 132949,
"file": "droboticflow-architecture.visual-check.1440x900.light.png"
},
{
"sha256": "1a882fcaced196e202121dae5445612df7c07baf5ac8b1aa4804ac1862a311c2",
"bytes": 144793,
"file": "droboticflow-architecture.visual-check.1440x900.dark.png"
},
{
"sha256": "17622bd574ab69f48b1cb6d2c57333f43a7b63e5e6007dd9f2488aaef9cbbedd",
"bytes": 196475,
"file": "droboticflow-architecture.visual-check.2048x1320.light.png"
},
{
"sha256": "e17e3bc1881068a3ea4ad8eba4e541e68912a81f08a8a03feb6184d495141439",
"bytes": 214176,
"file": "droboticflow-architecture.visual-check.2048x1320.dark.png"
}
]
}
}

View File

@ -0,0 +1,9 @@
# drosync 系统架构图
打开 `drosync.html`,支持源码引用、缩放、明暗主题和图片导出。
依据 poc 提交 `5d90885c5d817605a0b56a63de489ac6568c31d6` 的代码快照。展示客户端、SQLite、平台控制面、MongoDB、协调器和 BOS;不代表运行环境已发布这一提交。
`candidate.json` 保存可编辑规范。`drosync.finalize-summary.json` 记录 validate / deliver / check / browser-check 全部通过;visual-check 目录保存浏览器截图和测量证据。
实际检查了 1440×900 深色、2048×1320 浅色截图,主链路与文字未见遮挡。自动路由交叉数为 0。截图检查与运行环境验收是不同证据。

View File

@ -0,0 +1,313 @@
{
"schema_version": 1,
"diagram_type": "architecture",
"meta": {
"title": "drosync 系统架构 · poc 代码快照",
"locale": "zh-CN",
"output": ".archify/architecture-drosync-20261010-183011/drosync.html",
"quality_profile": "showcase",
"repository": {
"url": "git@gitea.d-robotics.cc:longtao.wu/droboticflow.git",
"revision": "5d90885c5d817605a0b56a63de489ac6568c31d6",
"link_mode": "local-only"
}
},
"components": [
{
"id": "console",
"type": "frontend",
"label": "CLI 与本地 Web",
"sublabel": "操作 / 日报 / 冲突警告",
"pos": [
40,
350
],
"size": [
230,
82
],
"sources": [
{
"path": "tools/drosync/crates/cli/src/main.rs",
"line": 45,
"end_line": 58
},
{
"path": "tools/drosync/crates/cli/src/report_service.rs",
"line": 12,
"end_line": 18
}
]
},
{
"id": "files",
"type": "external",
"label": "采集目录",
"sublabel": "稳定性检查 / SHA256",
"pos": [
400,
60
],
"size": [
230,
82
],
"sources": [
{
"path": "tools/drosync/crates/core/src/lib.rs",
"line": 430,
"end_line": 447
}
]
},
{
"id": "daemon",
"type": "backend",
"label": "drosync-daemon",
"sublabel": "调度 / 扫描 / 并发传输",
"pos": [
400,
350
],
"size": [
230,
82
],
"sources": [
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 1209,
"end_line": 1245
},
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 592,
"end_line": 614
}
]
},
{
"id": "sqlite",
"type": "database",
"label": "本地 SQLite",
"sublabel": "清单 / 缓存 / 回执 / 检查点",
"pos": [
40,
650
],
"size": [
230,
82
],
"sources": [
{
"path": "tools/drosync/crates/state/src/lib.rs",
"line": 245,
"end_line": 294
}
]
},
{
"id": "api",
"type": "backend",
"label": "平台 ObjectSync API",
"sublabel": "凭据鉴权 / 预签名 / 状态",
"pos": [
800,
350
],
"size": [
230,
82
],
"sources": [
{
"path": "internal/api/object_sync.go",
"line": 1831,
"end_line": 1848
},
{
"path": "internal/api/object_sync.go",
"line": 2190,
"end_line": 2210
},
{
"path": "internal/api/object_sync.go",
"line": 2630,
"end_line": 2662
}
]
},
{
"id": "bos",
"type": "cloud",
"label": "BOS 对象存储",
"sublabel": "暂存上传 → 正式归档",
"pos": [
400,
650
],
"size": [
230,
82
],
"sources": [
{
"path": "internal/api/object_sync.go",
"line": 2206
},
{
"path": "internal/objectsync/bos.go",
"line": 151,
"end_line": 185
}
]
},
{
"id": "coordinator",
"type": "backend",
"label": "ObjectSync 协调器",
"sublabel": "规划 / 租约 / 条件发布",
"pos": [
800,
650
],
"size": [
230,
82
],
"sources": [
{
"path": "internal/objectsync/coordinator.go",
"line": 645,
"end_line": 701
},
{
"path": "internal/objectsync/coordinator.go",
"line": 830,
"end_line": 880
}
]
},
{
"id": "mongo",
"type": "database",
"label": "平台 MongoDB",
"sublabel": "Session / Items / Heads / 租约",
"pos": [
1140,
650
],
"size": [
230,
82
],
"sources": [
{
"path": "internal/store/mongo.go",
"line": 80,
"end_line": 90
}
]
}
],
"connections": [
{
"id": "local-control",
"to": "daemon",
"label": "本地 IPC",
"variant": "default",
"from": "console"
},
{
"id": "local-report",
"to": "sqlite",
"label": "只读日报",
"variant": "default",
"from": "console"
},
{
"id": "scan",
"to": "daemon",
"label": "扫描与读取",
"variant": "default",
"from": "files"
},
{
"id": "checkpoint",
"to": "sqlite",
"label": "持久化",
"variant": "default",
"from": "daemon"
},
{
"id": "control",
"to": "api",
"label": "清单 / 预签名 / 提交",
"variant": "default",
"from": "daemon"
},
{
"id": "upload",
"to": "bos",
"label": "预签名 PUT / 分片",
"variant": "emphasis",
"from": "daemon"
},
{
"id": "api-state",
"to": "mongo",
"label": "状态读写",
"variant": "default",
"from": "api"
},
{
"id": "coord-state",
"to": "mongo",
"label": "认领 / 回执",
"variant": "default",
"from": "coordinator"
},
{
"id": "publication",
"to": "bos",
"label": "条件发布 / 核验",
"variant": "emphasis",
"from": "coordinator"
}
],
"cards": [
{
"dot": "cyan",
"title": "上传主路径",
"items": [
"本地扫描 → 分页清单 → 服务端规划 → 预签名上传暂存区 → 请求提交 → 协调器在 BOS 内复制发布。",
"文件字节直达 BOS;API 承担控制请求,不代理上传文件。"
]
},
{
"dot": "amber",
"title": "归档与冲突规则",
"items": [
"平台 objectSyncHeads 是正式提交清单;同 SHA256 与大小跳过,不检查已归档对象的远端变化。",
"同路径内容不同:规划拦截,页面警告;未登记同名对象也拦截。本地删除不联动云端删除。"
]
},
{
"dot": "emerald",
"title": "同步确认与恢复",
"items": [
"SQLite 保存 hash 缓存、传输分片和检查点;失败任务按阶段重试。",
"提交等待轮询进度摘要;终态恢复详细条目。本地清理仍独立核验云端证据。"
]
},
{
"dot": "slate",
"title": "范围与部署",
"items": [
"本图依据所标注 poc 提交的源码,不代表生产已部署同版本。",
"未展示标注、洗数等平台业务;BOS 内条件发布包含分片复制,仍有发布成本。"
]
}
]
}

View File

@ -0,0 +1,721 @@
{
"schemaVersion": 1,
"ok": true,
"command": "browser-check",
"evidenceKind": "automated-browser",
"status": "pass",
"visualReview": "not-requested",
"provenance": "current",
"deliveryReceiptId": "fd56d274-50cd-42fc-8548-14547f418478",
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.html",
"sha256": "55abf84d40c78f51e209b32a380f1b2810412aea9fced95cb79488d56fdd9b93",
"bytes": 762356
},
"state": {
"detail": "read",
"motion": "still"
},
"chrome": {
"status": "available",
"executable": "/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
},
"diagnostics": [],
"containment": {
"status": "pass",
"policy": "fit-or-reader-declared-readable-vertical-scroll",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"themeStates": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1600,
"height": 1000,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1920,
"height": 1080,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1440,
"height": 900,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
}
]
},
"readability": {
"status": "pass",
"minimumProjectedNodeTextPx": 6,
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"viewerChrome": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"captures": {
"status": "not-requested",
"screenshots": [],
"contactSheet": null
},
"sidecars": {
"receipt": "drosync.browser-check.json",
"files": []
}
}

View File

@ -0,0 +1,17 @@
{
"schemaVersion": 1,
"receiptId": "fd56d274-50cd-42fc-8548-14547f418478",
"status": "current",
"command": "deliver",
"type": "architecture",
"input": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/candidate.json",
"output": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.html",
"specification": {
"sha256": "02fcb55153ace833c7583923a1c589bc091c7af01d0f4fd3194f32051bf435ba",
"bytes": 7021
},
"artifact": {
"sha256": "55abf84d40c78f51e209b32a380f1b2810412aea9fced95cb79488d56fdd9b93",
"bytes": 762356
}
}

View File

@ -0,0 +1,47 @@
{
"schemaVersion": 1,
"ok": true,
"command": "finalize",
"status": "pass",
"type": "architecture",
"quality": "showcase",
"specification": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/candidate.json",
"sha256": "02fcb55153ace833c7583923a1c589bc091c7af01d0f4fd3194f32051bf435ba",
"bytes": 7021
},
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.html",
"sha256": "55abf84d40c78f51e209b32a380f1b2810412aea9fced95cb79488d56fdd9b93",
"bytes": 762356
},
"gates": {
"validate": "pass",
"deliver": "pass",
"check": "pass",
"browser-check": "pass"
},
"diagnostics": [],
"diagnosticSummary": {
"total": 0,
"shown": 0,
"truncated": false
},
"evidence": {
"receipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.finalize.json",
"summaryReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.finalize-summary.json",
"browserCheckReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.browser-check.json"
},
"update": {
"status": "current",
"installedVersion": "3.0.1",
"availableVersion": "3.0.1",
"releaseNotes": null,
"checkedAt": "2026-10-09T12:28:15.117Z",
"source": "cache",
"noticeRequired": false,
"noticeText": null
},
"visualReview": "not-requested",
"durationMs": 7687
}

File diff suppressed because it is too large Load Diff

File diff suppressed because one or more lines are too long

Binary file not shown.

After

Width:  |  Height:  |  Size: 96 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 90 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 152 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 142 KiB

View File

@ -0,0 +1,32 @@
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width,initial-scale=1">
<title>Archify automated browser evidence · drosync.html</title>
<style>
*{box-sizing:border-box}body{margin:0;padding:24px;background:#e9eef5;color:#172033;font:14px/1.5 ui-monospace,SFMono-Regular,Menlo,Consolas,monospace}header{max-width:1500px;margin:0 auto 18px}h1{margin:0 0 6px;font-size:20px}p{margin:0;color:#526176}.grid{max-width:1500px;margin:auto;display:grid;grid-template-columns:repeat(2,minmax(0,1fr));gap:18px}figure{margin:0;padding:10px;background:white;border:1px solid #c9d4e3;border-radius:12px;box-shadow:0 10px 30px rgba(15,23,42,.08)}img{display:block;width:100%;height:auto;border:1px solid #e2e8f0}figcaption{padding:9px 4px 2px;color:#526176}@media(max-width:900px){.grid{grid-template-columns:1fr}}
</style>
</head>
<body>
<header><h1>Automated browser evidence</h1><p>drosync.html · visual-check containment pass · perceptual visual review pending</p></header>
<main class="grid">
<figure>
<img src="drosync.visual-check.1440x900.light.png" alt="light 1440 by 900">
<figcaption><strong>LIGHT</strong> · 1440×900 · containment pass</figcaption>
</figure>
<figure>
<img src="drosync.visual-check.1440x900.dark.png" alt="dark 1440 by 900">
<figcaption><strong>DARK</strong> · 1440×900 · containment pass</figcaption>
</figure>
<figure>
<img src="drosync.visual-check.2048x1320.light.png" alt="light 2048 by 1320">
<figcaption><strong>LIGHT</strong> · 2048×1320 · containment pass</figcaption>
</figure>
<figure>
<img src="drosync.visual-check.2048x1320.dark.png" alt="dark 2048 by 1320">
<figcaption><strong>DARK</strong> · 2048×1320 · containment pass</figcaption>
</figure>
</main>
</body>
</html>

View File

@ -0,0 +1,962 @@
{
"schemaVersion": 1,
"ok": true,
"command": "visual-check",
"evidenceKind": "automated-browser",
"status": "pass",
"visualReview": "pending",
"provenance": "current",
"deliveryReceiptId": "fd56d274-50cd-42fc-8548-14547f418478",
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.html",
"sha256": "55abf84d40c78f51e209b32a380f1b2810412aea9fced95cb79488d56fdd9b93",
"bytes": 762356
},
"state": {
"detail": "read",
"motion": "still"
},
"chrome": {
"status": "available",
"executable": "/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
},
"diagnostics": [],
"containment": {
"status": "pass",
"policy": "fit-or-reader-declared-readable-vertical-scroll",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"themeStates": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1600,
"height": 1000,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1920,
"height": 1080,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1440,
"height": 900,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
}
]
},
"readability": {
"status": "pass",
"minimumProjectedNodeTextPx": 6,
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"viewerChrome": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"captures": {
"status": "pass",
"screenshots": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light",
"file": "drosync.visual-check.1440x900.light.png"
},
{
"width": 1440,
"height": 900,
"theme": "dark",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "dark",
"file": "drosync.visual-check.1440x900.dark.png"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light",
"file": "drosync.visual-check.2048x1320.light.png"
},
{
"width": 2048,
"height": 1320,
"theme": "dark",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "dark",
"file": "drosync.visual-check.2048x1320.dark.png"
}
],
"contactSheet": "drosync.visual-check.html"
},
"sidecars": {
"directory": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/visual-check",
"receipt": "drosync.visual-check.json",
"contactSheet": "drosync.visual-check.html",
"files": [
{
"sha256": "bfc4e7db7f78a7e5e98c94cc23510048466b13585e5931acad4cbdfe6b54734a",
"bytes": 1886,
"file": "drosync.visual-check.html"
},
{
"sha256": "8d82ab86f00bad7f9a7be98ef32edc1f0f6be680e3027cb9b7a8c18b693df214",
"bytes": 92353,
"file": "drosync.visual-check.1440x900.light.png"
},
{
"sha256": "c48872886e1d427c44690dd2ad978ff2e89efebc225c362c6b4c1e6145946d47",
"bytes": 98610,
"file": "drosync.visual-check.1440x900.dark.png"
},
{
"sha256": "f91e144d7bd0108bc9dfd71dfa8ae7e18afa4367512f5a1f36d49b5546a98a30",
"bytes": 145811,
"file": "drosync.visual-check.2048x1320.light.png"
},
{
"sha256": "27e8c1776edae8515e9a320ec1372b12684b4cf1b7b686b8efa8fc7ca26282d4",
"bytes": 155924,
"file": "drosync.visual-check.2048x1320.dark.png"
}
]
}
}

View File

@ -0,0 +1,25 @@
---
description: 跑 POC / drosync 验收链路
argument-hint: "[要做什么,例如 验收就绪检查]"
---
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
使用 `droflow-ops` 技能处理这个请求:$ARGUMENTS
本命令覆盖的动作:
- `accept.readiness`:验收就绪检查——检查验收前置条件与平台侧最新验收证据(只读)
- `accept.strict`:严格全量验收——就绪检查 + 算子工作流验收 + 结果导入,要求审核分支闭环(变更)
- `accept.operators`:算子全量验收——在集群里逐个跑内置算子的验收 Job(变更、可 dry-run)
- `accept.operator-workflows`:算子工作流验收——用固定验收工作流跑算子链路并核对产物(变更)
- `accept.gpu-capacity`:GPU 容量验收——从集群内调用 worker 容量接口,核对 GPU 可调度性(变更)
- `accept.gpu-workflow`:GPU 工作流验收——走 worker 路径跑一次 GPU 验收工作流(CPU-only 时期望失败证据)(变更)
- `accept.object-storage`:对象存储验收——校验对象存储浏览、上传与视频预览链路(变更)
- `accept.import-verify`:核对验收导入——核对最近一次验收结果是否已正确导入平台(只读)
- `accept.drosync-poc`:drosync POC 验收——用本机 drosync 跑上传、断点、分片与稳定性验收(变更)
- `accept.drosync-capacity`:drosync 容量验收——校验 drosync 在容量边界下的行为(变更)
- `accept.xplatform`:跨平台链路验收——从源数据到上传输出的跨平台全链路验收(变更)
先用 `go run ./cmd/droctl describe <动作>` 确认参数与 tier;变更类先 dry-run,需确认的动作先征得用户同意再加 `--yes`。
没有给出具体要求时,先跑本组的只读动作汇报现状。

View File

@ -0,0 +1,25 @@
---
description: 构建、部署、滚动重启或清理 POC 环境
argument-hint: "[要做什么,例如 构建推送 POC 镜像]"
---
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
使用 `droflow-ops` 技能处理这个请求:$ARGUMENTS
本命令覆盖的动作:
- `poc.images`:构建推送 POC 镜像——用集群内 Kaniko 从当前工作树构建 api/worker/runner 等镜像并推送到 dataflow-poc(变更、需确认)
- `poc.deploy`:部署 POC——渲染清单并滚动更新 droboticflow 命名空间(使用最近一次构建的镜像标签)(变更、需确认)
- `poc.api-image`:更新 POC API 镜像——只更新 API 镜像及镜像标记,保留 Worker、算子、配置与密钥(变更、需确认、可 dry-run)
- `poc.ship`:构建并部署 POC——依次构建推送镜像、部署、查看就绪度(变更、需确认)
- `poc.rollout-restart`:滚动重启——滚动重启 API 与 worker 并等待就绪(不换镜像)(变更、需确认、可 dry-run)
- `poc.manifests-validate`:校验 K8s 清单——用占位镜像渲染清单并做 kubectl client dry-run 校验(只读)
- `poc.cleanup-jobs`:清理算子 Job——删除超过保留时长的已完成/失败算子 Job(变更、需确认、可 dry-run)
- `poc.cleanup-artifacts`:清理运行时产物——清理 POC 工作区里超过保留时长的运行时产物(变更、需确认、可 dry-run)
- `poc.reconcile-data`:收敛系统数据——清理遗留演示数据,把内置算子目录收敛到当前 operator-runner 镜像(变更、需确认)
- `poc.configure-fixtures`:配置验收夹具——发现并写入 POC 验收所需的 SOURCE_PATH 等夹具配置(变更、需确认、可 dry-run)
- `poc.configure-environment`:初始化 POC 环境——创建命名空间、BOS 工作区 PVC 与凭据 Secret(变更、需确认)
先用 `go run ./cmd/droctl describe <动作>` 确认参数与 tier;变更类先 dry-run,需确认的动作先征得用户同意再加 `--yes`。
没有给出具体要求时,先跑本组的只读动作汇报现状。

View File

@ -0,0 +1,16 @@
---
description: 按常见故障模式做只读诊断
argument-hint: "[要做什么,例如 故障诊断]"
---
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
使用 `droflow-ops` 技能处理这个请求:$ARGUMENTS
本命令覆盖的动作:
- `diagnose.symptom`:故障诊断——针对一个已知故障模式收集只读证据(不做任何修改)(只读)
- `diagnose.run`:运行排障——拉取一次运行的详情与日志,定位失败节点(只读)
先用 `go run ./cmd/droctl describe <动作>` 确认参数与 tier;变更类先 dry-run,需确认的动作先征得用户同意再加 `--yes`。
没有给出具体要求时,先跑本组的只读动作汇报现状。

View File

@ -0,0 +1,27 @@
---
description: 项目、工作流、运行与审核的日常操作
argument-hint: "[要做什么,例如 项目列表]"
---
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
使用 `droflow-ops` 技能处理这个请求:$ARGUMENTS
本命令覆盖的动作:
- `platform.projects`:项目列表——列出本组织的项目(只读)
- `platform.workflows`:项目工作流——列出某个项目下的工作流(只读)
- `platform.workflow-runs`:工作流运行记录——列出某个工作流的历史运行(只读)
- `platform.workflow-run`:运行工作流——立即触发一次工作流运行(变更、需确认)
- `platform.runs`:运行列表——列出最近的运行(只读)
- `platform.run`:运行详情——查看一次运行的状态、节点与失败信息(只读)
- `platform.run-stop`:停止运行——请求优雅停止一次运行(变更、需确认)
- `platform.run-rerun`:重跑子树——从指定节点起重跑一次运行的下游子树(变更、需确认)
- `platform.audit-tasks`:待审核任务——列出人工审核队列(只读)
- `platform.audit-approve`:审核通过——通过一个审核任务,运行从通过分支继续(变更、需确认)
- `platform.audit-reject`:审核驳回——驳回一个审核任务,运行从驳回分支继续(变更、需确认)
- `platform.operators`:算子目录——列出平台可用算子(只读)
- `platform.worker-retry`:Worker 重试运行——让 worker 重新调度一次失败或卡住的运行(变更、需确认)
先用 `go run ./cmd/droctl describe <动作>` 确认参数与 tier;变更类先 dry-run,需确认的动作先征得用户同意再加 `--yes`。
没有给出具体要求时,先跑本组的只读动作汇报现状。

View File

@ -0,0 +1,34 @@
---
description: drosync 与内置算子的发版
argument-hint: "[要做什么,例如 drosync 测试]"
---
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
使用 `droflow-ops` 技能处理这个请求:$ARGUMENTS
本命令覆盖的动作:
- `drosync.test`:drosync 测试——运行 drosync workspace 全部测试(只读)
- `drosync.lint`:drosync 静态检查——cargo fmt --check 与 clippy -D warnings(只读)
- `drosync.contract-check`:drosync 协议契约校验——检查 Go/Rust 生成的协议常量与 OpenAPI 一致(只读)
- `drosync.build`:drosync 构建——cargo build --release(只读)
- `drosync.release-bump`:drosync 版本号 +1——把 tools/drosync/Cargo.toml 末位版本号 +1,刷新 Cargo.lock 并提交(变更、需确认)
- `drosync.release-build`:drosync 发版构建——在离线 Ubuntu 22.04 容器里构建、打包并校验当前提交(变更)
- `drosync.release-preflight`:drosync 发版预检——签名并检查 BOS 发布目标(不写 BOS)(只读)
- `drosync.release-publish`:drosync 发布到公网通道——发布便携包到公网通道并核对公开指针(对所有用户可见)(变更、需确认)
- `drosync.release`:drosync 完整发版——版本号 +1 → 构建 → 预检 → 发布(变更、需确认)
- `operators.check`:校验算子生成物——校验算子仓库、清单与镜像定义是否与目录一致(只读)
- `operators.repos-check`:校验算子仓库——检查 operator-repos 是否与目录一致(只读)
- `operators.manifests-check`:校验算子清单——检查算子仓库清单是否最新(只读)
- `operators.images-check`:校验算子镜像定义——检查 operator-images 是否最新(只读)
- `operators.generate`:重新生成算子产物——重新生成算子仓库、清单与镜像定义(写工作树)(变更)
- `operators.repos-generate`:生成算子仓库——重新生成 operator-repos(变更)
- `operators.manifests-generate`:生成算子清单——重新生成算子仓库清单(变更)
- `operators.images-generate`:生成算子镜像定义——重新生成 operator-images(变更)
- `operators.releases-record`:记录算子发布——把已推送算子镜像的 digest 写入 release.json 与内置目录(变更、需确认)
- `operators.digests-verify`:核对算子 digest——核对目录里钉住的算子镜像 digest 仍在 registry 中(只读)
- `operators.live-sync`:同步现网内置算子——对比并(apply 时)重新钉住现网内置算子镜像;13 个保留现网 pin 的内置算子不要传入(变更、需确认、可 dry-run)
先用 `go run ./cmd/droctl describe <动作>` 确认参数与 tier;变更类先 dry-run,需确认的动作先征得用户同意再加 `--yes`。
没有给出具体要求时,先跑本组的只读动作汇报现状。

View File

@ -0,0 +1,21 @@
---
description: 查看 droboticflow 平台、集群与验收门的当前状态
argument-hint: "[要做什么,例如 API 健康]"
---
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
使用 `droflow-ops` 技能处理这个请求:$ARGUMENTS
本命令覆盖的动作:
- `status.health`:API 健康——检查 API 进程与 MongoDB 就绪状态(只读)
- `status.poc-readiness`:POC 就绪度——汇总 POC 验收门(外部依赖、GPU、算子工作流证据)的最新结论(只读)
- `status.dashboard`:平台看板——项目、工作流、运行和审核任务的计数与最近动态(只读)
- `status.worker-capacity`:Worker 容量——集群可调度节点的 CPU/内存/GPU 余量(worker 视角)(只读)
- `status.worker-stats`:Worker 队列——运行队列深度、在途运行与租约状态(只读)
- `status.ai`:AI 服务状态——查看模型网关是否已配置,以及算子生成能力是否就绪(只读)
- `status.workloads`:集群工作负载——列出命名空间内的 Pod、Job、Service 与 PVC 状态(只读)
先用 `go run ./cmd/droctl describe <动作>` 确认参数与 tier;变更类先 dry-run,需确认的动作先征得用户同意再加 `--yes`。
没有给出具体要求时,先跑本组的只读动作汇报现状。

View File

@ -0,0 +1,20 @@
---
description: 提交前的 lint、测试与构建校验
argument-hint: "[要做什么,例如 Lint]"
---
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
使用 `droflow-ops` 技能处理这个请求:$ARGUMENTS
本命令覆盖的动作:
- `verify.lint`:Lint——前端 tsc、gofmt 与脚本语法检查(只读)
- `verify.go-test`:Go 测试——go test ./...(只读)
- `verify.python-test`:Python 测试——operator-runner 与后端 pytest(只读)
- `verify.frontend-test`:前端测试——node --test 前端单测(只读)
- `verify.ops-catalog`:能力目录一致性——检查能力目录与五份生成产物一致(只读)
- `verify.local`:完整本地校验——lint + 格式 + Go/Python/前端测试 + 构建 + 清单校验(只读)
先用 `go run ./cmd/droctl describe <动作>` 确认参数与 tier;变更类先 dry-run,需确认的动作先征得用户同意再加 `--yes`。
没有给出具体要求时,先跑本组的只读动作汇报现状。

View File

@ -0,0 +1,55 @@
---
name: droflow-ops
description: droboticflow 统一运维入口。部署/构建/滚动重启 POC、跑验收、故障诊断、drosync 与算子发版、项目/工作流/运行/审核操作、提交前校验时使用。所有动作都通过仓库里的 droctl 执行,不要自己拼脚本命令。
---
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
# droboticflow 运维入口
这个仓库的全部运维与平台动作都登记在能力目录 `ops/catalog/*.yaml` 里,并由 `droctl` 统一执行。
**始终通过 droctl 执行,不要直接调用 `scripts/` 下的脚本或 `npm run`**——droctl 会做前置检查
(分支、集群可达性、所需命令)、参数校验、dry-run 与确认闸门,和 CLI、产品内助手走同一条执行路径。
## 怎么用
```bash
go run ./cmd/droctl list # 全部动作(可加 --domain poc / --tier read)
go run ./cmd/droctl describe poc.rollout-restart
go run ./cmd/droctl run status.poc-readiness --surface claude --json
go run ./cmd/droctl run poc.cleanup-jobs --surface claude --dry-run
go run ./cmd/droctl run poc.cleanup-jobs --surface claude --yes
```
规则:
1. 先 `describe` 看清参数、tier、是否变更、runbook,再执行。
2. 变更类动作:能 dry-run 的先 `--dry-run` 跑一遍,把结果给用户看。
3. 标了「需确认」的动作(`confirm: true`)**必须先得到用户明确同意**,再加 `--yes` 执行;不要替用户确认。
4. `tier: admin` 的动作还需要 `DROCTL_ALLOW_ADMIN=1`,只在用户明确要求时设置。
5. 失败时读 `describe` 里的 runbook 与 failure_modes 对应文档段落,再按 `diagnose.symptom` 做只读诊断。
6. 先用只读动作确认现状,再动环境;结论要基于命令真实输出,不要推断成功。
7. 遵守 `AGENTS.md`:`poc` 分支只部署 POC 环境;发版前 drosync 版本号要 +1(`drosync.release` 已包含)。
平台类(`platform.*`、`status.*` 等 http 动作)需要 `DROBOTICFLOW_API_BASE_URL` 与
`DROBOTICFLOW_API_TOKEN`(或 `DROBOTICFLOW_ACCEPTANCE_EMAIL` / `DROBOTICFLOW_ACCEPTANCE_PASSWORD`)。
## 能力域
- **验收**(`accept`):POC 与 drosync 的验收链路(会在环境里创建验收运行或临时 Job) → [references/accept.md](references/accept.md)
- **故障诊断**(`diagnose`):按 docs/operations.md 的常见故障模式跑只读探针并给出结论 → [references/diagnose.md](references/diagnose.md)
- **drosync**(`drosync`):drosync 客户端的构建、测试与便携通道发版 → [references/drosync.md](references/drosync.md)
- **算子发布**(`operators`):内置算子仓库、清单、镜像与发布记录的生成、校验和同步 → [references/operators.md](references/operators.md)
- **平台业务**(`platform`):项目、工作流、运行、审核与算子的日常操作(走平台 API,沿用路由级角色校验) → [references/platform.md](references/platform.md)
- **POC 环境**(`poc`):POC 环境(命名空间 droboticflow)的构建、部署、清理与数据收敛 → [references/poc.md](references/poc.md)
- **状态总览**(`status`):只读查看平台、集群与验收门的当前状态 → [references/status.md](references/status.md)
- **本地校验**(`verify`):提交前的 lint、测试与构建校验 → [references/verify.md](references/verify.md)
## 权限分层
| tier | 含义 | 允许角色 |
|---|---|---|
| `read` | 只读 | admin、pipeline_engineer、data_operator、qa_reviewer、compliance_auditor |
| `operate` | 操作 | admin、pipeline_engineer、data_operator |
| `release` | 发布 | admin、pipeline_engineer |
| `admin` | 管理 | admin |

View File

@ -0,0 +1,131 @@
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
# 验收(`accept`)
POC 与 drosync 的验收链路(会在环境里创建验收运行或临时 Job)
| 动作 | 说明 | 权限 | 性质 | 参数 | 入口 |
|---|---|---|---|---|---|
| `accept.readiness`<br>验收就绪检查 | 检查验收前置条件与平台侧最新验收证据([runbook](../../../../docs/operations.md#acceptance-checks)) | 操作 | 只读 | `env`(poc/wjzh,默认 poc) | cli claude product |
| `accept.strict`<br>严格全量验收 | 就绪检查 + 算子工作流验收 + 结果导入,要求审核分支闭环([runbook](../../../../docs/poc-current-status.md#strict-poc-acceptance)) | 操作 | 变更 | `env`(poc,默认 poc) | cli claude product |
| `accept.operators`<br>算子全量验收 | 在集群里逐个跑内置算子的验收 Job | 操作 | 变更、可 dry-run | `env`(poc,默认 poc) | cli claude product |
| `accept.operator-workflows`<br>算子工作流验收 | 用固定验收工作流跑算子链路并核对产物 | 操作 | 变更 | `env`(poc,默认 poc) | cli claude product |
| `accept.gpu-capacity`<br>GPU 容量验收 | 从集群内调用 worker 容量接口,核对 GPU 可调度性([runbook](../../../../docs/operations.md#acceptance-checks)) | 操作 | 变更 | `env`(poc,默认 poc)<br>`expect_available`(bool,默认 false) | cli claude product |
| `accept.gpu-workflow`<br>GPU 工作流验收 | 走 worker 路径跑一次 GPU 验收工作流(CPU-only 时期望失败证据)([runbook](../../../../docs/operations.md#acceptance-checks)) | 操作 | 变更 | `env`(poc,默认 poc)<br>`expect_available`(bool,默认 false) | cli claude product |
| `accept.object-storage`<br>对象存储验收 | 校验对象存储浏览、上传与视频预览链路 | 操作 | 变更 | — | cli claude product |
| `accept.import-verify`<br>核对验收导入 | 核对最近一次验收结果是否已正确导入平台 | 操作 | 只读 | — | cli claude product |
| `accept.drosync-poc`<br>drosync POC 验收 | 用本机 drosync 跑上传、断点、分片与稳定性验收<br>不在产品内:需要本机 drosync 二进制与守护进程 | 操作 | 变更 | — | cli claude |
| `accept.drosync-capacity`<br>drosync 容量验收 | 校验 drosync 在容量边界下的行为<br>不在产品内:需要本机 drosync 二进制与守护进程 | 操作 | 变更 | — | cli claude |
| `accept.xplatform`<br>跨平台链路验收 | 从源数据到上传输出的跨平台全链路验收<br>不在产品内:依赖本机配置的数据源与存储连接参数 | 操作 | 变更 | — | cli claude |
### `accept.readiness` — 验收就绪检查
检查验收前置条件与平台侧最新验收证据
```bash
go run ./cmd/droctl run accept.readiness --surface claude
```
前置检查:`kube-reachable`
Runbook:`docs/operations.md#acceptance-checks`
### `accept.strict` — 严格全量验收
就绪检查 + 算子工作流验收 + 结果导入,要求审核分支闭环
```bash
go run ./cmd/droctl run accept.strict --surface claude
```
前置检查:`kube-reachable`
Runbook:`docs/poc-current-status.md#strict-poc-acceptance`
### `accept.operators` — 算子全量验收
在集群里逐个跑内置算子的验收 Job
```bash
go run ./cmd/droctl run accept.operators --surface claude
```
前置检查:`kube-reachable`
### `accept.operator-workflows` — 算子工作流验收
用固定验收工作流跑算子链路并核对产物
```bash
go run ./cmd/droctl run accept.operator-workflows --surface claude
```
前置检查:`kube-reachable`
### `accept.gpu-capacity` — GPU 容量验收
从集群内调用 worker 容量接口,核对 GPU 可调度性
```bash
go run ./cmd/droctl run accept.gpu-capacity --surface claude
```
前置检查:`kube-reachable`
Runbook:`docs/operations.md#acceptance-checks`
### `accept.gpu-workflow` — GPU 工作流验收
走 worker 路径跑一次 GPU 验收工作流(CPU-only 时期望失败证据)
```bash
go run ./cmd/droctl run accept.gpu-workflow --surface claude
```
前置检查:`kube-reachable`
Runbook:`docs/operations.md#acceptance-checks`
### `accept.object-storage` — 对象存储验收
校验对象存储浏览、上传与视频预览链路
```bash
go run ./cmd/droctl run accept.object-storage --surface claude
```
### `accept.import-verify` — 核对验收导入
核对最近一次验收结果是否已正确导入平台
```bash
go run ./cmd/droctl run accept.import-verify --surface claude
```
### `accept.drosync-poc` — drosync POC 验收
用本机 drosync 跑上传、断点、分片与稳定性验收
```bash
go run ./cmd/droctl run accept.drosync-poc --surface claude
```
前置检查:`drosync`
### `accept.drosync-capacity` — drosync 容量验收
校验 drosync 在容量边界下的行为
```bash
go run ./cmd/droctl run accept.drosync-capacity --surface claude
```
前置检查:`drosync`
### `accept.xplatform` — 跨平台链路验收
从源数据到上传输出的跨平台全链路验收
```bash
go run ./cmd/droctl run accept.xplatform --surface claude
```

View File

@ -0,0 +1,32 @@
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
# 故障诊断(`diagnose`)
按 docs/operations.md 的常见故障模式跑只读探针并给出结论
| 动作 | 说明 | 权限 | 性质 | 参数 | 入口 |
|---|---|---|---|---|---|
| `diagnose.symptom`<br>故障诊断 | 针对一个已知故障模式收集只读证据(不做任何修改)([runbook](../../../../docs/operations.md#common-failure-modes)) | 操作 | 只读 | `symptom`(mongo/worker-jobs/missing-outputs/bosfs-errno107/image-pull/ui/all,默认 all)<br>`env`(poc/wjzh,默认 poc) | cli claude product |
| `diagnose.run`<br>运行排障 | 拉取一次运行的详情与日志,定位失败节点([runbook](../../../../docs/operations.md#run-lifecycle)) | 只读 | 只读 | `run_id`(string,必填) | cli claude product |
### `diagnose.symptom` — 故障诊断
针对一个已知故障模式收集只读证据(不做任何修改)
```bash
go run ./cmd/droctl run diagnose.symptom --surface claude
```
前置检查:`kubectl`
Runbook:`docs/operations.md#common-failure-modes`
### `diagnose.run` — 运行排障
拉取一次运行的详情与日志,定位失败节点
```bash
go run ./cmd/droctl run diagnose.run --arg run_id=<run_id> --surface claude
```
Runbook:`docs/operations.md#run-lifecycle`

View File

@ -0,0 +1,99 @@
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
# drosync(`drosync`)
drosync 客户端的构建、测试与便携通道发版
| 动作 | 说明 | 权限 | 性质 | 参数 | 入口 |
|---|---|---|---|---|---|
| `drosync.test`<br>drosync 测试 | 运行 drosync workspace 全部测试<br>不在产品内:Rust 工具链与签名密钥只在开发机上 | 只读 | 只读 | — | cli claude |
| `drosync.lint`<br>drosync 静态检查 | cargo fmt --check 与 clippy -D warnings<br>不在产品内:Rust 工具链与签名密钥只在开发机上 | 只读 | 只读 | — | cli claude |
| `drosync.contract-check`<br>drosync 协议契约校验 | 检查 Go/Rust 生成的协议常量与 OpenAPI 一致<br>不在产品内:Rust 工具链与签名密钥只在开发机上 | 只读 | 只读 | — | cli claude |
| `drosync.build`<br>drosync 构建 | cargo build --release<br>不在产品内:Rust 工具链与签名密钥只在开发机上 | 只读 | 只读 | — | cli claude |
| `drosync.release-bump`<br>drosync 版本号 +1 | 把 tools/drosync/Cargo.toml 末位版本号 +1,刷新 Cargo.lock 并提交<br>不在产品内:在本机工作树提交 | 发布 | 变更、需确认 | — | cli claude |
| `drosync.release-build`<br>drosync 发版构建 | 在离线 Ubuntu 22.04 容器里构建、打包并校验当前提交<br>不在产品内:需要本机 Docker(colima) | 发布 | 变更 | — | cli claude |
| `drosync.release-preflight`<br>drosync 发版预检 | 签名并检查 BOS 发布目标(不写 BOS)<br>不在产品内:签名密钥在本机钥匙串 | 发布 | 只读 | — | cli claude |
| `drosync.release-publish`<br>drosync 发布到公网通道 | 发布便携包到公网通道并核对公开指针(对所有用户可见)<br>不在产品内:签名密钥在本机钥匙串,BOS 凭据在本机 publish.py | 发布 | 变更、需确认 | — | cli claude |
| `drosync.release`<br>drosync 完整发版 | 版本号 +1 → 构建 → 预检 → 发布<br>不在产品内:全部步骤依赖本机 | 发布 | 变更、需确认 | — | cli claude |
### `drosync.test` — drosync 测试
运行 drosync workspace 全部测试
```bash
go run ./cmd/droctl run drosync.test --surface claude
```
### `drosync.lint` — drosync 静态检查
cargo fmt --check 与 clippy -D warnings
```bash
go run ./cmd/droctl run drosync.lint --surface claude
```
### `drosync.contract-check` — drosync 协议契约校验
检查 Go/Rust 生成的协议常量与 OpenAPI 一致
```bash
go run ./cmd/droctl run drosync.contract-check --surface claude
```
### `drosync.build` — drosync 构建
cargo build --release
```bash
go run ./cmd/droctl run drosync.build --surface claude
```
### `drosync.release-bump` — drosync 版本号 +1
把 tools/drosync/Cargo.toml 末位版本号 +1,刷新 Cargo.lock 并提交
```bash
go run ./cmd/droctl run drosync.release-bump --surface claude
```
前置检查:`branch-is-poc`
### `drosync.release-build` — drosync 发版构建
在离线 Ubuntu 22.04 容器里构建、打包并校验当前提交
```bash
go run ./cmd/droctl run drosync.release-build --surface claude
```
前置检查:`branch-is-poc`、`docker`
### `drosync.release-preflight` — drosync 发版预检
签名并检查 BOS 发布目标(不写 BOS)
```bash
go run ./cmd/droctl run drosync.release-preflight --surface claude
```
前置检查:`branch-is-poc`
### `drosync.release-publish` — drosync 发布到公网通道
发布便携包到公网通道并核对公开指针(对所有用户可见)
```bash
go run ./cmd/droctl run drosync.release-publish --surface claude
```
前置检查:`branch-is-poc`
### `drosync.release` — drosync 完整发版
版本号 +1 → 构建 → 预检 → 发布
```bash
go run ./cmd/droctl run drosync.release --surface claude
```
步骤:`drosync.release-bump` → `drosync.release-build` → `drosync.release-preflight` → `drosync.release-publish`

View File

@ -0,0 +1,111 @@
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
# 算子发布(`operators`)
内置算子仓库、清单、镜像与发布记录的生成、校验和同步
| 动作 | 说明 | 权限 | 性质 | 参数 | 入口 |
|---|---|---|---|---|---|
| `operators.check`<br>校验算子生成物 | 校验算子仓库、清单与镜像定义是否与目录一致<br>不在产品内:读写本机工作树中的算子生成物 | 只读 | 只读 | — | cli claude |
| `operators.repos-check`<br>校验算子仓库 | 检查 operator-repos 是否与目录一致<br>不在产品内:读写本机工作树中的算子生成物 | 只读 | 只读 | — | cli claude |
| `operators.manifests-check`<br>校验算子清单 | 检查算子仓库清单是否最新<br>不在产品内:读写本机工作树中的算子生成物 | 只读 | 只读 | — | cli claude |
| `operators.images-check`<br>校验算子镜像定义 | 检查 operator-images 是否最新<br>不在产品内:读写本机工作树中的算子生成物 | 只读 | 只读 | — | cli claude |
| `operators.generate`<br>重新生成算子产物 | 重新生成算子仓库、清单与镜像定义(写工作树)<br>不在产品内:读写本机工作树中的算子生成物 | 操作 | 变更 | — | cli claude |
| `operators.repos-generate`<br>生成算子仓库 | 重新生成 operator-repos<br>不在产品内:读写本机工作树中的算子生成物 | 操作 | 变更 | — | cli claude |
| `operators.manifests-generate`<br>生成算子清单 | 重新生成算子仓库清单<br>不在产品内:读写本机工作树中的算子生成物 | 操作 | 变更 | — | cli claude |
| `operators.images-generate`<br>生成算子镜像定义 | 重新生成 operator-images<br>不在产品内:读写本机工作树中的算子生成物 | 操作 | 变更 | — | cli claude |
| `operators.releases-record`<br>记录算子发布 | 把已推送算子镜像的 digest 写入 release.json 与内置目录<br>不在产品内:读写本机工作树中的算子生成物 | 发布 | 变更、需确认 | — | cli claude |
| `operators.digests-verify`<br>核对算子 digest | 核对目录里钉住的算子镜像 digest 仍在 registry 中<br>不在产品内:读写本机工作树中的算子生成物 | 只读 | 只读 | — | cli claude |
| `operators.live-sync`<br>同步现网内置算子 | 对比并(apply 时)重新钉住现网内置算子镜像;13 个保留现网 pin 的内置算子不要传入<br>不在产品内:读写本机工作树中的算子生成物 | 发布 | 变更、需确认、可 dry-run | `slugs`(list,必填) | cli claude |
### `operators.check` — 校验算子生成物
校验算子仓库、清单与镜像定义是否与目录一致
```bash
go run ./cmd/droctl run operators.check --surface claude
```
步骤:`operators.repos-check` → `operators.manifests-check` → `operators.images-check`
### `operators.repos-check` — 校验算子仓库
检查 operator-repos 是否与目录一致
```bash
go run ./cmd/droctl run operators.repos-check --surface claude
```
### `operators.manifests-check` — 校验算子清单
检查算子仓库清单是否最新
```bash
go run ./cmd/droctl run operators.manifests-check --surface claude
```
### `operators.images-check` — 校验算子镜像定义
检查 operator-images 是否最新
```bash
go run ./cmd/droctl run operators.images-check --surface claude
```
### `operators.generate` — 重新生成算子产物
重新生成算子仓库、清单与镜像定义(写工作树)
```bash
go run ./cmd/droctl run operators.generate --surface claude
```
步骤:`operators.repos-generate` → `operators.manifests-generate` → `operators.images-generate`
### `operators.repos-generate` — 生成算子仓库
重新生成 operator-repos
```bash
go run ./cmd/droctl run operators.repos-generate --surface claude
```
### `operators.manifests-generate` — 生成算子清单
重新生成算子仓库清单
```bash
go run ./cmd/droctl run operators.manifests-generate --surface claude
```
### `operators.images-generate` — 生成算子镜像定义
重新生成 operator-images
```bash
go run ./cmd/droctl run operators.images-generate --surface claude
```
### `operators.releases-record` — 记录算子发布
把已推送算子镜像的 digest 写入 release.json 与内置目录
```bash
go run ./cmd/droctl run operators.releases-record --surface claude
```
### `operators.digests-verify` — 核对算子 digest
核对目录里钉住的算子镜像 digest 仍在 registry 中
```bash
go run ./cmd/droctl run operators.digests-verify --surface claude
```
### `operators.live-sync` — 同步现网内置算子
对比并(apply 时)重新钉住现网内置算子镜像;13 个保留现网 pin 的内置算子不要传入
```bash
go run ./cmd/droctl run operators.live-sync --arg slugs=<slugs> --surface claude
```

View File

@ -0,0 +1,127 @@
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
# 平台业务(`platform`)
项目、工作流、运行、审核与算子的日常操作(走平台 API,沿用路由级角色校验)
| 动作 | 说明 | 权限 | 性质 | 参数 | 入口 |
|---|---|---|---|---|---|
| `platform.projects`<br>项目列表 | 列出本组织的项目 | 只读 | 只读 | — | cli claude product |
| `platform.workflows`<br>项目工作流 | 列出某个项目下的工作流 | 只读 | 只读 | `project_id`(string,必填) | cli claude product |
| `platform.workflow-runs`<br>工作流运行记录 | 列出某个工作流的历史运行 | 只读 | 只读 | `workflow_id`(string,必填) | cli claude product |
| `platform.workflow-run`<br>运行工作流 | 立即触发一次工作流运行([runbook](../../../../docs/operations.md#run-lifecycle)) | 操作 | 变更、需确认 | `workflow_id`(string,必填) | cli claude product |
| `platform.runs`<br>运行列表 | 列出最近的运行 | 只读 | 只读 | — | cli claude product |
| `platform.run`<br>运行详情 | 查看一次运行的状态、节点与失败信息 | 只读 | 只读 | `run_id`(string,必填) | cli claude product |
| `platform.run-stop`<br>停止运行 | 请求优雅停止一次运行 | 操作 | 变更、需确认 | `run_id`(string,必填) | cli claude product |
| `platform.run-rerun`<br>重跑子树 | 从指定节点起重跑一次运行的下游子树 | 操作 | 变更、需确认 | `run_id`(string,必填)<br>`node_id`(string,必填) | cli claude product |
| `platform.audit-tasks`<br>待审核任务 | 列出人工审核队列 | admin、qa_reviewer、compliance_auditor | 只读 | — | cli claude product |
| `platform.audit-approve`<br>审核通过 | 通过一个审核任务,运行从通过分支继续 | admin、qa_reviewer、compliance_auditor | 变更、需确认 | `task_id`(string,必填) | cli claude product |
| `platform.audit-reject`<br>审核驳回 | 驳回一个审核任务,运行从驳回分支继续 | admin、qa_reviewer、compliance_auditor | 变更、需确认 | `task_id`(string,必填) | cli claude product |
| `platform.operators`<br>算子目录 | 列出平台可用算子 | 只读 | 只读 | — | cli claude product |
| `platform.worker-retry`<br>Worker 重试运行 | 让 worker 重新调度一次失败或卡住的运行 | 操作 | 变更、需确认 | `run_id`(string,必填) | cli claude product |
### `platform.projects` — 项目列表
列出本组织的项目
```bash
go run ./cmd/droctl run platform.projects --surface claude
```
### `platform.workflows` — 项目工作流
列出某个项目下的工作流
```bash
go run ./cmd/droctl run platform.workflows --arg project_id=<project_id> --surface claude
```
### `platform.workflow-runs` — 工作流运行记录
列出某个工作流的历史运行
```bash
go run ./cmd/droctl run platform.workflow-runs --arg workflow_id=<workflow_id> --surface claude
```
### `platform.workflow-run` — 运行工作流
立即触发一次工作流运行
```bash
go run ./cmd/droctl run platform.workflow-run --arg workflow_id=<workflow_id> --surface claude
```
Runbook:`docs/operations.md#run-lifecycle`
### `platform.runs` — 运行列表
列出最近的运行
```bash
go run ./cmd/droctl run platform.runs --surface claude
```
### `platform.run` — 运行详情
查看一次运行的状态、节点与失败信息
```bash
go run ./cmd/droctl run platform.run --arg run_id=<run_id> --surface claude
```
### `platform.run-stop` — 停止运行
请求优雅停止一次运行
```bash
go run ./cmd/droctl run platform.run-stop --arg run_id=<run_id> --surface claude
```
### `platform.run-rerun` — 重跑子树
从指定节点起重跑一次运行的下游子树
```bash
go run ./cmd/droctl run platform.run-rerun --arg run_id=<run_id> --arg node_id=<node_id> --surface claude
```
### `platform.audit-tasks` — 待审核任务
列出人工审核队列
```bash
go run ./cmd/droctl run platform.audit-tasks --surface claude
```
### `platform.audit-approve` — 审核通过
通过一个审核任务,运行从通过分支继续
```bash
go run ./cmd/droctl run platform.audit-approve --arg task_id=<task_id> --surface claude
```
### `platform.audit-reject` — 审核驳回
驳回一个审核任务,运行从驳回分支继续
```bash
go run ./cmd/droctl run platform.audit-reject --arg task_id=<task_id> --surface claude
```
### `platform.operators` — 算子目录
列出平台可用算子
```bash
go run ./cmd/droctl run platform.operators --surface claude
```
### `platform.worker-retry` — Worker 重试运行
让 worker 重新调度一次失败或卡住的运行
```bash
go run ./cmd/droctl run platform.worker-retry --arg run_id=<run_id> --surface claude
```

View File

@ -0,0 +1,145 @@
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
# POC 环境(`poc`)
POC 环境(命名空间 droboticflow)的构建、部署、清理与数据收敛
| 动作 | 说明 | 权限 | 性质 | 参数 | 入口 |
|---|---|---|---|---|---|
| `poc.images`<br>构建推送 POC 镜像 | 用集群内 Kaniko 从当前工作树构建 api/worker/runner 等镜像并推送到 dataflow-poc([runbook](../../../../docs/deployment.md#2-build-and-push-images))<br>不在产品内:构建上下文是本机工作树,产品侧没有你的未发布代码;产品里请用 poc.rollout-restart | 发布 | 变更、需确认 | `env`(poc,默认 poc)<br>`build_operators`(bool,默认 false) | cli claude |
| `poc.deploy`<br>部署 POC | 渲染清单并滚动更新 droboticflow 命名空间(使用最近一次构建的镜像标签)([runbook](../../../../docs/deployment.md#4-deploy))<br>不在产品内:需要本机 registry 凭据与最近一次构建产出的镜像标签;产品里请用 poc.rollout-restart | 发布 | 变更、需确认 | `env`(poc,默认 poc) | cli claude |
| `poc.api-image`<br>更新 POC API 镜像 | 只更新 API 镜像及镜像标记,保留 Worker、算子、配置与密钥([runbook](../../../../docs/deployment.md#api-only-poc-rollout))<br>不在产品内:由本机核对新构建的镜像摘要后执行 | 发布 | 变更、需确认、可 dry-run | `env`(poc,默认 poc)<br>`image`(string,必填) | cli claude |
| `poc.ship`<br>构建并部署 POC | 依次构建推送镜像、部署、查看就绪度([runbook](../../../../docs/deployment.md))<br>不在产品内:包含 poc.images,依赖本机工作树 | 发布 | 变更、需确认 | — | cli claude |
| `poc.rollout-restart`<br>滚动重启 | 滚动重启 API 与 worker 并等待就绪(不换镜像)([runbook](../../../../docs/operations.md#kubernetes-verification)) | 发布 | 变更、需确认、可 dry-run | `env`(poc/wjzh,默认 poc)<br>`target`(all/api/worker,默认 all) | cli claude product |
| `poc.manifests-validate`<br>校验 K8s 清单 | 用占位镜像渲染清单并做 kubectl client dry-run 校验([runbook](../../../../docs/deployment.md#6-manifest-variables))<br>不在产品内:依赖本机 node_modules 与工作树 | 只读 | 只读 | — | cli claude |
| `poc.cleanup-jobs`<br>清理算子 Job | 删除超过保留时长的已完成/失败算子 Job([runbook](../../../../docs/operations.md#job-retention)) | 操作 | 变更、需确认、可 dry-run | `env`(poc/wjzh,默认 poc)<br>`min_age_seconds`(int,默认 86400) | cli claude product |
| `poc.cleanup-artifacts`<br>清理运行时产物 | 清理 POC 工作区里超过保留时长的运行时产物 | 操作 | 变更、需确认、可 dry-run | `min_age_hours`(int,默认 24) | cli claude product |
| `poc.reconcile-data`<br>收敛系统数据 | 清理遗留演示数据,把内置算子目录收敛到当前 operator-runner 镜像([runbook](../../../../docs/operations.md#old-demo-data-still-appears-after-an-upgrade)) | 管理 | 变更、需确认 | `env`(poc/wjzh,默认 poc) | cli claude product |
| `poc.configure-fixtures`<br>配置验收夹具 | 发现并写入 POC 验收所需的 SOURCE_PATH 等夹具配置<br>不在产品内:脚本要 kubectl exec 进 API Pod 写夹具,集群内执行器不授予 pods/exec | 操作 | 变更、需确认、可 dry-run | `env`(poc,默认 poc) | cli claude |
| `poc.configure-environment`<br>初始化 POC 环境 | 创建命名空间、BOS 工作区 PVC 与凭据 Secret([runbook](../../../../docs/deployment.md#3-prepare-kubernetes-access))<br>不在产品内:需要本机的 BOS AK/SK,不进入集群 | 管理 | 变更、需确认 | — | cli claude |
### `poc.images` — 构建推送 POC 镜像
用集群内 Kaniko 从当前工作树构建 api/worker/runner 等镜像并推送到 dataflow-poc
```bash
go run ./cmd/droctl run poc.images --surface claude
```
前置检查:`branch-is-poc`、`kube-reachable`
Runbook:`docs/deployment.md#2-build-and-push-images`
### `poc.deploy` — 部署 POC
渲染清单并滚动更新 droboticflow 命名空间(使用最近一次构建的镜像标签)
```bash
go run ./cmd/droctl run poc.deploy --surface claude
```
前置检查:`branch-is-poc`、`kube-reachable`
Runbook:`docs/deployment.md#4-deploy`
### `poc.api-image` — 更新 POC API 镜像
只更新 API 镜像及镜像标记,保留 Worker、算子、配置与密钥
```bash
go run ./cmd/droctl run poc.api-image --arg image=<image> --surface claude
```
前置检查:`branch-is-poc`、`kube-reachable`
Runbook:`docs/deployment.md#api-only-poc-rollout`
### `poc.ship` — 构建并部署 POC
依次构建推送镜像、部署、查看就绪度
```bash
go run ./cmd/droctl run poc.ship --surface claude
```
步骤:`poc.images` → `poc.deploy` → `accept.readiness`
Runbook:`docs/deployment.md`
### `poc.rollout-restart` — 滚动重启
滚动重启 API 与 worker 并等待就绪(不换镜像)
```bash
go run ./cmd/droctl run poc.rollout-restart --surface claude
```
前置检查:`kube-reachable`
Runbook:`docs/operations.md#kubernetes-verification`
### `poc.manifests-validate` — 校验 K8s 清单
用占位镜像渲染清单并做 kubectl client dry-run 校验
```bash
go run ./cmd/droctl run poc.manifests-validate --surface claude
```
Runbook:`docs/deployment.md#6-manifest-variables`
### `poc.cleanup-jobs` — 清理算子 Job
删除超过保留时长的已完成/失败算子 Job
```bash
go run ./cmd/droctl run poc.cleanup-jobs --surface claude
```
前置检查:`kube-reachable`
Runbook:`docs/operations.md#job-retention`
### `poc.cleanup-artifacts` — 清理运行时产物
清理 POC 工作区里超过保留时长的运行时产物
```bash
go run ./cmd/droctl run poc.cleanup-artifacts --surface claude
```
前置检查:`kubectl`
### `poc.reconcile-data` — 收敛系统数据
清理遗留演示数据,把内置算子目录收敛到当前 operator-runner 镜像
```bash
go run ./cmd/droctl run poc.reconcile-data --surface claude
```
前置检查:`kube-reachable`
Runbook:`docs/operations.md#old-demo-data-still-appears-after-an-upgrade`
### `poc.configure-fixtures` — 配置验收夹具
发现并写入 POC 验收所需的 SOURCE_PATH 等夹具配置
```bash
go run ./cmd/droctl run poc.configure-fixtures --surface claude
```
前置检查:`kube-reachable`
### `poc.configure-environment` — 初始化 POC 环境
创建命名空间、BOS 工作区 PVC 与凭据 Secret
```bash
go run ./cmd/droctl run poc.configure-environment --surface claude
```
前置检查:`branch-is-poc`、`bos-ak`、`bos-sk`
Runbook:`docs/deployment.md#3-prepare-kubernetes-access`

View File

@ -0,0 +1,81 @@
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
# 状态总览(`status`)
只读查看平台、集群与验收门的当前状态
| 动作 | 说明 | 权限 | 性质 | 参数 | 入口 |
|---|---|---|---|---|---|
| `status.health`<br>API 健康 | 检查 API 进程与 MongoDB 就绪状态([runbook](../../../../docs/operations.md#ui-cannot-load-data)) | 只读 | 只读 | — | cli claude product |
| `status.poc-readiness`<br>POC 就绪度 | 汇总 POC 验收门(外部依赖、GPU、算子工作流证据)的最新结论([runbook](../../../../docs/poc-current-status.md#strict-poc-acceptance)) | 只读 | 只读 | — | cli claude product |
| `status.dashboard`<br>平台看板 | 项目、工作流、运行和审核任务的计数与最近动态 | 只读 | 只读 | — | cli claude product |
| `status.worker-capacity`<br>Worker 容量 | 集群可调度节点的 CPU/内存/GPU 余量(worker 视角)([runbook](../../../../docs/operations.md#acceptance-checks)) | 操作 | 只读 | — | cli claude product |
| `status.worker-stats`<br>Worker 队列 | 运行队列深度、在途运行与租约状态 | 操作 | 只读 | — | cli claude product |
| `status.ai`<br>AI 服务状态 | 查看模型网关是否已配置,以及算子生成能力是否就绪 | 只读 | 只读 | — | cli claude product |
| `status.workloads`<br>集群工作负载 | 列出命名空间内的 Pod、Job、Service 与 PVC 状态([runbook](../../../../docs/operations.md#kubernetes-verification)) | 操作 | 只读 | `env`(poc/wjzh,默认 poc) | cli claude product |
### `status.health` — API 健康
检查 API 进程与 MongoDB 就绪状态
```bash
go run ./cmd/droctl run status.health --surface claude
```
Runbook:`docs/operations.md#ui-cannot-load-data`
### `status.poc-readiness` — POC 就绪度
汇总 POC 验收门(外部依赖、GPU、算子工作流证据)的最新结论
```bash
go run ./cmd/droctl run status.poc-readiness --surface claude
```
Runbook:`docs/poc-current-status.md#strict-poc-acceptance`
### `status.dashboard` — 平台看板
项目、工作流、运行和审核任务的计数与最近动态
```bash
go run ./cmd/droctl run status.dashboard --surface claude
```
### `status.worker-capacity` — Worker 容量
集群可调度节点的 CPU/内存/GPU 余量(worker 视角)
```bash
go run ./cmd/droctl run status.worker-capacity --surface claude
```
Runbook:`docs/operations.md#acceptance-checks`
### `status.worker-stats` — Worker 队列
运行队列深度、在途运行与租约状态
```bash
go run ./cmd/droctl run status.worker-stats --surface claude
```
### `status.ai` — AI 服务状态
查看模型网关是否已配置,以及算子生成能力是否就绪
```bash
go run ./cmd/droctl run status.ai --surface claude
```
### `status.workloads` — 集群工作负载
列出命名空间内的 Pod、Job、Service 与 PVC 状态
```bash
go run ./cmd/droctl run status.workloads --surface claude
```
前置检查:`kubectl`
Runbook:`docs/operations.md#kubernetes-verification`

View File

@ -0,0 +1,62 @@
<!-- Code generated by scripts/generate_ops_catalog.py; DO NOT EDIT. -->
# 本地校验(`verify`)
提交前的 lint、测试与构建校验
| 动作 | 说明 | 权限 | 性质 | 参数 | 入口 |
|---|---|---|---|---|---|
| `verify.lint`<br>Lint | 前端 tsc、gofmt 与脚本语法检查<br>不在产品内:校验的是本机工作树 | 只读 | 只读 | — | cli claude |
| `verify.go-test`<br>Go 测试 | go test ./...<br>不在产品内:校验的是本机工作树 | 只读 | 只读 | — | cli claude |
| `verify.python-test`<br>Python 测试 | operator-runner 与后端 pytest<br>不在产品内:校验的是本机工作树 | 只读 | 只读 | — | cli claude |
| `verify.frontend-test`<br>前端测试 | node --test 前端单测<br>不在产品内:校验的是本机工作树 | 只读 | 只读 | — | cli claude |
| `verify.ops-catalog`<br>能力目录一致性 | 检查能力目录与五份生成产物一致<br>不在产品内:校验的是本机工作树 | 只读 | 只读 | — | cli claude |
| `verify.local`<br>完整本地校验 | lint + 格式 + Go/Python/前端测试 + 构建 + 清单校验<br>不在产品内:校验的是本机工作树 | 只读 | 只读 | — | cli claude |
### `verify.lint` — Lint
前端 tsc、gofmt 与脚本语法检查
```bash
go run ./cmd/droctl run verify.lint --surface claude
```
### `verify.go-test` — Go 测试
go test ./...
```bash
go run ./cmd/droctl run verify.go-test --surface claude
```
### `verify.python-test` — Python 测试
operator-runner 与后端 pytest
```bash
go run ./cmd/droctl run verify.python-test --surface claude
```
### `verify.frontend-test` — 前端测试
node --test 前端单测
```bash
go run ./cmd/droctl run verify.frontend-test --surface claude
```
### `verify.ops-catalog` — 能力目录一致性
检查能力目录与五份生成产物一致
```bash
go run ./cmd/droctl run verify.ops-catalog --surface claude
```
### `verify.local` — 完整本地校验
lint + 格式 + Go/Python/前端测试 + 构建 + 清单校验
```bash
go run ./cmd/droctl run verify.local --surface claude
```

View File

@ -7,3 +7,7 @@ coverage
.env .env
.env.local .env.local
*.log *.log
**/__pycache__
**/*.pyc
**/.pytest_cache

View File

@ -36,7 +36,10 @@ AI_API_BASE_URL=
AI_MODEL= AI_MODEL=
AI_API_KEY= AI_API_KEY=
DROBOTICFLOW_API_TOKEN= DROBOTICFLOW_API_TOKEN=
DROBOTICFLOW_REQUIRE_SESSION_AUTH=false
DROBOTICFLOW_SESSION_COOKIE_SECURE=false DROBOTICFLOW_SESSION_COOKIE_SECURE=false
DROBOTICFLOW_TRUSTED_PROXY_CIDRS= DROBOTICFLOW_TRUSTED_PROXY_CIDRS=
API_SERVICE_TYPE=NodePort API_SERVICE_TYPE=NodePort
# drosync v2 signed-release verification key (base64 Ed25519 public key, not a secret).
# Must match the key embedded in native clients and used by the release signer.
DROSYNC_UPDATE_SIGNING_PUBLIC_KEY=

View File

@ -1,77 +1,204 @@
name: drosync-release name: drosync-release
on: on:
workflow_dispatch: workflow_dispatch:
inputs: inputs:
version: version:
description: SemVer release version description: Exact committed Cargo version (POC only)
required: true required: true
env:
DROSYNC_VERSION: ${{ inputs.version }}
DROSYNC_RELEASE_REF: ${{ github.ref }}
jobs: jobs:
verify: verify:
runs-on: ubuntu-22.04 runs-on: ubuntu-22.04
steps: steps:
- uses: actions/checkout@v4 - uses: actions/checkout@v4
- uses: dtolnay/rust-toolchain@stable - uses: dtolnay/rust-toolchain@1.89.0
- run: |
test "$DROSYNC_RELEASE_REF" = refs/heads/poc
python3 tools/drosync/packaging/build-metadata.py --version "$DROSYNC_VERSION"
sudo apt-get update && sudo apt-get install -y libdbus-1-dev pkg-config
- run: python3 scripts/generate_drosync_contract.py --check - run: python3 scripts/generate_drosync_contract.py --check
- run: python3 tools/drosync/packaging/tests/test_installation.py
- run: cargo fmt --manifest-path tools/drosync/Cargo.toml --all -- --check - run: cargo fmt --manifest-path tools/drosync/Cargo.toml --all -- --check
- run: cargo clippy --manifest-path tools/drosync/Cargo.toml --workspace --all-targets -- -D warnings - run: cargo clippy --locked --manifest-path tools/drosync/Cargo.toml --workspace --all-targets -- -D warnings
- run: cargo test --manifest-path tools/drosync/Cargo.toml --workspace - run: cargo test --locked --manifest-path tools/drosync/Cargo.toml --workspace
- uses: actions/setup-go@v5
with:
go-version-file: go.mod
- run: go test ./scripts/drosync-release-publisher
linux: linux:
needs: verify needs: verify
runs-on: ubuntu-22.04 runs-on: ubuntu-22.04
strategy:
matrix:
platform: [linux-x86_64, linux-arm64]
env:
GNUPGHOME: ${{ runner.temp }}/drosync-gnupg
DROSYNC_GPG_SIGN_KEY: ${{ secrets.DROSYNC_GPG_SIGN_KEY }}
DROSYNC_DEB_SIGN_KEY: ${{ secrets.DROSYNC_GPG_SIGN_KEY }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64_LINUX_X86_64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64_LINUX_ARM64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
steps: steps:
- uses: actions/checkout@v4 - uses: actions/checkout@v4
- uses: dtolnay/rust-toolchain@stable - uses: dtolnay/rust-toolchain@1.89.0
- run: tools/drosync/packaging/build-release.sh linux-x86_64 with:
targets: aarch64-unknown-linux-gnu
- run: sudo apt-get update && sudo apt-get install -y libdbus-1-dev pkg-config gcc-aarch64-linux-gnu binutils-aarch64-linux-gnu debsigs debsig-verify
- name: Import isolated CI signing key
env: env:
DROSYNC_VERSION: ${{ inputs.version }} DROSYNC_GPG_PRIVATE_KEY_BASE64: ${{ secrets.DROSYNC_GPG_PRIVATE_KEY_BASE64 }}
DROSYNC_GPG_SIGN_KEY: ${{ secrets.DROSYNC_GPG_SIGN_KEY }} DROSYNC_GPG_PASSPHRASE: ${{ secrets.DROSYNC_GPG_PASSPHRASE }}
DROSYNC_DEB_SIGN_KEY: ${{ secrets.DROSYNC_GPG_SIGN_KEY }} run: |
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }} umask 077
mkdir -p "$GNUPGHOME"
python3 - <<'PY'
import base64, os, subprocess
material=base64.b64decode(os.environ['DROSYNC_GPG_PRIVATE_KEY_BASE64'],validate=True)
result=subprocess.run(['gpg','--batch','--quiet','--import'],input=material,stdout=subprocess.DEVNULL,stderr=subprocess.PIPE)
if result.returncode: raise SystemExit('CI signing key import failed')
passphrase=os.environ.get('DROSYNC_GPG_PASSPHRASE','')
if passphrase:
from pathlib import Path
Path(os.environ['GNUPGHOME'],'gpg-agent.conf').write_text('allow-preset-passphrase\n')
subprocess.run(['gpgconf','--reload','gpg-agent'],check=True,stdout=subprocess.DEVNULL)
listing=subprocess.run(['gpg','--batch','--with-colons','--with-keygrip','--list-secret-keys',os.environ['DROSYNC_GPG_SIGN_KEY']],capture_output=True,check=True,text=True).stdout
grips=[line.split(':')[9] for line in listing.splitlines() if line.startswith('grp:')]
if not grips: raise SystemExit('CI signing key has no private keygrip')
for grip in grips:
result=subprocess.run(['/usr/lib/gnupg/gpg-preset-passphrase','--preset',grip],input=(passphrase+'\n').encode(),stdout=subprocess.DEVNULL,stderr=subprocess.PIPE)
if result.returncode: raise SystemExit('CI signing key unlock failed')
PY
- run: tools/drosync/packaging/build-release.sh "$PLATFORM"
env:
PLATFORM: ${{ matrix.platform }}
- uses: actions/upload-artifact@v4 - uses: actions/upload-artifact@v4
with: with:
name: drosync-linux-x86_64-${{ inputs.version }} name: drosync-${{ matrix.platform }}
path: tools/drosync/dist/* path: tools/drosync/dist/*
if-no-files-found: error if-no-files-found: error
- if: always()
run: |
gpgconf --kill all || true
rm -rf "$GNUPGHOME"
macos: macos:
needs: verify needs: verify
runs-on: macos-14 runs-on: macos-14
env:
DROSYNC_APPLE_KEYCHAIN: ${{ runner.temp }}/drosync-signing.keychain-db
DROSYNC_APPLE_APPLICATION_IDENTITY: ${{ secrets.DROSYNC_APPLE_APPLICATION_IDENTITY }}
DROSYNC_APPLE_INSTALLER_IDENTITY: ${{ secrets.DROSYNC_APPLE_INSTALLER_IDENTITY }}
DROSYNC_APPLE_NOTARY_PROFILE: drosync-ci
DROSYNC_UPDATE_PUBLIC_KEY_BASE64_MACOS_ARM64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
steps: steps:
- uses: actions/checkout@v4 - uses: actions/checkout@v4
- uses: dtolnay/rust-toolchain@stable - uses: dtolnay/rust-toolchain@1.89.0
- run: tools/drosync/packaging/build-release.sh macos-arm64 - name: Import dedicated signing and notarization credentials
env: env:
DROSYNC_VERSION: ${{ inputs.version }} P12_BASE64: ${{ secrets.DROSYNC_APPLE_SIGNING_P12_BASE64 }}
DROSYNC_APPLE_APPLICATION_IDENTITY: ${{ secrets.DROSYNC_APPLE_APPLICATION_IDENTITY }} P12_PASSWORD: ${{ secrets.DROSYNC_APPLE_SIGNING_P12_PASSWORD }}
DROSYNC_APPLE_INSTALLER_IDENTITY: ${{ secrets.DROSYNC_APPLE_INSTALLER_IDENTITY }} NOTARY_KEY_BASE64: ${{ secrets.DROSYNC_APPLE_NOTARY_KEY_BASE64 }}
DROSYNC_APPLE_NOTARY_PROFILE: ${{ secrets.DROSYNC_APPLE_NOTARY_PROFILE }} NOTARY_KEY_ID: ${{ secrets.DROSYNC_APPLE_NOTARY_KEY_ID }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }} NOTARY_ISSUER_ID: ${{ secrets.DROSYNC_APPLE_NOTARY_ISSUER_ID }}
run: |
umask 077
python3 - <<'PY'
import base64, os, pathlib
for variable,name in [('P12_BASE64','drosync-signing.p12'),('NOTARY_KEY_BASE64','drosync-notary.p8')]:
pathlib.Path(os.environ['RUNNER_TEMP'],name).write_bytes(base64.b64decode(os.environ[variable],validate=True))
PY
signing_password=$(openssl rand -base64 32)
security create-keychain -p "$signing_password" "$DROSYNC_APPLE_KEYCHAIN"
security unlock-keychain -p "$signing_password" "$DROSYNC_APPLE_KEYCHAIN"
security import "$RUNNER_TEMP/drosync-signing.p12" -k "$DROSYNC_APPLE_KEYCHAIN" -P "$P12_PASSWORD" -T /usr/bin/codesign -T /usr/bin/pkgbuild
security set-key-partition-list -S apple-tool:,apple: -s -k "$signing_password" "$DROSYNC_APPLE_KEYCHAIN" >/dev/null
xcrun notarytool store-credentials "$DROSYNC_APPLE_NOTARY_PROFILE" --key "$RUNNER_TEMP/drosync-notary.p8" --key-id "$NOTARY_KEY_ID" --issuer "$NOTARY_ISSUER_ID" --keychain "$DROSYNC_APPLE_KEYCHAIN"
- run: tools/drosync/packaging/build-release.sh macos-arm64
- uses: actions/upload-artifact@v4 - uses: actions/upload-artifact@v4
with: with:
name: drosync-macos-arm64-${{ inputs.version }} name: drosync-macos-arm64
path: tools/drosync/dist/* path: tools/drosync/dist/*
if-no-files-found: error if-no-files-found: error
- if: always()
run: |
security delete-keychain "$DROSYNC_APPLE_KEYCHAIN" || true
rm -f "$RUNNER_TEMP/drosync-signing.p12" "$RUNNER_TEMP/drosync-notary.p8"
windows: windows:
needs: verify needs: verify
runs-on: windows-2022 runs-on: windows-2022
env:
DROSYNC_UPDATE_PUBLIC_KEY_BASE64_WINDOWS_X86_64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
steps: steps:
- uses: actions/checkout@v4 - uses: actions/checkout@v4
- uses: dtolnay/rust-toolchain@stable - uses: dtolnay/rust-toolchain@1.89.0
- run: cargo build --manifest-path tools/drosync/Cargo.toml --release --workspace --target x86_64-pc-windows-msvc - name: Install isolated WiX and import signing certificate
shell: pwsh
env: env:
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }} PFX_BASE64: ${{ secrets.DROSYNC_WINDOWS_SIGNING_PFX_BASE64 }}
PFX_PASSWORD: ${{ secrets.DROSYNC_WINDOWS_SIGNING_PFX_PASSWORD }}
run: |
$ErrorActionPreference='Stop'
dotnet tool install wix --tool-path "$env:RUNNER_TEMP\drosync-wix" --version 4.0.6
if ($LASTEXITCODE -ne 0) { throw 'WiX installation failed' }
"$env:RUNNER_TEMP\drosync-wix" | Out-File -FilePath $env:GITHUB_PATH -Append
$signTool=Get-ChildItem "${env:ProgramFiles(x86)}\Windows Kits\10\bin" -Filter signtool.exe -Recurse | Where-Object FullName -Match '\\x64\\signtool.exe$' | Sort-Object FullName -Descending | Select-Object -First 1
if (-not $signTool) { throw 'Windows signing SDK is missing' }
$signTool.DirectoryName | Out-File -FilePath $env:GITHUB_PATH -Append
$pfx=Join-Path $env:RUNNER_TEMP 'drosync-signing.pfx'
[IO.File]::WriteAllBytes($pfx,[Convert]::FromBase64String($env:PFX_BASE64))
$password=ConvertTo-SecureString $env:PFX_PASSWORD -AsPlainText -Force
$cert=Import-PfxCertificate -FilePath $pfx -CertStoreLocation Cert:\CurrentUser\My -Password $password
"DROSYNC_AUTHENTICODE_CERT_THUMBPRINT=$($cert.Thumbprint)" | Out-File -FilePath $env:GITHUB_ENV -Append
- run: cargo build --locked --manifest-path tools/drosync/Cargo.toml --release --workspace --target x86_64-pc-windows-msvc
- shell: pwsh - shell: pwsh
run: tools/drosync/packaging/windows/build-msi.ps1 run: tools/drosync/packaging/windows/build-msi.ps1
env:
DROSYNC_VERSION: ${{ inputs.version }}
DROSYNC_AUTHENTICODE_CERT_THUMBPRINT: ${{ secrets.DROSYNC_AUTHENTICODE_CERT_THUMBPRINT }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
- uses: actions/upload-artifact@v4 - uses: actions/upload-artifact@v4
with: with:
name: drosync-windows-x86_64-${{ inputs.version }} name: drosync-windows-x86_64
path: tools/drosync/dist/* path: tools/drosync/dist/*
if-no-files-found: error if-no-files-found: error
- if: always()
shell: pwsh
run: |
if ($env:DROSYNC_AUTHENTICODE_CERT_THUMBPRINT) { Remove-Item "Cert:\CurrentUser\My\$env:DROSYNC_AUTHENTICODE_CERT_THUMBPRINT" -ErrorAction SilentlyContinue }
Remove-Item "$env:RUNNER_TEMP\drosync-signing.pfx" -ErrorAction SilentlyContinue
publish:
needs: [linux, macos, windows]
runs-on: ubuntu-22.04
env:
DROSYNC_RELEASE_ENVIRONMENT: poc
DROSYNC_POC_RELEASE_PUBLIC_BASE_URL: ${{ secrets.DROSYNC_POC_RELEASE_PUBLIC_BASE_URL }}
DROSYNC_POC_RELEASE_BOS_ENDPOINT: ${{ secrets.DROSYNC_POC_RELEASE_BOS_ENDPOINT }}
DROSYNC_POC_RELEASE_BUCKET: ${{ secrets.DROSYNC_POC_RELEASE_BUCKET }}
DROSYNC_POC_RELEASE_BOS_ACCESS_KEY: ${{ secrets.DROSYNC_POC_RELEASE_BOS_ACCESS_KEY }}
DROSYNC_POC_RELEASE_BOS_SECRET_KEY: ${{ secrets.DROSYNC_POC_RELEASE_BOS_SECRET_KEY }}
DROSYNC_POC_RELEASE_API_URL: ${{ secrets.DROSYNC_POC_RELEASE_API_URL }}
DROSYNC_RELEASE_ADMIN_EMAIL: ${{ secrets.DROSYNC_RELEASE_ADMIN_EMAIL }}
DROSYNC_RELEASE_ADMIN_PASSWORD: ${{ secrets.DROSYNC_RELEASE_ADMIN_PASSWORD }}
DROSYNC_UPDATE_SIGNING_PRIVATE_KEY: ${{ secrets.DROSYNC_UPDATE_SIGNING_PRIVATE_KEY }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
steps:
- uses: actions/checkout@v4
- uses: actions/download-artifact@v4
with:
pattern: drosync-*
path: release-artifacts
merge-multiple: true
- uses: dtolnay/rust-toolchain@1.89.0
- uses: actions/setup-go@v5
with:
go-version-file: go.mod
- run: python3 tools/drosync/packaging/build-metadata.py --version "$DROSYNC_VERSION"
- run: cargo build --locked --release --manifest-path tools/drosync/Cargo.toml -p drosync-updater --bin drosync-sign-manifest
- run: go run ./scripts/drosync-release-publisher --version "$DROSYNC_VERSION" --artifacts release-artifacts --manifest release-manifest.json
- uses: actions/upload-artifact@v4
with:
name: registered-drosync-manifest
path: release-manifest.json
if-no-files-found: error

View File

@ -13,7 +13,6 @@ permissions:
env: env:
DROSYNC_VERSION: ${{ inputs.version }} DROSYNC_VERSION: ${{ inputs.version }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=
jobs: jobs:
verify: verify:

2
.gitignore vendored
View File

@ -14,3 +14,5 @@ docs.zip
__pycache__/ __pycache__/
*.py[cod] *.py[cod]
.operator-source-repos/ .operator-source-repos/
target/
**/target/

View File

@ -5,3 +5,4 @@ node_modules/
tmp/ tmp/
docs/ docs/
backend/operator-runner/ backend/operator-runner/
src/lib/ops-catalog.generated.ts

View File

@ -0,0 +1,21 @@
Type: task
Status: resolved
Blocked by:
# 01: 对外开发人员文档架构与协议规范规划
## Question
面向外部开发人员(算法工程师、系统集成工程师、采集工具开发者),必须提供哪些文档?各个文档的具体定位、章节大纲、输入输出契约、核心接口与依赖标准是什么?
需覆盖的三大核心模块:
1. **自定义容器算子开发指南 (Custom Container Operator Guide)**
2. **开放 REST API 与自动化集成指南 (API Integration Guide)**
3. **drosync 采集工具与客户端集成开发手册 (drosync Client Guide)**
## Answer
已完成面向外部技术人员的三套标准化开发指南文档编制,统一保存在 `docs/external/developer/` 目录下:
1. [A1-自定义容器算子开发与接入指南.md](file:///Users/d-robotics/temp/droboticflow/docs/external/developer/A1-%E8%87%AA%E5%AE%9A%E4%B9%89%E5%AE%B9%E5%99%A8%E7%AE%97%E5%AD%90%E5%BC%80%E5%8F%91%E4%B8%8E%E6%8E%A5%E5%85%A5%E6%8C%87%E5%8D%97.md):详述 K8s Job 独立沙箱模型、平台注入环境变量协议、`input-bindings.json` 解析、`result.json` 契约(含 inline 与 ref 模式)、百度云 CCR 镜像打包推送规范、Web 平台注册流程及常见失败排查表。
2. [A2-平台开放API与自动化集成指南.md](file:///Users/d-robotics/temp/droboticflow/docs/external/developer/A2-%E5%B9%B3%E5%8F%B0%E5%BC%80%E6%94%BEAPI%E4%B8%8E%E8%87%AA%E5%8A%A8%E5%8C%96%E9%9B%86%E6%88%90%E6%8C%87%E5%8D%97.md):提供基于 API Token 的免交互鉴权规范、工作流触发、状态与日志轮询、产物拉取与数据血缘追溯接口,并提供完整的 Python 端到端自动化集成脚本。
3. [A3-drosync数据采集客户端集成手册.md](file:///Users/d-robotics/temp/droboticflow/docs/external/developer/A3-drosync%E6%95%B0%E6%8D%AE%E9%87%87%E9%9B%86%E5%AE%A2%E6%88%B7%E7%AB%AF%E9%9B%86%E6%88%90%E6%8C%87%E5%8D%97.md):阐述受限设备凭证安全机制、CLI/Daemon 命令参数、60s 静默期防截断设计、工控机实机 Systemd 自动化常驻及采集脚本集成方案。

View File

@ -0,0 +1,27 @@
Type: task
Status: resolved
Blocked by:
# 02: 对外使用人员操作手册与业务角色旅程规划
## Question
面向外部不同业务使用人员,如何按实际业务旅程与权责分工规划成套操作手册?每本手册的适用角色、操作 SOP、界面指引与核心步骤是什么?
需规划的五大业务手册:
1. **平台管理员手册 (Platform Administrator Manual)**
2. **流程工程师编排与调试手册 (Pipeline Engineer Manual)**
3. **数据运营与监控手册 (Data Operator Manual)**
4. **现场采集人员快速指南 (Field Collector Guide)**
5. **质检验收与评审手册 (QA Reviewer Manual)**
6. **合规审计与数据溯源手册 (Compliance Auditor Manual)**
## Answer
已完成面向外部六类业务角色的成套标准化操作手册编制,统一保存在 `docs/external/user/` 目录下:
1. [B1-平台管理员与系统配置指南.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B1-%E5%B9%B3%E5%8F%B0%E7%AE%A1%E7%90%86%E5%91%98%E4%B8%8E%E7%B3%BB%E7%BB%9F%E9%85%8D%E7%BD%AE%E6%8C%87%E5%8D%97.md):明确超级管理员与平台管理员权责边界,详细列出 5 类业务角色 RBAC 权限矩阵红线、BOS/Mongo 存储连接配置、drosync 同步空间划分与设备密钥签发、异常任务干预与租约释放 SOP。
2. [B2-流程工程师编排与调试手册.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B2-%E6%B5%81%E7%A8%8B%E5%B7%A5%E7%A8%8B%E5%B8%88%E7%BC%96%E6%8E%92%E4%B8%8E%E8%B0%83%E8%AF%95%E6%89%8B%E5%86%8C.md):指导内建与自定义算子注册、工作流画布可视化拖拽、数据边与控制边连接规则、单步调试与日志下钻、版本发布不可变锁定及沉淀为组织级模板。
3. [B3-数据运营与任务监控手册.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B3-%E6%95%B0%E6%8D%AE%E8%BF%90%E8%90%A5%E4%B8%8E%E4%BB%BB%E5%8A%A1%E7%9B%91%E6%8E%A7%E6%89%8B%E5%86%8C.md):详述任务执行大盘状态流转、单节点原地增量重试 SOP、优雅停止与强制销毁、数据资产检索与每日同步双 Sheet Excel 报表导出。
4. [B4-现场采集人员极简操作指南.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B4-%E7%8E%B0%E5%9C%BA%E9%87%87%E9%9B%86%E4%BA%BA%E5%91%98%E6%9E%81%E7%AE%80%E6%93%8D%E4%BD%9C%E6%8C%87%E5%8D%97.md):极简 3 步指南(配置、静默 60 秒、看 8080 绿灯),辅以外场常见异常速查问答。
5. [B5-质检验收与人工审核手册.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B5-%E8%B4%A8%E6%A3%80%E9%AA%8C%E6%94%B6%E4%B8%8E%E4%BA%BA%E5%B7%A5%E5%AE%A1%E6%A0%B8%E6%89%8B%E5%86%8C.md):覆盖人工审核节点挂起流转、多模态样本数据在线评审、质检打标判定及下游分支准出。
6. [B6-合规审计与数据溯源手册.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B6-%E5%90%88%E8%A7%84%E5%AE%A1%E8%AE%A1%E4%B8%8E%E6%95%B0%E6%8D%AE%E6%BA%AF%E6%BA%90%E6%89%8B%E5%86%8C.md):只读审计视角、全链路数据血缘图谱反向穿透溯源、系统操作审计与同步证据链导出。

View File

@ -0,0 +1,25 @@
Type: prototype
Status: resolved
Blocked by: 01
# 03: 自定义容器算子“5分钟极速开发”示例原型
## Question
如何为外部算法开发者设计一个极简、端到端跑通的“Hello World 级”自定义容器算子开发示范原型?
需包含的原型资产:
1. 最小可工作的 Python 算子脚本(处理输入图片/JSON,生成带指标的输出 Artifact)。
2. 配套极简 Dockerfile(以轻量 Python 为基底,非 root 运行)。
3. 本地模拟测试命令(无需 K8s 集群,纯 docker run 验证环境变量与产物目录结构)。
4. 百度云 CCR 打包推送命令模板。
5. 平台前端注册所需的 `operator.json` 元数据配置示例。
## Answer
已在 [`docs/external/examples/quickstart-operator/`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/) 目录下交付了一套完整的开箱即用示范工程原型:
1. [`operator.py`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/operator.py):接收上游输入绑定,根据置信度阈值进行数据过滤,输出持久化 JSON 数据与内存级指标,并产出符合规范的 `result.json`。
2. [`Dockerfile`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/Dockerfile):生产级轻量容器配置,采用非 root 用户(UID 1000)。
3. [`operator.json`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/operator.json):提供平台直接导入注册所需的端口与超参完整定义。
4. [`test_local.sh`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/test_local.sh):提供一键本地模拟测试脚本,验证实际执行顺利通过且契约 100% 吻合。
5. [`README.md`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/README.md):极速 3 步上手指南。

View File

@ -0,0 +1,21 @@
Type: task
Status: resolved
Blocked by: 01, 02, 03
# 04: 飞书文档规范主蓝图与知识库规划交付
## Question
如何将外部开发文档架构、平台使用手册架构与原型规范综合为一份深度适配飞书排版、可一键导入飞书知识库或飞书云文档的 Master Blueprint《POC 对外开发与使用文档全景规划及目录规范说明书》?
交付标准:
1. 飞书原生适配:全面支持 Markdown 导入至飞书文档(标题层级清晰、Mermaid 架构流程图、信息卡片/引用块、标准表格排版、待办清单)。
2. 全景规划树:提供外部开发、管理配置、业务编排、日常运营、现场采集、质检验收六大分册的完整目录和章节展开。
3. 写作标准:规定术语清单、契约安全红线、脱敏准则、交付优先级路线图。
## Answer
已完成面向飞书知识库的 Master Blueprint 及文档导航中心建设:
1. [`docs/external/飞书知识库-POC对外开发与使用文档体系全景规划.md`](file:///Users/d-robotics/temp/droboticflow/docs/external/%E9%A3%9E%E4%B9%A6%E7%9F%A5%E8%AF%86%E5%BA%93-POC%E5%AF%B9%E5%A4%96%E5%BC%80%E5%8F%91%E4%B8%8E%E4%BD%BF%E7%94%A8%E6%96%87%E6%A1%A3%E4%BD%93%E7%B3%BB%E5%85%A8%E6%99%AF%E8%A7%84%E5%88%92.md):包含两大体系、九大分册的完整架构拓扑、受众画像、敏感信息脱敏红线规约、飞书一键导入 SOP 及分阶段里程碑。
2. [`docs/external/README.md`](file:///Users/d-robotics/temp/droboticflow/docs/external/README.md):对外文档中心全局导航大纲,全面串联开发套件(A1-A3、Demo 原型)与使用套件(B1-B6)。
3. 所有文档均通过标准 Markdown 编写,完美兼容飞书导入器与复制粘贴原生渲染。

View File

@ -0,0 +1,40 @@
# Wayfinder Map: POC 对外开发与使用文档体系规划
## Destination
交付一份完整、脱敏且已针对飞书(Feishu)知识库排版优化的《POC 对外开发与使用文档全景规划及目录规范说明书》,明确对外开发人员(算子/API/同步)与对外使用人员(管理员/流程/运营/采集/质检/审计)所需提供的全部文档清单、章节大纲、协议边界与交付物。
## Notes
- Domain: Droboticflow POC 具身智能与机器人数据工作流平台 (`droboticflow` 命名空间,`120.48.164.19`)
- Skills to consult: `domain-modeling`, `codebase-design`, `research`
- Standing preferences:
- 角色严格分离:对外开发人员(External Developers)与平台使用人员(Platform Users)独立成册。
- 算子开发边界限定为“标准化自定义容器算子(Custom Container Operator)”,严禁暴露内置算子代码与底层 operator-runner 源码。
- 彻底脱敏:剔除所有内部测试环境路径、历史弃用代码兼容说明及非公开信息。
- 格式完美适配飞书:支持一键导入飞书知识库或直接复制粘贴无损转换。
## Decisions so far
- [Decision 01 - 规划终点定义](file://.scratch/poc-external-docs/issues/00-initial-grilling.md): 先交付《文档体系规划与目录规范说明书》作为阶段终点,确定全景树与章节大纲后再开展批量编写。
- [Decision 02 - 目标受众与角色分类](file://.scratch/poc-external-docs/issues/00-initial-grilling.md): 划分为外部开发者(算子开发、系统集成)与平台使用者(平台管理员、流程工程师、数据运营、现场采集人员、质检验收、审计观察员)共两层八类角色。
- [Decision 03 - 算子开发开放边界](file://.scratch/poc-external-docs/issues/00-initial-grilling.md): 以基于 Docker 的自定义容器算子为主干协议,辅以快速验证能力,完全屏蔽内部 Builtin 源码。
- [Decision 04 - 独立对外专区与脱敏策略](file://.scratch/poc-external-docs/issues/00-initial-grilling.md): 在独立对外文档专区构建,去除内部技术黑话与兼容历史。
- [Decision 05 - 交付载体与飞书格式](file://.scratch/poc-external-docs/issues/00-initial-grilling.md): 产出深度适配飞书文档规范的 Markdown 体系与主文档,支持一键导入飞书知识库。
- [01-external-developer-docs-architecture](file://.scratch/poc-external-docs/issues/01-external-developer-docs-architecture.md): 完成三大开发者指南(A1 算子容器开发、A2 REST API 自动化集成、A3 drosync 客户端集成)。
- [02-platform-user-manuals-architecture](file://.scratch/poc-external-docs/issues/02-platform-user-manuals-architecture.md): 完成六大业务角色操作手册(B1 管理员、B2 流程工程师、B3 数据运营、B4 现场采集、B5 质检验收、B6 合规审计)。
- [03-custom-operator-quickstart-prototype](file://.scratch/poc-external-docs/issues/03-custom-operator-quickstart-prototype.md): 完成极速自定义容器算子 Demo 原型(包含 `operator.py`, `Dockerfile`, `operator.json`, `test_local.sh`, `README.md`),并通过本地单机契约验证。
- [04-feishu-docs-blueprint-synthesis](file://.scratch/poc-external-docs/issues/04-feishu-docs-blueprint-synthesis.md): 交付飞书 Master Blueprint 及对外文档中心全局导航 Hub(`docs/external/README.md`)。
## Not yet specified
- 飞书 Open API 自动化同步脚本(待后续提供企业自建应用凭据后落地)。
- 算子本地调试仿真沙箱环境 CLI(类似本地轻量 minikube/mock runner)。
- 外部开发人员专用的 Swagger / Redoc 静态交互式 API 站点生成流程。
## Out of scope
- 内部 Builtin 算子底层 Python 运行器与调度器修改文档。
- Fanyu 分支专有功能及未发布特性的对外说明。
- 历史废弃接口兼容层与清理说明(仅限内部研发可见)。
- 多租户商业计费与账单系统文档。

View File

@ -0,0 +1,25 @@
# Specification: POC 对外开发与使用文档体系规范
本文档为 Droboticflow POC 对外文档体系的技术规约。所有文档均已脱离本仓库,直接发布至**飞书云文档**专区。
## 1. 体系目标
面向 POC 外部开发人员(算子、API、同步客户端)与使用人员(管理员、流程编排、数据运营、现场采集、质检验收、合规审计)提供成套、角色闭环、零工程内部黑话泄露的正式交付文档。
## 2. 飞书文档发布中心与全量链接
飞书主文件夹:[📁 Droboticflow (POC) 对外文档中心](https://horizonrobotics.feishu.cn/drive/folder/JrCDfUkDQl43LadGBCZc4wuznQg)
| 体系分册 | 文档名称 | 飞书在线文档链接 | 适用受众 |
| :--- | :--- | :--- | :--- |
| **导航主页** | 平台对外文档中心导航大纲 | [在线阅读](https://horizonrobotics.feishu.cn/docx/N7IAd1UtToWU4ox9zn3cDGLcnPe) | 全体外部人员 |
| **全景规划** | 文档体系全景规划与规范说明书 | [在线阅读](https://horizonrobotics.feishu.cn/docx/KE54diBzPoBYzuxQD3QcWTMJnLb) | 负责人与架构师 |
| **开发分册 A1** | 自定义容器算子开发与接入指南 | [在线阅读](https://horizonrobotics.feishu.cn/docx/Pk6rdRMNoolEjaxBLZEcS92Nnah) | 算法/模型开发 |
| **开发分册 A2** | 平台开放 REST API 与自动化集成指南 | [在线阅读](https://horizonrobotics.feishu.cn/docx/Pk60dr6ploTDVBxtY8Pcul4injg) | 系统集成/后端 |
| **开发分册 A3** | drosync 数据采集客户端集成手册 | [在线阅读](https://horizonrobotics.feishu.cn/docx/SxA5dliHpozzrrxKxz8cuC8vnbb) | 采集工具运维 |
| **开发范例** | 5分钟算子极速上手工程原型 (QuickStart) | [在线阅读](https://horizonrobotics.feishu.cn/docx/VJZVd9KZUoEMCfxkWItcys1dn3f) | 算法开发工程师 |
| **使用分册 B1** | 平台管理员与系统配置指南 | [在线阅读](https://horizonrobotics.feishu.cn/docx/GRnDd31gloa9gIxUzXCcv1zKn6c) | 平台/超级管理员 |
| **使用分册 B2** | 流程工程师编排与调试手册 | [在线阅读](https://horizonrobotics.feishu.cn/docx/VqWedTTiToHfYZxN4bzcLQzrnOh) | 流程工程师 |
| **使用分册 B3** | 数据运营与任务监控手册 | [在线阅读](https://horizonrobotics.feishu.cn/docx/QxtCdDvIfonLfVxNlftcJJX7nGb) | 数据运营人员 |
| **使用分册 B4** | 现场采集人员极简操作指南 | [在线阅读](https://horizonrobotics.feishu.cn/docx/Zei8dBvm4oLM2DxZFFoc6xY0n96) | 现场随车采集员 |
| **使用分册 B5** | 质检验收与人工审核手册 | [在线阅读](https://horizonrobotics.feishu.cn/docx/U6gvdK665oToPdxkpAAciVFQnPe) | 质检验收人员 |
| **使用分册 B6** | 合规审计与数据溯源手册 | [在线阅读](https://horizonrobotics.feishu.cn/docx/Je9kdbD2noTSaexZWbSc3txnnDh) | 合规审计人员 |

View File

@ -2,9 +2,10 @@
## Deployment Environment ## Deployment Environment
- The `dev` branch uses the `poc` deployment and test environment. - The `poc` branch uses the POC environment (namespace `droboticflow`, public entry `120.48.164.19`).
- Leave `DEPLOY_ENV` unset on `dev`; the deploy scripts should resolve it to `poc`. - Keep the pre-Fanyu baseline `d947a20b` plus drosync changes. Do not merge `dev` or Fanyu commits into `poc`.
- Do not deploy `dev` to `wjzh` unless the user explicitly overrides this rule. - Build POC images from `poc` and publish them under `dataflow-poc`, never from the Fanyu development branch.
- Fanyu is a separate environment and is not a target of POC deployment commands.
## Git Workflow ## Git Workflow
@ -14,3 +15,7 @@
- Commit automatically with an English, emoji-prefixed commit message. - Commit automatically with an English, emoji-prefixed commit message.
- Push the current branch after a successful commit. - Push the current branch after a successful commit.
- Do not stage or commit unrelated user changes already present in the working tree. - Do not stage or commit unrelated user changes already present in the working tree.
## Release Versioning
- Every time a new release package/build is generated for the user, increment the last digit of the version by +1 in `tools/drosync/Cargo.toml` (e.g., `1.0.0` -> `1.0.1` -> `1.0.2`).

49
CONTEXT.md Normal file
View File

@ -0,0 +1,49 @@
# Droboticflow POC
Domain vocabulary for Droboticflow POC environment workflow orchestration, custom operators, and data synchronization.
## Language
**POC Environment**:
The isolated deployment and validation environment operating under namespace droboticflow at 120.48.164.19 on git branch poc.
_Avoid_: Dev, Fanyu, Production
**Custom Operator**:
A user-defined data transformation or validation module packaged as a standard Docker container communicating through input/output artifacts and environment variables.
_Avoid_: Builtin operator, internal runner handler, plugin
**Builtin Operator**:
A platform-managed, canonical operator embedded in the central catalog whose container images are maintained by the platform team.
_Avoid_: Core script, system operator
**Workflow**:
A directed acyclic graph (DAG) composed of operator nodes, data connections, and hyperparameters executed by the Go worker and scheduled on Kubernetes.
_Avoid_: Pipeline (when referring to an individual DAG instance), Job
**Artifact**:
A discrete, typed, addressable data object or reference produced by an operator execution node.
_Avoid_: Output file, blob, payload, log
**drosync**:
The high-reliability, one-way synchronization tool transferring local robotics sensor datasets to Baidu Object Storage (BOS) with conflict protection.
_Avoid_: File sync, rsync, robopull
**Platform Administrator**:
The user role responsible for managing an organization's business accounts, storage connections, drosync spaces, and access keys.
_Avoid_: SuperAdmin, root
**Pipeline Engineer**:
The user role responsible for registering custom operators, designing workflow templates, orchestrating DAGs, and publishing workflow versions.
_Avoid_: Algorithm dev, pipeline designer
**Data Operator**:
The user role responsible for tracking daily data ingestion, monitoring live runs, pausing/resuming workflows, and retrying failed nodes.
_Avoid_: Operator (overloaded), worker
**QA Reviewer**:
The user role responsible for reviewing human audit tasks, conducting sample quality inspections, and evaluating final data assets.
_Avoid_: Auditor, inspector
**Compliance Auditor**:
The user role responsible for viewing audit trails, data provenance, run lineage, and synchronization evidence.
_Avoid_: QA, security guard

View File

@ -17,6 +17,7 @@ RUN pip install --no-cache-dir numpy opencv-python-headless bce-python-sdk pymon
RUN groupadd --system --gid 10001 droboticflow && useradd --system --uid 10001 --gid droboticflow --home-dir /app --shell /usr/sbin/nologin droboticflow RUN groupadd --system --gid 10001 droboticflow && useradd --system --uid 10001 --gid droboticflow --home-dir /app --shell /usr/sbin/nologin droboticflow
COPY --chown=10001:10001 backend ./backend COPY --chown=10001:10001 backend ./backend
COPY --chown=10001:10001 operator-repos ./operator-repos
USER 10001:10001 USER 10001:10001
CMD ["python", "/app/backend/operator-runner/main.py"] CMD ["python", "/app/backend/operator-runner/main.py"]

53
Dockerfile.ops-runner Normal file
View File

@ -0,0 +1,53 @@
ARG DROBOTICFLOW_BUILD_COMMIT=unknown
ARG DROBOTICFLOW_BUILD_TIME=unknown
ARG DROBOTICFLOW_SOURCE_BRANCH=unknown
ARG KUBECTL_IMAGE=rancher/kubectl:v1.31.4
# The ops runner executes catalog script actions for the product's ops assistant (see ops/README.md).
# It holds droctl plus the scripts and repository data those actions read; it never holds credentials,
# which come from its ServiceAccount and the namespace's existing secrets at run time.
# kubectl comes from an image rather than dl.k8s.io, which the POC build network cannot reach.
FROM ${KUBECTL_IMAGE} AS kubectl
FROM golang:1.24-bookworm AS go-build
WORKDIR /src
ARG GOPROXY=https://proxy.golang.org,direct
COPY go.mod go.sum ./
RUN GOPROXY="${GOPROXY}" go mod download
COPY cmd ./cmd
COPY internal ./internal
RUN CGO_ENABLED=0 GOOS=linux GOARCH=amd64 go build -o /out/droctl ./cmd/droctl
FROM node:22-bookworm-slim AS runtime
ARG DROBOTICFLOW_BUILD_COMMIT
ARG DROBOTICFLOW_BUILD_TIME
ARG DROBOTICFLOW_SOURCE_BRANCH
WORKDIR /opt/droboticflow
ENV DROCTL_ROOT=/opt/droboticflow
ENV DROBOTICFLOW_SOURCE_BRANCH=${DROBOTICFLOW_SOURCE_BRANCH}
ENV DROBOTICFLOW_IMAGE_BUILD_COMMIT=${DROBOTICFLOW_BUILD_COMMIT}
ENV DROBOTICFLOW_IMAGE_BUILD_TIME=${DROBOTICFLOW_BUILD_TIME}
ENV HOME=/tmp
LABEL org.opencontainers.image.revision=${DROBOTICFLOW_BUILD_COMMIT}
LABEL org.opencontainers.image.created=${DROBOTICFLOW_BUILD_TIME}
RUN apt-get update \
&& apt-get install -y --no-install-recommends bash ca-certificates python3 \
&& rm -rf /var/lib/apt/lists/*
RUN groupadd --system --gid 10001 droboticflow && useradd --system --uid 10001 --gid droboticflow --home-dir /tmp --shell /usr/sbin/nologin droboticflow
COPY --from=kubectl /bin/kubectl /usr/local/bin/kubectl
COPY --from=go-build /out/droctl /usr/local/bin/droctl
COPY --chown=10001:10001 ops ./ops
COPY --chown=10001:10001 scripts ./scripts
COPY --chown=10001:10001 k8s ./k8s
COPY --chown=10001:10001 internal/api/builtin_operators_catalog.json ./internal/api/builtin_operators_catalog.json
COPY --chown=10001:10001 backend ./backend
COPY --chown=10001:10001 operator-repos ./operator-repos
COPY --chown=10001:10001 package.json ./package.json
USER 10001:10001
ENTRYPOINT []
CMD ["droctl", "list", "--surface", "product"]

View File

@ -1,5 +1,7 @@
# Drobodata # Drobodata
The current branch retires historical runtime compatibility. Read [the cutover and retired-capability record](doc/兼容代码清理记录.md) before deployment. New browser sessions, artifact payloads, operator handlers, credentials and client journals must use the current contracts. No production cutover is implied by this source change.
Drobodata is a workflow orchestration platform for embodied AI and vision pipelines. This repository now contains: Drobodata is a workflow orchestration platform for embodied AI and vision pipelines. This repository now contains:
- a React/Vite frontend - a React/Vite frontend
@ -114,9 +116,9 @@ Key environment variables:
- `OPERATOR_COMMAND_ALLOWLIST_REGEX`: optional regular expression that explicit shell commands must match - `OPERATOR_COMMAND_ALLOWLIST_REGEX`: optional regular expression that explicit shell commands must match
- `OPERATOR_COMMAND_DENYLIST_REGEX`: optional regular expression that rejects matching explicit shell commands - `OPERATOR_COMMAND_DENYLIST_REGEX`: optional regular expression that rejects matching explicit shell commands
- `DROBOTICFLOW_API_TOKEN`: optional shared API token for non-browser API clients. When set, non-public API calls require `Authorization: Bearer <token>` or `X-Droboticflow-API-Token` unless a valid session cookie is already present while session auth is enabled. - `DROBOTICFLOW_API_TOKEN`: optional shared API token for non-browser API clients. When set, non-public API calls require `Authorization: Bearer <token>` or `X-Droboticflow-API-Token` unless a valid session cookie is already present while session auth is enabled.
- `DROBOTICFLOW_REQUIRE_SESSION_AUTH`: optional cookie-session auth enforcement for business APIs, default `false` locally; public LoadBalancer deploys force it to `true` - Browser business APIs always require cookie-session authentication; there is no authentication-off setting.
- `DROBOTICFLOW_SESSION_COOKIE_SECURE`: sets the `Secure` attribute on session cookies, default `false` for local development; enable it behind HTTPS - `DROBOTICFLOW_SESSION_COOKIE_SECURE`: sets the `Secure` attribute on session cookies, default `false` for local development; enable it behind HTTPS
- `DROBOTICFLOW_ACCEPTANCE_EMAIL` / `DROBOTICFLOW_ACCEPTANCE_PASSWORD`: optional credentials used by live acceptance and reconcile scripts to log in, persist cookies, and send CSRF headers against session-authenticated deployments. Workflow acceptance checks can use admin, pipeline-engineer, data-operator, or legacy operator accounts depending on the exercised surface; reconcile still needs an admin account when it updates settings or management resources. - `DROBOTICFLOW_ACCEPTANCE_EMAIL` / `DROBOTICFLOW_ACCEPTANCE_PASSWORD`: optional credentials used by live acceptance and reconcile scripts to log in, persist cookies, and send CSRF headers against session-authenticated deployments. Workflow acceptance checks can use admin, pipeline-engineer, or data-operator accounts depending on the exercised surface; reconcile still needs an admin account when it updates settings or management resources.
- `DROBOTICFLOW_TRUSTED_PROXY_CIDRS`: optional comma/space-separated proxy CIDRs whose `X-Forwarded-For` or `X-Real-IP` headers may be trusted for rate limiting; empty means trust no forwarded headers - `DROBOTICFLOW_TRUSTED_PROXY_CIDRS`: optional comma/space-separated proxy CIDRs whose `X-Forwarded-For` or `X-Real-IP` headers may be trusted for rate limiting; empty means trust no forwarded headers
- `API_SERVICE_TYPE`: Kubernetes API service type for rendered manifests, `NodePort` by default and `ClusterIP` when exposure is handled by LoadBalancer or ingress - `API_SERVICE_TYPE`: Kubernetes API service type for rendered manifests, `NodePort` by default and `ClusterIP` when exposure is handled by LoadBalancer or ingress
- `AI_API_BASE_URL`: OpenAI-compatible endpoint used by server-side AI generation; required when `AI_API_KEY` is set - `AI_API_BASE_URL`: OpenAI-compatible endpoint used by server-side AI generation; required when `AI_API_KEY` is set
@ -124,7 +126,7 @@ Key environment variables:
- `AI_API_KEY`: server-side OpenAI-compatible API key used for workflow/operator generation; leave unset to disable AI generation - `AI_API_KEY`: server-side OpenAI-compatible API key used for workflow/operator generation; leave unset to disable AI generation
- `VITE_API_BASE_URL`: optional frontend API base URL override; leave empty for same-origin `/api`, or set an absolute `http://` / `https://` URL - `VITE_API_BASE_URL`: optional frontend API base URL override; leave empty for same-origin `/api`, or set an absolute `http://` / `https://` URL
- `VITE_DEV_API_BASE_URL`: optional Vite dev proxy target for `/api`, default `http://127.0.0.1:3001` - `VITE_DEV_API_BASE_URL`: optional Vite dev proxy target for `/api`, default `http://127.0.0.1:3001`
- `VITE_DEV_WORKER_BASE_URL`: optional Vite dev proxy target for `/worker-api`, default `http://127.0.0.1:3002` - Browser `/worker-api` routes use the same `VITE_DEV_API_BASE_URL` proxy as `/api`; direct Worker proxy overrides are retired so session and role checks always apply.
- `WORKFLOW_ACCEPTANCE_REQUIRE_EXPLICIT_ENDPOINT`: set to `true` for deployed-environment workflow acceptance so omitted API endpoints fail instead of falling back to localhost. - `WORKFLOW_ACCEPTANCE_REQUIRE_EXPLICIT_ENDPOINT`: set to `true` for deployed-environment workflow acceptance so omitted API endpoints fail instead of falling back to localhost.
Explicit startup values are validated before API/worker startup, before Kubernetes manifest rendering, and before `scripts/deploy-k8s.sh` performs cluster writes. `MONGO_URI` is required at runtime and must be a `mongodb://` or `mongodb+srv://` URI without whitespace or unreplaced placeholder markers. `PORT`/`WORKER_PORT` must be valid TCP ports, Mongo retry count and retry delay must be positive, worker poll interval must be positive, replica counts must be non-negative in manifests, NodePort must be in the Kubernetes `30000..32767` range, and `OPERATOR_JOB_TTL_SECONDS` must be non-negative (`0` disables TTL injection). Manifest, build, and deploy wrappers no longer carry a repository-default image registry: callers must set `API_IMAGE`, `WORKER_IMAGE`, and `OPERATOR_RUNNER_IMAGE` explicitly, or set `REGISTRY_HOST` and `REGISTRY_NAMESPACE` so those image references can be derived from `IMAGE_TAG`; all three wrappers validate generated or explicit image references before Docker or Kubernetes calls. Manifest and deploy wrappers also reject invalid Kubernetes namespace/Secret/PVC/Service names, non-absolute workspace mount paths, malformed worker/BOS service URLs, malformed non-empty AI service URLs, missing AI base/model when an AI key is configured, and container image references with whitespace. Multi-line ConfigMap block values such as GPU tolerations JSON and shell command allow/deny regexes are indented before manifest output so readable multi-line input stays valid YAML. Explicit boolean env values accept `true/false`, `1/0`, `yes/no`, or `on/off`; other spellings fail fast instead of silently falling back, and accepted true aliases drive deploy-time branches such as public LoadBalancer creation. Explicit startup values are validated before API/worker startup, before Kubernetes manifest rendering, and before `scripts/deploy-k8s.sh` performs cluster writes. `MONGO_URI` is required at runtime and must be a `mongodb://` or `mongodb+srv://` URI without whitespace or unreplaced placeholder markers. `PORT`/`WORKER_PORT` must be valid TCP ports, Mongo retry count and retry delay must be positive, worker poll interval must be positive, replica counts must be non-negative in manifests, NodePort must be in the Kubernetes `30000..32767` range, and `OPERATOR_JOB_TTL_SECONDS` must be non-negative (`0` disables TTL injection). Manifest, build, and deploy wrappers no longer carry a repository-default image registry: callers must set `API_IMAGE`, `WORKER_IMAGE`, and `OPERATOR_RUNNER_IMAGE` explicitly, or set `REGISTRY_HOST` and `REGISTRY_NAMESPACE` so those image references can be derived from `IMAGE_TAG`; all three wrappers validate generated or explicit image references before Docker or Kubernetes calls. Manifest and deploy wrappers also reject invalid Kubernetes namespace/Secret/PVC/Service names, non-absolute workspace mount paths, malformed worker/BOS service URLs, malformed non-empty AI service URLs, missing AI base/model when an AI key is configured, and container image references with whitespace. Multi-line ConfigMap block values such as GPU tolerations JSON and shell command allow/deny regexes are indented before manifest output so readable multi-line input stays valid YAML. Explicit boolean env values accept `true/false`, `1/0`, `yes/no`, or `on/off`; other spellings fail fast instead of silently falling back, and accepted true aliases drive deploy-time branches such as public LoadBalancer creation.
@ -132,9 +134,9 @@ Explicit startup values are validated before API/worker startup, before Kubernet
Development and acceptance entrypoints resolve API endpoints through shared helpers instead of each script carrying its own localhost default. Node/Vite entrypoints use `scripts/lib/service-endpoints.mjs`, Python operational scripts use `scripts/lib/droboticflow_env.py`, and shell wrappers use `scripts/lib/service-endpoints.sh`. `BASE_URL` is accepted by browser-oriented acceptance scripts, while deployment/reconcile wrappers preserve `API_BASE_URL` as their primary environment variable. Explicit endpoint values must be absolute `http://` or `https://` URLs so malformed values fail before Vite, curl, Playwright, or urllib requests are attempted. Browser-side `VITE_API_BASE_URL` follows the same rule, with the empty value reserved for same-origin API requests. Development and acceptance entrypoints resolve API endpoints through shared helpers instead of each script carrying its own localhost default. Node/Vite entrypoints use `scripts/lib/service-endpoints.mjs`, Python operational scripts use `scripts/lib/droboticflow_env.py`, and shell wrappers use `scripts/lib/service-endpoints.sh`. `BASE_URL` is accepted by browser-oriented acceptance scripts, while deployment/reconcile wrappers preserve `API_BASE_URL` as their primary environment variable. Explicit endpoint values must be absolute `http://` or `https://` URLs so malformed values fail before Vite, curl, Playwright, or urllib requests are attempted. Browser-side `VITE_API_BASE_URL` follows the same rule, with the empty value reserved for same-origin API requests.
The frontend never reads the AI key directly. Workflow generation and operator generation are proxied through the Go API so secrets stay on the server side. AI-generated operators use an explicit publication lifecycle: `draft -> built -> verified -> published`. Generated drafts can be saved and exercised only in sandbox workflows; production workflows, templates, runs, and AI workflow generation accept only published AI operators with repository, digest, fixture, test, and acceptance evidence. The frontend never reads the AI key directly. Workflow generation and operator generation are proxied through the Go API so secrets stay on the server side. AI-generated operators use an explicit publication lifecycle: `draft -> built -> verified -> published`. Generated drafts can be saved and exercised only in sandbox workflows; production workflows, templates, runs, and AI workflow generation accept only published AI operators with repository, digest, fixture, test, and acceptance evidence.
The settings page can update K8s access details, the worker defaults, the global `timezone`, `provider`, `baseURL`, `model`, and the server-side AI key. `GET /api/settings` only returns whether secrets exist via `k8s.hasKubeconfig` / `ai.hasAPIKey`; it does not echo plaintext kubeconfig or API keys back to the browser. When session auth is required, `/api/settings`, `/api/users`, database browser routes, object-storage management routes, Mongo connection tests, and external business-DB token management are organization-admin surfaces; creating a user or setting a password requires a non-blank password value, user names cannot be blank, and account status must be `active` or `disabled`. Business roles are modeled around embodied-AI data production: `admin` owns organization/system governance, `pipeline_engineer` owns operators/templates/workflow design and AI-assisted generation, `data_operator` owns project execution, run control, production monitoring, and storage browsing, `qa_reviewer` owns workflow audit decisions and post-package sampling acceptance, and `compliance_auditor` is read-only for monitoring, data assets, and audit traceability. Legacy `operator` and `auditor` users remain accepted for migration compatibility. Project mutations reject blank names and unknown statuses; project status must be `active` or `archived`. Workflow and template mutations reject blank names and unknown metadata enum values before persistence. Operator mutations reject blank metadata, unknown operator/port enum values, duplicate port IDs, and invalid resource defaults before persistence. Reusable storage/Mongo connection list/get routes and workflow storage browse helpers require admin, pipeline engineer, data operator, or legacy operator role so workflow editors and production operators can select real connections without exposing connection or bucket metadata to reviewers. Creating, updating, deleting, or testing connections remains admin-only. Model-backed AI generation requires admin, pipeline engineer, or legacy operator role. Non-admin pages use `/api/public/settings`, which exposes only `timezone`, and users can update only their own sidebar `name` / `email` through `/api/users/me`. Worker polling and concurrency values are positive-integer gated in the browser, the shared settings payload builder, and the API, so values such as `0`, `1.5`, `60s`, or blank strings fail instead of being ignored. Default CPU/MEM resource values are trimmed and validated as positive Kubernetes resource quantities when settings are saved, and default GPU must be a positive integer when present. Timestamps in the UI are rendered in the configured IANA timezone with compact minute-level formatting for cards, lists, and summaries, while logs keep finer granularity when needed. OSS-related bucket and path settings belong on OSS operators in workflows, not in the global system settings page. Scan workflows can now reference reusable BOS storage connections via `scanConfig.connectionId`, so endpoint and AK/SK are stored once in `/api/storage/connections` and resolved by the API/worker at preview and execution time instead of being duplicated into each workflow; if a scan config or connection omits endpoint, both API preview and worker execution use the validated `BOS_ENDPOINT` startup value when it is set, otherwise real BOS requests fail with an explicit missing-endpoint error. The settings page can update K8s access details, the worker defaults, the global `timezone`, `provider`, `baseURL`, `model`, and the server-side AI key. `GET /api/settings` only returns whether secrets exist via `k8s.hasKubeconfig` / `ai.hasAPIKey`; it does not echo plaintext kubeconfig or API keys back to the browser. When session auth is required, `/api/settings`, `/api/users`, database browser routes, object-storage management routes, Mongo connection tests, and external business-DB token management are organization-admin surfaces; creating a user or setting a password requires a non-blank password value, user names cannot be blank, and account status must be `active` or `disabled`. Business roles are modeled around embodied-AI data production: `admin` owns organization/system governance, `pipeline_engineer` owns operators/templates/workflow design and AI-assisted generation, `data_operator` owns project execution, run control, production monitoring, and storage browsing, `qa_reviewer` owns workflow audit decisions and post-package sampling acceptance, and `compliance_auditor` reads monitoring, data assets, and audit traces; the current task-audit API also permits its approval/rejection decisions. Only these five business roles are accepted. Unsupported role values cannot be assigned, log in, reuse sessions, or become public-preview identities. See [role scenarios and permissions](doc/角色使用想定与权限说明.md) for the UI/API boundaries. Project mutations reject blank names and unknown statuses; project status must be `active` or `archived`. Workflow and template mutations reject blank names and unknown metadata enum values before persistence. Operator mutations reject blank metadata, unknown operator/port enum values, duplicate port IDs, and invalid resource defaults before persistence. Reusable storage/Mongo connection list/get routes and workflow storage browse helpers require admin, pipeline engineer, or data operator role so workflow editors and production operators can select real connections without exposing connection or bucket metadata to reviewers. Creating, updating, deleting, or testing connections remains admin-only. Model-backed AI generation requires admin or pipeline engineer role. Non-admin pages use `/api/public/settings`, which exposes only `timezone`, and users can update only their own sidebar `name` / `email` through `/api/users/me`. Worker polling and concurrency values are positive-integer gated in the browser, the shared settings payload builder, and the API, so values such as `0`, `1.5`, `60s`, or blank strings fail instead of being ignored. Default CPU/MEM resource values are trimmed and validated as positive Kubernetes resource quantities when settings are saved, and default GPU must be a positive integer when present. Timestamps in the UI are rendered in the configured IANA timezone with compact minute-level formatting for cards, lists, and summaries, while logs keep finer granularity when needed. OSS-related bucket and path settings belong on OSS operators in workflows, not in the global system settings page. Scan workflows can now reference reusable BOS storage connections via `scanConfig.connectionId`, so endpoint and AK/SK are stored once in `/api/storage/connections` and resolved by the API/worker at preview and execution time instead of being duplicated into each workflow; if a scan config or connection omits endpoint, both API preview and worker execution use the validated `BOS_ENDPOINT` startup value when it is set, otherwise real BOS requests fail with an explicit missing-endpoint error.
The API now includes a cookie-session account foundation for organization-based access. Auth endpoints cover bootstrap, login, logout, current session, and super-admin organization/user management. Existing local deployments remain compatible by default; public LoadBalancer deploys require `DROBOTICFLOW_REQUIRE_SESSION_AUTH=true` so browser business APIs keep role checks. Session-authenticated unsafe requests, including logout, use a double-submit `droboticflow_csrf` cookie plus `X-Droboticflow-CSRF-Token` header. Browser JSON, object-storage preview, and multipart object upload requests share the same credentials and CSRF header path; object-storage preview byte-count headers are accepted only when they are exact safe non-negative integers. Worker control endpoints under `/worker-api` require an admin, pipeline engineer, data operator, or legacy operator session, or an API token when session auth is not enforced. Bundled acceptance and reconcile scripts can log in with `DROBOTICFLOW_ACCEPTANCE_EMAIL` / `DROBOTICFLOW_ACCEPTANCE_PASSWORD` and will send CSRF headers on writes. Do not embed `DROBOTICFLOW_API_TOKEN` into frontend builds; it is intended for machine-to-machine calls only. The API now includes a cookie-session account foundation for organization-based access. Auth endpoints cover bootstrap, login, logout, current session, and super-admin organization/user management. All browser business APIs require cookie-session authentication; there is no public-preview identity or authentication-off mode. Session-authenticated unsafe requests, including logout, use a double-submit `droboticflow_csrf` cookie plus `X-Droboticflow-CSRF-Token` header. Browser JSON, object-storage preview, and multipart object upload requests share the same credentials and CSRF header path; object-storage preview byte-count headers are accepted only when they are exact safe non-negative integers. Worker control endpoints under `/worker-api` require an admin, pipeline engineer, or data operator session. Bundled acceptance and reconcile scripts can log in with `DROBOTICFLOW_ACCEPTANCE_EMAIL` / `DROBOTICFLOW_ACCEPTANCE_PASSWORD` and will send CSRF headers on writes. Do not embed `DROBOTICFLOW_API_TOKEN` into frontend builds; it is intended for machine-to-machine calls only.
The Kubernetes runtime now assumes a shared workspace PVC. Worker writes per-node `input-artifacts.json` files into the shared workspace, operator-runner Jobs read those files through `INPUT_ARTIFACTS_PATH`, then persist `result.json` and `stage-manifest.json` back into the same PVC. Large artifact lists no longer need to travel through giant env vars or stdout payloads. Node CPU and memory requests/limits are applied to Kubernetes Job container resources and must be valid positive Kubernetes resource quantities; malformed explicit values fail before a Job is created instead of being omitted. Operator defaults and workflow-node overrides can also set `sharedMemorySize` for a writable `/dev/shm` memory volume; the effective order is node override, operator default, then `DROBOTICFLOW_SHARED_MEMORY_SIZE` (POC default `8Gi`). GPU requests use `nvidia.com/gpu` when the node or default resource config sets a positive GPU count. GPU scheduling requires a cluster with GPU nodes and the NVIDIA device plugin/runtime installed. Optional GPU node selector, tolerations, and runtime class settings are only injected into Jobs that request a positive GPU count. Invalid GPU selector or tolerations configuration fails worker startup instead of being ignored. Operator-runner Jobs also receive `ttlSecondsAfterFinished` from `OPERATOR_JOB_TTL_SECONDS`, and the cleanup script can remove old completed Jobs that were created before TTL was enabled. Run `npm run acceptance:gpu` against a real GPU cluster to validate allocatable GPU resources, scheduling, runtime, and `nvidia-smi` execution; the acceptance script rejects invalid namespace, image, timeout, GPU count, selector, toleration, resource-name, Job-name, and runtime-class inputs before it touches the cluster, and renders dynamic manifest values as quoted YAML scalars. Runs that execute on NVIDIA hardware report GPU utilization, GPU memory, GPU count, and GPU model in the resource samples shown on the monitoring page. The Kubernetes runtime now assumes a shared workspace PVC. Worker writes per-node `input-artifacts.json` files into the shared workspace, operator-runner Jobs read those files through `INPUT_ARTIFACTS_PATH`, then persist `result.json` and `stage-manifest.json` back into the same PVC. Large artifact lists no longer need to travel through giant env vars or stdout payloads. Node CPU and memory requests/limits are applied to Kubernetes Job container resources and must be valid positive Kubernetes resource quantities; malformed explicit values fail before a Job is created instead of being omitted. Operator defaults and workflow-node overrides can also set `sharedMemorySize` for a writable `/dev/shm` memory volume; the effective order is node override, operator default, then `DROBOTICFLOW_SHARED_MEMORY_SIZE` (POC default `8Gi`). GPU requests use `nvidia.com/gpu` when the node or default resource config sets a positive GPU count. GPU scheduling requires a cluster with GPU nodes and the NVIDIA device plugin/runtime installed. Optional GPU node selector, tolerations, and runtime class settings are only injected into Jobs that request a positive GPU count. Invalid GPU selector or tolerations configuration fails worker startup instead of being ignored. Operator-runner Jobs also receive `ttlSecondsAfterFinished` from `OPERATOR_JOB_TTL_SECONDS`, and the cleanup script can remove old completed Jobs that were created before TTL was enabled. Run `npm run acceptance:gpu` against a real GPU cluster to validate allocatable GPU resources, scheduling, runtime, and `nvidia-smi` execution; the acceptance script rejects invalid namespace, image, timeout, GPU count, selector, toleration, resource-name, Job-name, and runtime-class inputs before it touches the cluster, and renders dynamic manifest values as quoted YAML scalars. Runs that execute on NVIDIA hardware report GPU utilization, GPU memory, GPU count, and GPU model in the resource samples shown on the monitoring page.
@ -142,7 +144,7 @@ Explicit `COMMAND` / `SCRIPT` execution is disabled by default. Deployments that
Kubernetes Job failures include operator logs plus Job conditions, Pod phase, container waiting or termination reasons, and Pod events in the run error path. This makes image pull, scheduling, PVC mount, timeout, and GPU allocation failures visible without separately describing the Pod. Kubernetes Job failures include operator logs plus Job conditions, Pod phase, container waiting or termination reasons, and Pod events in the run error path. This makes image pull, scheduling, PVC mount, timeout, and GPU allocation failures visible without separately describing the Pod.
The worker exposes lightweight runtime metrics at `/worker-api/metrics` in Prometheus text format. The endpoint reports run status gauges, dispatch counters, node execution counters, cumulative duration counters, duration histograms, and the latest dispatch queue depth. Access through the API requires an admin, pipeline-engineer, data-operator, or legacy operator session or an API token when session auth is not enforced; the in-cluster worker Service keeps Prometheus scrape annotations for internal collection. The worker exposes lightweight runtime metrics at `/worker-api/metrics` in Prometheus text format. The endpoint reports run status gauges, dispatch counters, node execution counters, cumulative duration counters, duration histograms, and the latest dispatch queue depth. Access through the API requires an admin, pipeline-engineer, or data-operator session; the in-cluster worker Service keeps Prometheus scrape annotations for internal collection.
Workflow execution concurrency now has two levels: Workflow execution concurrency now has two levels:

View File

@ -4882,7 +4882,7 @@ def builtin_model_inference(
node_data: dict[str, Any], node_data: dict[str, Any],
inputs: list[dict[str, Any]], inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]: ) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.model_inference.operator', run_id, node_id, output_dir, node_data, inputs) return run_operator_module('model_inference', run_id, node_id, output_dir, node_data, inputs)
def builtin_vla_model_train( def builtin_vla_model_train(
@ -4892,7 +4892,7 @@ def builtin_vla_model_train(
node_data: dict[str, Any], node_data: dict[str, Any],
inputs: list[dict[str, Any]], inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]: ) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.vla_model_train.operator', run_id, node_id, output_dir, node_data, inputs) return run_operator_module('vla_model_train', run_id, node_id, output_dir, node_data, inputs)
def builtin_sim3d_asset_generate( def builtin_sim3d_asset_generate(
@ -4902,7 +4902,7 @@ def builtin_sim3d_asset_generate(
node_data: dict[str, Any], node_data: dict[str, Any],
inputs: list[dict[str, Any]], inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]: ) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.sim3d_asset_generate.operator', run_id, node_id, output_dir, node_data, inputs) return run_operator_module('sim3d_asset_generate', run_id, node_id, output_dir, node_data, inputs)
def builtin_holobrain_data_prepare( def builtin_holobrain_data_prepare(
@ -4912,7 +4912,7 @@ def builtin_holobrain_data_prepare(
node_data: dict[str, Any], node_data: dict[str, Any],
inputs: list[dict[str, Any]], inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]: ) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.holobrain_data_prepare.operator', run_id, node_id, output_dir, node_data, inputs) return run_operator_module('holobrain_data_prepare', run_id, node_id, output_dir, node_data, inputs)
def builtin_holobrain_train( def builtin_holobrain_train(
@ -4922,7 +4922,7 @@ def builtin_holobrain_train(
node_data: dict[str, Any], node_data: dict[str, Any],
inputs: list[dict[str, Any]], inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]: ) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.holobrain_train.operator', run_id, node_id, output_dir, node_data, inputs) return run_operator_module('holobrain_train', run_id, node_id, output_dir, node_data, inputs)
def builtin_holobrain_export( def builtin_holobrain_export(
@ -4932,7 +4932,7 @@ def builtin_holobrain_export(
node_data: dict[str, Any], node_data: dict[str, Any],
inputs: list[dict[str, Any]], inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]: ) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.holobrain_export.operator', run_id, node_id, output_dir, node_data, inputs) return run_operator_module('holobrain_export', run_id, node_id, output_dir, node_data, inputs)
def builtin_holobrain_robotwin_eval( def builtin_holobrain_robotwin_eval(
@ -4942,7 +4942,7 @@ def builtin_holobrain_robotwin_eval(
node_data: dict[str, Any], node_data: dict[str, Any],
inputs: list[dict[str, Any]], inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]: ) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.holobrain_robotwin_eval.operator', run_id, node_id, output_dir, node_data, inputs) return run_operator_module('holobrain_robotwin_eval', run_id, node_id, output_dir, node_data, inputs)
def builtin_holobrain_inference_test( def builtin_holobrain_inference_test(
@ -4952,7 +4952,7 @@ def builtin_holobrain_inference_test(
node_data: dict[str, Any], node_data: dict[str, Any],
inputs: list[dict[str, Any]], inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]: ) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.holobrain_inference_test.operator', run_id, node_id, output_dir, node_data, inputs) return run_operator_module('holobrain_inference_test', run_id, node_id, output_dir, node_data, inputs)
def builtin_vla_model_inference( def builtin_vla_model_inference(
@ -4962,7 +4962,7 @@ def builtin_vla_model_inference(
node_data: dict[str, Any], node_data: dict[str, Any],
inputs: list[dict[str, Any]], inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]: ) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.vla_model_inference.operator', run_id, node_id, output_dir, node_data, inputs) return run_operator_module('vla_model_inference', run_id, node_id, output_dir, node_data, inputs)
def builtin_vla_model_evaluate( def builtin_vla_model_evaluate(
@ -4972,7 +4972,7 @@ def builtin_vla_model_evaluate(
node_data: dict[str, Any], node_data: dict[str, Any],
inputs: list[dict[str, Any]], inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]: ) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.vla_model_evaluate.operator', run_id, node_id, output_dir, node_data, inputs) return run_operator_module('vla_model_evaluate', run_id, node_id, output_dir, node_data, inputs)
def builtin_shell_command( def builtin_shell_command(
@ -4982,7 +4982,7 @@ def builtin_shell_command(
node_data: dict[str, Any], node_data: dict[str, Any],
inputs: list[dict[str, Any]], inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]: ) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.shell_command.operator', run_id, node_id, output_dir, node_data, inputs) return run_operator_module('shell_command', run_id, node_id, output_dir, node_data, inputs)
def execute_command( def execute_command(
@ -5112,28 +5112,21 @@ OPERATOR_HELPERS = {
BuiltinHandler = Any BuiltinHandler = Any
_OPERATOR_MODULE_CACHE: dict[str, Any] = {} _OPERATOR_MODULE_CACHE: dict[str, Any] = {}
_OPERATOR_MODULE_ALIASES: dict[str, str] = { def load_operator_module(slug: str) -> Any:
f"{path.name}_operator": f"backend.operators.builtin.{path.name}.operator" if not re.fullmatch(r"[a-z0-9_]+", slug):
for path in (PROJECT_ROOT / "backend" / "operators" / "builtin").iterdir() raise ValueError(f"invalid operator slug: {slug}")
if path.is_dir() and (path / "operator.py").exists() source = PROJECT_ROOT / "operator-repos" / "builtin" / slug / "src" / "operator.py"
} module = _OPERATOR_MODULE_CACHE.get(slug)
def load_operator_module(module_path: str) -> Any:
module = _OPERATOR_MODULE_CACHE.get(module_path)
if module is None: if module is None:
module = importlib.import_module(module_path) spec = importlib.util.spec_from_file_location("droboticflow_operator_" + slug, source)
_OPERATOR_MODULE_CACHE[module_path] = module if spec is None or spec.loader is None:
raise RuntimeError(f"cannot load operator source: {source}")
module = importlib.util.module_from_spec(spec)
spec.loader.exec_module(module)
_OPERATOR_MODULE_CACHE[slug] = module
return module return module
def __getattr__(name: str) -> Any:
module_path = _OPERATOR_MODULE_ALIASES.get(name)
if module_path:
return load_operator_module(module_path)
raise AttributeError(f"module {__name__!r} has no attribute {name!r}")
def run_operator_module( def run_operator_module(
module_path: str, module_path: str,
run_id: str, run_id: str,
@ -5168,244 +5161,119 @@ def builtin_generic_handler(run_id: str, node_id: str, output_dir: pathlib.Path,
return builtin_generic(run_id, node_id, output_dir, node_label, node_data, inputs) return builtin_generic(run_id, node_id, output_dir, node_label, node_data, inputs)
BUILTIN_HANDLER_RULES: tuple[tuple[str, tuple[str, ...]], ...] = (
("bos_incremental_scan", ("bos 增量扫描", "bos incremental", "增量扫描")),
("human_review", ("人工审核", "人工验收", "任务审核", "human review")),
("mongodb_write", ("mongodb", "mongo 写入", "mongo write", "写入 mongo")),
("xplatform_index", ("x 平台数据集索引", "x-platform", "数据集索引", "dataset index")),
("collection_validate", ("采集目录校验", "目录校验", "validate collection")),
("video_quality", ("视频质检", "quality check", "quality")),
("dataset_filter", ("数据过滤", "dataset filter", "video filter")),
("video_slicing", ("视频切片", "video slicing", "slice")),
("yolo_video_target_clip", ("yolo 视频目标检测裁剪", "yolo target clip", "yolo video detection")),
("video_target_clip", ("视频目标检测裁剪", "目标检测裁剪", "视频目标检测", "target clip", "object detection clip", "video object detection")),
("video_annotation", ("视频标注", "annotation", "annotate")),
("result_package", ("成品打包", "package output", "package result")),
("audit_sampling", ("抽检采样", "audit sample", "sampling")),
("hf_dataset_probe", ("hf 数据集探测", "huggingface dataset", "hf dataset", "dataset viewer")),
("agibot_world2026_validate", ("agibotworld2026", "agibot world", "agibotworld", "智元 world", "智元数据集")),
("bridgedata_tfds_manifest_validate", ("bridgedata", "bridge data", "tfds-rlds", "tfds rlds 清单")),
("rlds_episode_summary", ("rlds", "tfds", "open x-embodiment", "轨迹概览")),
("droid_raw_episode_validate", ("droid raw", "droid episode", "droid trajectory", "droid raw episode", "droid 数据校验")),
("libero_hdf5_task_validate", ("libero hdf5", "libero 任务", "libero 数据集", "libero benchmark")),
("robocasa_hdf5_demonstration_validate", ("robocasa hdf5", "robocasa 示教", "robocasa 数据集", "robocasa demonstration")),
("furniturebench_pkl_demonstration_validate", ("furniturebench", "furniture bench", "家具装配", "furniture pkl")),
("roboturk_real_hdf5_validate", ("roboturk real", "roboturk hdf5", "roboturk aligned", "roboturk 真实", "robo turk")),
("roboset_hdf5_validate", ("roboset hdf5", "roboset 数据", "robo set", "robohive dataset", "robohive hdf5")),
("rh20t_scene_validate", ("rh20t", "rh20t 场景", "rh20t scene", "real human 20t")),
("robomind_hdf5_quality_validate", ("robomind hdf5", "robomind 质量", "robomind 数据", "multi-embodiment intelligence")),
("aloha_hdf5_validate", ("aloha hdf5", "aloha 示教", "act hdf5", "aloha 数据校验")),
("robomimic_hdf5_validate", ("robomimic hdf5", "robomimic 示教", "robomimic 数据校验", "robomimic dataset")),
("hdf5_demonstration_summary", ("hdf5 示教", "hdf5 demo", "robomimic", "droid hdf5")),
("holobrain_data_prepare", ("holobrain 数据准备", "holobrain data prepare", "robotwin2.0 数据准备", "robotwin 数据准备")),
("holobrain_train", ("holobrain 完整训练", "holobrain train", "holobrain 训练")),
("holobrain_export", ("holobrain 模型导出", "holobrain export")),
("holobrain_robotwin_eval", ("holobrain robotwin 评测", "holobrain robotwin eval", "robotwin 评测")),
("holobrain_inference_test", ("holobrain 模型测试", "holobrain inference test", "holobrain 推理测试")),
("openvla_finetune", ("openvla 微调", "openvla finetune", "openvla 训练")),
("openvla_inference", ("openvla 推理", "openvla inference")),
("vla_sample_manifest_validate", ("vla 样本", "vla manifest", "视觉语言动作样本", "droid manifest")),
("rlbench_dataset_validate", ("rlbench", "rlbench 数据集", "rlbench dataset")),
("maniskill_trajectory_validate", ("maniskill", "maniskill 轨迹", "mani skill")),
("calvin_episode_validate", ("calvin episode", "calvin 数据", "calvin episode 校验")),
("rtx_action_schema_validate", ("rt-x 动作", "rtx action", "open x action", "动作空间schema")),
("embodiment_metadata_validate", ("embodiment 元信息", "多机器人embodiment", "robot embodiment", "具身元信息")),
("force_torque_sensor_validate", ("力扭矩", "force torque", "wrench", "ft sensor", "力/扭矩")),
("lerobot_video_alignment_validate", ("lerobot 视频对齐", "lerobot video", "video alignment", "视频对齐校验")),
("lerobot_v3_episode_index_validate", ("lerobot v3 episode", "episode索引", "episode index", "data path template")),
("lerobot_dataset_validate", ("lerobot 数据集校验", "lerobot validate", "lerobot validation")),
("lerobot_metadata_consistency_validate", ("lerobot 元数据", "lerobot metadata", "metadata consistency")),
("trajectory_integrity_validate", ("轨迹多模态完整性校验", "trajectory integrity", "multimodal integrity")),
("action_state_quality_validate", ("动作状态数值", "action state quality", "action/state", "状态数值")),
("episode_boundary_validate", ("episode 边界", "episode boundary", "终止标志", "terminal flag")),
("joint_limit_validate", ("关节限位", "joint limit", "urdf limit", "qpos limit")),
("dataset_split_leakage_validate", ("切分泄漏", "split leakage", "leakage validation", "数据泄漏")),
("dataset_split_manifest", ("训练切分清单", "dataset split", "split manifest")),
("media_reference_validate", ("媒体引用", "media reference", "media readability", "引用可读")),
("dataset_schema_contract_validate", ("schema 合约", "schema contract", "数据集schema", "schema 校验")),
("mcap_topic_summary", ("mcap 主题概览", "mcap topic", "mcap summary")),
("tfrecord_structural_validate", ("tfrecord 结构校验", "tf record", "tfrecord validate")),
("dataset_provenance_audit", ("数据集来源许可审计", "dataset provenance", "license audit", "来源许可")),
("webdataset_shard_summary", ("webdataset 分片", "webdataset shard", "tar shard", "分片概览")),
("diffusion_policy_train", ("diffusion policy 训练", "diffusion policy train", "扩散策略训练")),
("umi_zarr_dataset_validate", ("umi zarr", "umi 数据", "universal manipulation interface", "diffusion policy zarr", "umi dataset")),
("zarr_trajectory_summary", ("zarr 轨迹", "zarr trajectory", "zarr array", "数组轨迹")),
("camera_calibration_validate", ("相机标定校验", "camera calibration", "intrinsics", "extrinsics")),
("tf_transform_tree_validate", ("tf 坐标树", "transform tree", "tf tree", "坐标树校验", "frametree")),
("ros_joint_state_validate", ("ros jointstate", "jointstate", "joint state", "joint_states", "ros 关节状态")),
("graspnet_dataset_validate", ("graspnet", "graspnet-1billion", "抓取数据集", "6d grasp", "general object grasping")),
("bop_dataset_validate", ("bop 6d", "bop 数据集", "bop dataset", "6d姿态", "6d pose", "object pose benchmark")),
("dexycb_dataset_validate", ("dexycb 数据集", "dex-ycb", "dexycb", "ycb hand", "hand grasping object")),
("ho3d_dataset_validate", ("ho3d 数据集", "ho-3d", "ho3d", "h2o3d", "h2o-3d", "honnotate")),
("wilor_hand_pose", ("wilor", "wilor 手部", "手部姿态估计", "3d hand pose", "hand pose estimation")),
("hand_removal", ("hand removal", "视频去手", "手部移除", "去除手臂", "propainter")),
("hand_object_pose_validate", ("手-物体姿态", "手物体姿态", "hand object pose", "dexycb", "ho3d")),
("partnet_mobility_asset_validate", ("partnet-mobility", "partnet mobility", "sapien asset", "sapien 资产", "mobility.urdf", "可交互物体")),
("mjcf_actuator_validate", ("mjcf 执行器", "mjcf actuator", "mujoco actuator", "执行器校验", "ctrlrange")),
("robot_model_asset_validate", ("机器人模型资产校验", "robot model asset", "urdf", "mjcf")),
("pointcloud_summary", ("点云数据概览", "point cloud", "pointcloud", "pcd", "ply")),
("sensor_timestamp_sync_validate", ("多传感器时间同步", "timestamp sync", "sensor sync", "时间同步")),
("parquet_table_summary", ("parquet 表摘要", "parquet summary", "parquet table", "parquet")),
("coco_annotation_validate", ("coco 标注", "coco annotation", "coco validate", "coco")),
("yolo_embodied_detection_train", ("yolo 具身目标检测训练", "yolo detection train", "yolo 训练")),
("yolo_video_target_clip", ("yolo 视频目标检测裁剪", "yolo target clip", "yolo video detection")),
("yolo_detection_validate", ("yolo 检测", "yolo label", "yolo 标注", "yolo")),
("rgbd_frame_pair_validate", ("rgb-d", "rgbd", "rgb-d 帧", "深度帧", "帧对齐")),
("segmentation_mask_validate", ("分割 mask", "segmentation mask", "semantic mask", "mask 校验")),
("language_instruction_validate", ("语言指令", "language instruction", "instruction validate", "vla 指令")),
("lerobot", ("lerobot",)),
("rosbag", ("rosbag", "mcap", "ros bag")),
("csv_to_json", ("csv 转 json", "csv转json", "csv to json", "tsv 转 json", "tsv转json", "tsv to json")),
("json_to_csv", ("json 转 csv", "json转csv", "json to csv")),
("json_extract", ("字段提取", "json提取", "json 提取", "extract")),
("json_filter", ("json过滤", "json 过滤", "filter")),
("json_map", ("json映射", "json 映射", "rename", "映射重命名")),
("text_template", ("模板渲染", "template")),
("condition_router", ("条件分流", "conditional", "router", "route")),
("directory_scan", ("目录扫描", "directory", "browse", "browse dir")),
("merge", ("merge", "合并")),
("intersection", ("intersect", "交集")),
("distribution", ("distribution", "分配")),
("upload", ("upload", "export", "上传", "导出")),
("act_policy_train", ("act 策略训练", "act policy train", "act training")),
("vla_model_train", ("vla 模型训练", "vla training", "视觉语言动作训练", "policy training")),
("sim3d_asset_generate", ("3d 资产仿真生成", "3d资产仿真生成", "仿真资产生成", "simulation asset", "sim3d asset")),
("vla_model_inference", ("vla 模型推理", "vla inference", "视觉语言动作推理", "policy inference")),
("vla_model_evaluate", ("vla 模型评测", "vla 评测", "vla evaluation", "policy evaluation")),
("model_inference", ("模型推理", "model inference", "inference")),
("shell_command", ("shell 命令", "shell command")),
("source", ("source", "scanner", "oss", "scan", "扫描", "数据源")),
)
BUILTIN_HANDLERS: dict[str, BuiltinHandler] = { BUILTIN_HANDLERS: dict[str, BuiltinHandler] = {
"source": operator_handler('backend.operators.builtin.real_source.operator'), "builtin_source": operator_handler('real_source'),
"act_policy_train": operator_handler('backend.operators.builtin.act_policy_train.operator'), "source": operator_handler('real_source'),
"bos_incremental_scan": operator_handler('backend.operators.builtin.bos_incremental_scan.operator'), "builtin_act_policy_train": operator_handler('act_policy_train'),
"merge": operator_handler('backend.operators.builtin.merge.operator'), "builtin_bos_incremental_scan": operator_handler('bos_incremental_scan'),
"intersection": builtin_intersection, "builtin_merge": operator_handler('merge'),
"distribution": builtin_distribution, "builtin_intersection": builtin_intersection,
"json_extract": operator_handler('backend.operators.builtin.json_field_extract.operator'), "builtin_distribution": builtin_distribution,
"json_filter": operator_handler('backend.operators.builtin.json_filter.operator'), "builtin_json_extract": operator_handler('json_field_extract'),
"json_map": operator_handler('backend.operators.builtin.json_map_rename.operator'), "builtin_json_filter": operator_handler('json_filter'),
"mongodb_write": operator_handler('backend.operators.builtin.mongodb_write.operator'), "builtin_json_map": operator_handler('json_map_rename'),
"text_template": operator_handler('backend.operators.builtin.template_render.operator'), "builtin_mongodb_write": operator_handler('mongodb_write'),
"csv_to_json": operator_handler('backend.operators.builtin.csv_to_json.operator'), "builtin_text_template": operator_handler('template_render'),
"json_to_csv": operator_handler('backend.operators.builtin.json_to_csv.operator'), "builtin_csv_to_json": operator_handler('csv_to_json'),
"directory_scan": operator_handler('backend.operators.builtin.directory_scan.operator'), "builtin_json_to_csv": operator_handler('json_to_csv'),
"diffusion_policy_train": operator_handler('backend.operators.builtin.diffusion_policy_train.operator'), "builtin_directory_scan": operator_handler('directory_scan'),
"xplatform_index": operator_handler('backend.operators.builtin.xplatform_dataset_index.operator'), "builtin_diffusion_policy_train": operator_handler('diffusion_policy_train'),
"collection_validate": operator_handler('backend.operators.builtin.xplatform_dataset_validate.operator'), "builtin_xplatform_index": operator_handler('xplatform_dataset_index'),
"video_quality": operator_handler('backend.operators.builtin.video_quality.operator'), "builtin_collection_validate": operator_handler('xplatform_dataset_validate'),
"dataset_filter": operator_handler('backend.operators.builtin.video_filter.operator'), "builtin_video_quality": operator_handler('video_quality'),
"video_slicing": operator_handler('backend.operators.builtin.video_slice.operator'), "builtin_dataset_filter": operator_handler('video_filter'),
"video_target_clip": operator_handler('backend.operators.builtin.video_target_clip.operator'), "builtin_video_slicing": operator_handler('video_slice'),
"video_annotation": operator_handler('backend.operators.builtin.video_annotate.operator'), "builtin_video_target_clip": operator_handler('video_target_clip'),
"result_package": operator_handler('backend.operators.builtin.package.operator'), "builtin_video_annotation": operator_handler('video_annotate'),
"audit_sampling": operator_handler('backend.operators.builtin.audit_sample.operator'), "builtin_result_package": operator_handler('package'),
"hf_dataset_probe": operator_handler('backend.operators.builtin.hf_dataset_probe.operator'), "builtin_audit_sampling": operator_handler('audit_sample'),
"agibot_world2026_validate": operator_handler('backend.operators.builtin.agibot_world2026_validate.operator'), "builtin_hf_dataset_probe": operator_handler('hf_dataset_probe'),
"rlds_episode_summary": operator_handler('backend.operators.builtin.rlds_episode_summary.operator'), "builtin_agibot_world2026_validate": operator_handler('agibot_world2026_validate'),
"bridgedata_tfds_manifest_validate": operator_handler('backend.operators.builtin.bridgedata_tfds_manifest_validate.operator'), "builtin_rlds_episode_summary": operator_handler('rlds_episode_summary'),
"droid_raw_episode_validate": operator_handler('backend.operators.builtin.droid_raw_episode_validate.operator'), "builtin_bridgedata_tfds_manifest_validate": operator_handler('bridgedata_tfds_manifest_validate'),
"libero_hdf5_task_validate": operator_handler('backend.operators.builtin.libero_hdf5_task_validate.operator'), "builtin_droid_raw_episode_validate": operator_handler('droid_raw_episode_validate'),
"hdf5_demonstration_summary": operator_handler('backend.operators.builtin.hdf5_demonstration_summary.operator'), "builtin_libero_hdf5_task_validate": operator_handler('libero_hdf5_task_validate'),
"aloha_hdf5_validate": operator_handler('backend.operators.builtin.aloha_hdf5_validate.operator'), "builtin_hdf5_demonstration_summary": operator_handler('hdf5_demonstration_summary'),
"robomimic_hdf5_validate": operator_handler('backend.operators.builtin.robomimic_hdf5_validate.operator'), "builtin_aloha_hdf5_validate": operator_handler('aloha_hdf5_validate'),
"robocasa_hdf5_demonstration_validate": operator_handler('backend.operators.builtin.robocasa_hdf5_demonstration_validate.operator'), "builtin_robomimic_hdf5_validate": operator_handler('robomimic_hdf5_validate'),
"furniturebench_pkl_demonstration_validate": operator_handler('backend.operators.builtin.furniturebench_pkl_demonstration_validate.operator'), "builtin_robocasa_hdf5_demonstration_validate": operator_handler('robocasa_hdf5_demonstration_validate'),
"roboturk_real_hdf5_validate": operator_handler('backend.operators.builtin.roboturk_real_hdf5_validate.operator'), "builtin_furniturebench_pkl_demonstration_validate": operator_handler('furniturebench_pkl_demonstration_validate'),
"roboset_hdf5_validate": operator_handler('backend.operators.builtin.roboset_hdf5_validate.operator'), "builtin_roboturk_real_hdf5_validate": operator_handler('roboturk_real_hdf5_validate'),
"rh20t_scene_validate": operator_handler('backend.operators.builtin.rh20t_scene_validate.operator'), "builtin_roboset_hdf5_validate": operator_handler('roboset_hdf5_validate'),
"robomind_hdf5_quality_validate": operator_handler('backend.operators.builtin.robomind_hdf5_quality_validate.operator'), "builtin_rh20t_scene_validate": operator_handler('rh20t_scene_validate'),
"vla_sample_manifest_validate": operator_handler('backend.operators.builtin.vla_sample_manifest_validate.operator'), "builtin_robomind_hdf5_quality_validate": operator_handler('robomind_hdf5_quality_validate'),
"rlbench_dataset_validate": operator_handler('backend.operators.builtin.rlbench_dataset_validate.operator'), "vla_sample_manifest_validate": operator_handler('vla_sample_manifest_validate'),
"maniskill_trajectory_validate": operator_handler('backend.operators.builtin.maniskill_trajectory_validate.operator'), "builtin_rlbench_dataset_validate": operator_handler('rlbench_dataset_validate'),
"calvin_episode_validate": operator_handler('backend.operators.builtin.calvin_episode_validate.operator'), "builtin_maniskill_trajectory_validate": operator_handler('maniskill_trajectory_validate'),
"rtx_action_schema_validate": operator_handler('backend.operators.builtin.rtx_action_schema_validate.operator'), "builtin_calvin_episode_validate": operator_handler('calvin_episode_validate'),
"embodiment_metadata_validate": operator_handler('backend.operators.builtin.embodiment_metadata_validate.operator'), "builtin_rtx_action_schema_validate": operator_handler('rtx_action_schema_validate'),
"force_torque_sensor_validate": operator_handler('backend.operators.builtin.force_torque_sensor_validate.operator'), "builtin_embodiment_metadata_validate": operator_handler('embodiment_metadata_validate'),
"lerobot_video_alignment_validate": operator_handler('backend.operators.builtin.lerobot_video_alignment_validate.operator'), "builtin_force_torque_sensor_validate": operator_handler('force_torque_sensor_validate'),
"lerobot_v3_episode_index_validate": operator_handler('backend.operators.builtin.lerobot_v3_episode_index_validate.operator'), "builtin_lerobot_video_alignment_validate": operator_handler('lerobot_video_alignment_validate'),
"lerobot_dataset_validate": operator_handler('backend.operators.builtin.lerobot_dataset_validate.operator'), "builtin_lerobot_v3_episode_index_validate": operator_handler('lerobot_v3_episode_index_validate'),
"lerobot_metadata_consistency_validate": operator_handler('backend.operators.builtin.lerobot_metadata_consistency_validate.operator'), "builtin_lerobot_dataset_validate": operator_handler('lerobot_dataset_validate'),
"trajectory_integrity_validate": operator_handler('backend.operators.builtin.trajectory_integrity_validate.operator'), "builtin_lerobot_metadata_consistency_validate": operator_handler('lerobot_metadata_consistency_validate'),
"action_state_quality_validate": operator_handler('backend.operators.builtin.action_state_quality_validate.operator'), "builtin_trajectory_integrity_validate": operator_handler('trajectory_integrity_validate'),
"episode_boundary_validate": operator_handler('backend.operators.builtin.episode_boundary_validate.operator'), "builtin_action_state_quality_validate": operator_handler('action_state_quality_validate'),
"joint_limit_validate": operator_handler('backend.operators.builtin.joint_limit_validate.operator'), "builtin_episode_boundary_validate": operator_handler('episode_boundary_validate'),
"dataset_split_leakage_validate": operator_handler('backend.operators.builtin.dataset_split_leakage_validate.operator'), "builtin_joint_limit_validate": operator_handler('joint_limit_validate'),
"dataset_split_manifest": operator_handler('backend.operators.builtin.dataset_split_manifest.operator'), "builtin_dataset_split_leakage_validate": operator_handler('dataset_split_leakage_validate'),
"media_reference_validate": operator_handler('backend.operators.builtin.media_reference_validate.operator'), "builtin_dataset_split_manifest": operator_handler('dataset_split_manifest'),
"dataset_schema_contract_validate": operator_handler('backend.operators.builtin.dataset_schema_contract_validate.operator'), "builtin_media_reference_validate": operator_handler('media_reference_validate'),
"mcap_topic_summary": operator_handler('backend.operators.builtin.mcap_topic_summary.operator'), "builtin_dataset_schema_contract_validate": operator_handler('dataset_schema_contract_validate'),
"tfrecord_structural_validate": operator_handler('backend.operators.builtin.tfrecord_structural_validate.operator'), "builtin_mcap_topic_summary": operator_handler('mcap_topic_summary'),
"dataset_provenance_audit": operator_handler('backend.operators.builtin.dataset_provenance_audit.operator'), "builtin_tfrecord_structural_validate": operator_handler('tfrecord_structural_validate'),
"graspnet_dataset_validate": operator_handler('backend.operators.builtin.graspnet_dataset_validate.operator'), "builtin_dataset_provenance_audit": operator_handler('dataset_provenance_audit'),
"bop_dataset_validate": operator_handler('backend.operators.builtin.bop_dataset_validate.operator'), "builtin_graspnet_dataset_validate": operator_handler('graspnet_dataset_validate'),
"dexycb_dataset_validate": operator_handler('backend.operators.builtin.dexycb_dataset_validate.operator'), "builtin_bop_dataset_validate": operator_handler('bop_dataset_validate'),
"ho3d_dataset_validate": operator_handler('backend.operators.builtin.ho3d_dataset_validate.operator'), "builtin_dexycb_dataset_validate": operator_handler('dexycb_dataset_validate'),
"wilor_hand_pose": operator_handler('backend.operators.builtin.wilor_hand_pose.operator'), "builtin_ho3d_dataset_validate": operator_handler('ho3d_dataset_validate'),
"hand_removal": operator_handler('backend.operators.builtin.hand_removal.operator'), "builtin_wilor_hand_pose": operator_handler('wilor_hand_pose'),
"webdataset_shard_summary": operator_handler('backend.operators.builtin.webdataset_shard_summary.operator'), "builtin_hand_removal": operator_handler('hand_removal'),
"umi_zarr_dataset_validate": operator_handler('backend.operators.builtin.umi_zarr_dataset_validate.operator'), "builtin_webdataset_shard_summary": operator_handler('webdataset_shard_summary'),
"zarr_trajectory_summary": operator_handler('backend.operators.builtin.zarr_trajectory_summary.operator'), "builtin_umi_zarr_dataset_validate": operator_handler('umi_zarr_dataset_validate'),
"camera_calibration_validate": operator_handler('backend.operators.builtin.camera_calibration_validate.operator'), "builtin_zarr_trajectory_summary": operator_handler('zarr_trajectory_summary'),
"tf_transform_tree_validate": operator_handler('backend.operators.builtin.tf_transform_tree_validate.operator'), "builtin_camera_calibration_validate": operator_handler('camera_calibration_validate'),
"ros_joint_state_validate": operator_handler('backend.operators.builtin.ros_joint_state_validate.operator'), "builtin_tf_transform_tree_validate": operator_handler('tf_transform_tree_validate'),
"hand_object_pose_validate": operator_handler('backend.operators.builtin.hand_object_pose_validate.operator'), "builtin_ros_joint_state_validate": operator_handler('ros_joint_state_validate'),
"partnet_mobility_asset_validate": operator_handler('backend.operators.builtin.partnet_mobility_asset_validate.operator'), "builtin_hand_object_pose_validate": operator_handler('hand_object_pose_validate'),
"mjcf_actuator_validate": operator_handler('backend.operators.builtin.mjcf_actuator_validate.operator'), "builtin_partnet_mobility_asset_validate": operator_handler('partnet_mobility_asset_validate'),
"robot_model_asset_validate": operator_handler('backend.operators.builtin.robot_model_asset_validate.operator'), "builtin_mjcf_actuator_validate": operator_handler('mjcf_actuator_validate'),
"pointcloud_summary": operator_handler('backend.operators.builtin.pointcloud_summary.operator'), "builtin_robot_model_asset_validate": operator_handler('robot_model_asset_validate'),
"sensor_timestamp_sync_validate": operator_handler('backend.operators.builtin.sensor_timestamp_sync_validate.operator'), "builtin_pointcloud_summary": operator_handler('pointcloud_summary'),
"parquet_table_summary": operator_handler('backend.operators.builtin.parquet_table_summary.operator'), "builtin_sensor_timestamp_sync_validate": operator_handler('sensor_timestamp_sync_validate'),
"coco_annotation_validate": operator_handler('backend.operators.builtin.coco_annotation_validate.operator'), "builtin_parquet_table_summary": operator_handler('parquet_table_summary'),
"yolo_detection_validate": operator_handler('backend.operators.builtin.yolo_detection_validate.operator'), "builtin_coco_annotation_validate": operator_handler('coco_annotation_validate'),
"rgbd_frame_pair_validate": operator_handler('backend.operators.builtin.rgbd_frame_pair_validate.operator'), "builtin_yolo_detection_validate": operator_handler('yolo_detection_validate'),
"segmentation_mask_validate": operator_handler('backend.operators.builtin.segmentation_mask_validate.operator'), "builtin_rgbd_frame_pair_validate": operator_handler('rgbd_frame_pair_validate'),
"language_instruction_validate": operator_handler('backend.operators.builtin.language_instruction_validate.operator'), "builtin_segmentation_mask_validate": operator_handler('segmentation_mask_validate'),
"condition_router": operator_handler('backend.operators.builtin.conditional_route.operator'), "builtin_language_instruction_validate": operator_handler('language_instruction_validate'),
"human_review": operator_handler('backend.operators.builtin.human_review.operator'), "builtin_condition_router": operator_handler('conditional_route'),
"builtin_human_review": operator_handler('backend.operators.builtin.human_review.operator'), "builtin_human_review": operator_handler('human_review'),
"lerobot": operator_handler('backend.operators.builtin.lerobot_summary.operator'), "lerobot": operator_handler('lerobot_summary'),
"rosbag": operator_handler('backend.operators.builtin.rosbag_summary.operator'), "rosbag": operator_handler('rosbag_summary'),
"upload": operator_handler('backend.operators.builtin.upload.operator'), "builtin_upload": operator_handler('upload'),
"holobrain_data_prepare": operator_handler('backend.operators.builtin.holobrain_data_prepare.operator'), "builtin_holobrain_data_prepare": operator_handler('holobrain_data_prepare'),
"holobrain_train": operator_handler('backend.operators.builtin.holobrain_train.operator'), "builtin_holobrain_train": operator_handler('holobrain_train'),
"holobrain_export": operator_handler('backend.operators.builtin.holobrain_export.operator'), "builtin_holobrain_export": operator_handler('holobrain_export'),
"holobrain_robotwin_eval": operator_handler('backend.operators.builtin.holobrain_robotwin_eval.operator'), "builtin_holobrain_robotwin_eval": operator_handler('holobrain_robotwin_eval'),
"holobrain_inference_test": operator_handler('backend.operators.builtin.holobrain_inference_test.operator'), "builtin_holobrain_inference_test": operator_handler('holobrain_inference_test'),
"openvla_finetune": operator_handler('backend.operators.builtin.openvla_finetune.operator'), "builtin_openvla_finetune": operator_handler('openvla_finetune'),
"openvla_inference": operator_handler('backend.operators.builtin.openvla_inference.operator'), "builtin_openvla_inference": operator_handler('openvla_inference'),
"vla_model_train": operator_handler('backend.operators.builtin.vla_model_train.operator'), "vla_model_train": operator_handler('vla_model_train'),
"sim3d_asset_generate": operator_handler('backend.operators.builtin.sim3d_asset_generate.operator'), "sim3d_asset_generate": operator_handler('sim3d_asset_generate'),
"vla_model_inference": operator_handler('backend.operators.builtin.vla_model_inference.operator'), "vla_model_inference": operator_handler('vla_model_inference'),
"vla_model_evaluate": operator_handler('backend.operators.builtin.vla_model_evaluate.operator'), "vla_model_evaluate": operator_handler('vla_model_evaluate'),
"model_inference": builtin_model_inference, "builtin_model_inference": builtin_model_inference,
"yolo_embodied_detection_train": operator_handler('backend.operators.builtin.yolo_embodied_detection_train.operator'), "builtin_yolo_embodied_detection_train": operator_handler('yolo_embodied_detection_train'),
"yolo_video_target_clip": operator_handler('backend.operators.builtin.yolo_video_target_clip.operator'), "builtin_yolo_video_target_clip": operator_handler('yolo_video_target_clip'),
"shell_command": builtin_shell_command, "builtin_shell_command": builtin_shell_command,
"generic": builtin_generic_handler, "builtin_generic": builtin_generic_handler,
} }
for _handler_name, _handler in tuple(BUILTIN_HANDLERS.items()): def runtime_handler() -> str:
if _handler_name != "generic":
BUILTIN_HANDLERS.setdefault(f"builtin_{_handler_name}", _handler)
BUILTIN_HANDLERS.setdefault("builtin_lerobot_summary", BUILTIN_HANDLERS["lerobot"])
BUILTIN_HANDLERS.setdefault("builtin_rosbag_summary", BUILTIN_HANDLERS["rosbag"])
def select_handler(node_label: str) -> str:
normalized = node_label.lower()
for handler, tokens in BUILTIN_HANDLER_RULES:
if any(token in normalized for token in tokens):
return handler
return "generic"
def runtime_handler_override() -> str:
handler = os.getenv("DROBOTICFLOW_OPERATOR_HANDLER", "").strip() handler = os.getenv("DROBOTICFLOW_OPERATOR_HANDLER", "").strip()
if not handler: if not handler:
return "" raise RuntimeError("DROBOTICFLOW_OPERATOR_HANDLER is required; label-based dispatch is not supported")
if handler not in BUILTIN_HANDLERS: if handler not in BUILTIN_HANDLERS:
known = ", ".join(sorted(BUILTIN_HANDLERS)) known = ", ".join(sorted(BUILTIN_HANDLERS))
raise RuntimeError(f"DROBOTICFLOW_OPERATOR_HANDLER={handler!r} is not registered; known handlers: {known}") raise RuntimeError(f"DROBOTICFLOW_OPERATOR_HANDLER={handler!r} is not registered; known handlers: {known}")
@ -5448,10 +5316,10 @@ def main() -> int:
append_log("INFO", "Executing explicit command") append_log("INFO", "Executing explicit command")
artifacts = execute_command(run_id, node_id, output_dir, node_data, command) artifacts = execute_command(run_id, node_id, output_dir, node_data, command)
else: else:
handler = runtime_handler_override() or select_handler(node_label) handler = runtime_handler()
append_log("INFO", f"Selected built-in handler: {handler}") append_log("INFO", f"Selected built-in handler: {handler}")
builtin_handler = BUILTIN_HANDLERS.get(handler, BUILTIN_HANDLERS["generic"]) builtin_handler = BUILTIN_HANDLERS[handler]
if handler == "generic": if handler == "builtin_generic":
artifacts = builtin_handler(run_id, node_id, output_dir, node_label, node_data, inputs) artifacts = builtin_handler(run_id, node_id, output_dir, node_label, node_data, inputs)
else: else:
artifacts = builtin_handler(run_id, node_id, output_dir, node_data, inputs) artifacts = builtin_handler(run_id, node_id, output_dir, node_data, inputs)

View File

@ -332,65 +332,23 @@ class SourcePathFromItemTests(unittest.TestCase):
class RuntimeFileContractTests(unittest.TestCase): class RuntimeFileContractTests(unittest.TestCase):
def test_select_handler_prefers_specific_operator_routes(self): def test_dispatch_requires_explicit_current_handler(self):
self.assertEqual(MODULE.select_handler("BOS 增量扫描"), "bos_incremental_scan") with mock.patch.dict(os.environ, {"DROBOTICFLOW_OPERATOR_HANDLER": ""}):
self.assertEqual(MODULE.select_handler("人工审核"), "human_review") with self.assertRaisesRegex(RuntimeError, "is required"):
self.assertEqual(MODULE.select_handler("ALOHA HDF5 示教校验"), "aloha_hdf5_validate") MODULE.runtime_handler()
self.assertEqual(MODULE.select_handler("robomimic HDF5 示教校验"), "robomimic_hdf5_validate") with mock.patch.dict(os.environ, {"DROBOTICFLOW_OPERATOR_HANDLER": "undeclared-handler"}):
self.assertEqual(MODULE.select_handler("VLA 样本清单校验"), "vla_sample_manifest_validate") with self.assertRaisesRegex(RuntimeError, "is not registered"):
self.assertEqual(MODULE.select_handler("ACT 策略训练"), "act_policy_train") MODULE.runtime_handler()
self.assertEqual(MODULE.select_handler("Diffusion Policy 训练"), "diffusion_policy_train") with mock.patch.dict(os.environ, {"DROBOTICFLOW_OPERATOR_HANDLER": "builtin_source"}):
self.assertEqual(MODULE.select_handler("HoloBrain 数据准备"), "holobrain_data_prepare") self.assertEqual(MODULE.runtime_handler(), "builtin_source")
self.assertEqual(MODULE.select_handler("HoloBrain 完整训练"), "holobrain_train")
self.assertEqual(MODULE.select_handler("HoloBrain 模型导出"), "holobrain_export")
self.assertEqual(MODULE.select_handler("HoloBrain RoboTwin 评测"), "holobrain_robotwin_eval")
self.assertEqual(MODULE.select_handler("HoloBrain 模型测试"), "holobrain_inference_test")
self.assertEqual(MODULE.select_handler("OpenVLA 微调训练"), "openvla_finetune")
self.assertEqual(MODULE.select_handler("OpenVLA 推理"), "openvla_inference")
self.assertEqual(MODULE.select_handler("YOLO 具身目标检测训练"), "yolo_embodied_detection_train")
self.assertEqual(MODULE.select_handler("YOLO 视频目标检测裁剪"), "yolo_video_target_clip")
self.assertEqual(MODULE.select_handler("URDF 关节限位校验"), "joint_limit_validate")
self.assertEqual(MODULE.select_handler("MJCF 执行器校验"), "mjcf_actuator_validate")
self.assertEqual(MODULE.select_handler("TF 坐标树校验"), "tf_transform_tree_validate")
self.assertEqual(MODULE.select_handler("LeRobot 视频对齐校验"), "lerobot_video_alignment_validate")
self.assertEqual(MODULE.select_handler("ROS JointState 校验"), "ros_joint_state_validate")
self.assertEqual(MODULE.select_handler("GraspNet 抓取数据集校验"), "graspnet_dataset_validate")
self.assertEqual(MODULE.select_handler("BOP 6D姿态数据集校验"), "bop_dataset_validate")
self.assertEqual(MODULE.select_handler("DexYCB 数据集校验"), "dexycb_dataset_validate")
self.assertEqual(MODULE.select_handler("HO3D/H2O3D 数据集校验"), "ho3d_dataset_validate")
self.assertEqual(MODULE.select_handler("WiLoR 3D手部姿态估计"), "wilor_hand_pose")
self.assertEqual(MODULE.select_handler("Hand Removal 视频去手"), "hand_removal")
self.assertEqual(MODULE.select_handler("手-物体姿态标注校验"), "hand_object_pose_validate")
self.assertEqual(MODULE.select_handler("PartNet-Mobility 资产校验"), "partnet_mobility_asset_validate")
self.assertEqual(MODULE.select_handler("RLBench 数据集校验"), "rlbench_dataset_validate")
self.assertEqual(MODULE.select_handler("ManiSkill 轨迹校验"), "maniskill_trajectory_validate")
self.assertEqual(MODULE.select_handler("CALVIN Episode 校验"), "calvin_episode_validate")
self.assertEqual(MODULE.select_handler("RT-X动作空间Schema校验"), "rtx_action_schema_validate")
self.assertEqual(MODULE.select_handler("多机器人Embodiment元信息校验"), "embodiment_metadata_validate")
self.assertEqual(MODULE.select_handler("力扭矩传感器数据校验"), "force_torque_sensor_validate")
self.assertEqual(MODULE.select_handler("AgiBotWorld2026 数据集校验"), "agibot_world2026_validate")
self.assertEqual(MODULE.select_handler("BridgeData TFDS-RLDS清单校验"), "bridgedata_tfds_manifest_validate")
self.assertEqual(MODULE.select_handler("DROID Raw Episode校验"), "droid_raw_episode_validate")
self.assertEqual(MODULE.select_handler("LIBERO HDF5任务校验"), "libero_hdf5_task_validate")
self.assertEqual(MODULE.select_handler("RoboCasa HDF5示教校验"), "robocasa_hdf5_demonstration_validate")
self.assertEqual(MODULE.select_handler("FurnitureBench PKL示教校验"), "furniturebench_pkl_demonstration_validate")
self.assertEqual(MODULE.select_handler("RoboTurk Real HDF5校验"), "roboturk_real_hdf5_validate")
self.assertEqual(MODULE.select_handler("RoboSet HDF5轨迹校验"), "roboset_hdf5_validate")
self.assertEqual(MODULE.select_handler("RH20T 场景结构校验"), "rh20t_scene_validate")
self.assertEqual(MODULE.select_handler("RoboMIND HDF5质量校验"), "robomind_hdf5_quality_validate")
self.assertEqual(MODULE.select_handler("UMI Zarr数据集校验"), "umi_zarr_dataset_validate")
self.assertEqual(MODULE.select_handler("LeRobot v3 Episode索引校验"), "lerobot_v3_episode_index_validate")
self.assertEqual(MODULE.select_handler("数据集切分泄漏校验"), "dataset_split_leakage_validate")
self.assertEqual(MODULE.select_handler("媒体引用可读性校验"), "media_reference_validate")
self.assertEqual(MODULE.select_handler("数据集Schema合约校验"), "dataset_schema_contract_validate")
def test_builtin_handler_aliases_match_runtime_contract_names(self): def test_registry_uses_only_current_catalog_handler_names(self):
self.assertIs(MODULE.BUILTIN_HANDLERS["builtin_lerobot"], MODULE.BUILTIN_HANDLERS["lerobot"]) catalog = json.loads((MODULE.PROJECT_ROOT / "internal" / "api" / "builtin_operators_catalog.json").read_text())
self.assertIs(MODULE.BUILTIN_HANDLERS["builtin_lerobot_summary"], MODULE.BUILTIN_HANDLERS["lerobot"]) for item in catalog:
self.assertIs( if item.get("type") == "builtin":
MODULE.BUILTIN_HANDLERS["builtin_action_state_quality_validate"], self.assertIn(item["runtimeHandler"], MODULE.BUILTIN_HANDLERS)
MODULE.BUILTIN_HANDLERS["action_state_quality_validate"], self.assertNotIn("csv_to_json", MODULE.BUILTIN_HANDLERS)
) self.assertNotIn("builtin_lerobot", MODULE.BUILTIN_HANDLERS)
def test_operator_helpers_do_not_expose_legacy_builtin_handlers(self): def test_operator_helpers_do_not_expose_legacy_builtin_handlers(self):
legacy_keys = sorted(key for key in MODULE.OPERATOR_HELPERS if key.startswith("builtin_")) legacy_keys = sorted(key for key in MODULE.OPERATOR_HELPERS if key.startswith("builtin_"))
@ -409,7 +367,7 @@ class RuntimeFileContractTests(unittest.TestCase):
"outputs": [{"id": "out-1", "name": "table", "type": "json"}], "outputs": [{"id": "out-1", "name": "table", "type": "json"}],
} }
artifacts = MODULE.BUILTIN_HANDLERS["csv_to_json"]("run-1", "csv", output_dir, node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_csv_to_json"]("run-1", "csv", output_dir, node_data, [])
payload = json.loads(pathlib.Path(artifacts[0]["path"]).read_text(encoding="utf-8")) payload = json.loads(pathlib.Path(artifacts[0]["path"]).read_text(encoding="utf-8"))
self.assertEqual(payload["columns"], ["id", "name", "score"]) self.assertEqual(payload["columns"], ["id", "name", "score"])
@ -427,7 +385,7 @@ class RuntimeFileContractTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["json_filter"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_json_filter"](
"run-1", "run-1",
"filter", "filter",
output_dir, output_dir,
@ -533,6 +491,7 @@ class RuntimeFileContractTests(unittest.TestCase):
"WORKFLOW_ID": "wf-1", "WORKFLOW_ID": "wf-1",
"NODE_ID": "node-1", "NODE_ID": "node-1",
"NODE_LABEL": "通用处理", "NODE_LABEL": "通用处理",
"DROBOTICFLOW_OPERATOR_HANDLER": "builtin_generic",
"OUTPUT_DIR": str(output_dir), "OUTPUT_DIR": str(output_dir),
"NODE_DATA_JSON": '{"label":"通用处理","hyperparams":[]}', "NODE_DATA_JSON": '{"label":"通用处理","hyperparams":[]}',
"INPUT_ARTIFACTS_PATH": str(input_artifacts_path), "INPUT_ARTIFACTS_PATH": str(input_artifacts_path),
@ -1048,7 +1007,7 @@ class SourceOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["source"]("run-test", "source-json-payload", output_dir, node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_source"]("run-test", "source-json-payload", output_dir, node_data, [])
payload_artifact = next(item for item in artifacts if item["name"] == "payload.json") payload_artifact = next(item for item in artifacts if item["name"] == "payload.json")
payload = json.loads(pathlib.Path(payload_artifact["path"]).read_text(encoding="utf-8")) payload = json.loads(pathlib.Path(payload_artifact["path"]).read_text(encoding="utf-8"))
@ -1080,7 +1039,7 @@ class SourceOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["source"]("run-test", "source-json-list-payload", output_dir, node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_source"]("run-test", "source-json-list-payload", output_dir, node_data, [])
payload_artifact = next(item for item in artifacts if item["name"] == "payload.json") payload_artifact = next(item for item in artifacts if item["name"] == "payload.json")
payload = json.loads(pathlib.Path(payload_artifact["path"]).read_text(encoding="utf-8")) payload = json.loads(pathlib.Path(payload_artifact["path"]).read_text(encoding="utf-8"))
@ -1104,7 +1063,7 @@ class SourceOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["source"]("run-test", "source-csv-payload", output_dir, node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_source"]("run-test", "source-csv-payload", output_dir, node_data, [])
csv_artifact = next(item for item in artifacts if item["name"] == "report.csv") csv_artifact = next(item for item in artifacts if item["name"] == "report.csv")
self.assertEqual(csv_artifact["portId"], "csv") self.assertEqual(csv_artifact["portId"], "csv")
@ -1128,7 +1087,7 @@ class SourceOperatorTests(unittest.TestCase):
} }
with self.assertRaisesRegex(RuntimeError, "OUTPUT_NAME"): with self.assertRaisesRegex(RuntimeError, "OUTPUT_NAME"):
MODULE.BUILTIN_HANDLERS["source"]("run-test", "source-unsafe-payload", output_dir, node_data, []) MODULE.BUILTIN_HANDLERS["builtin_source"]("run-test", "source-unsafe-payload", output_dir, node_data, [])
def test_builtin_source_prefers_source_json_over_bos_env(self): def test_builtin_source_prefers_source_json_over_bos_env(self):
with tempfile.TemporaryDirectory() as temp_dir: with tempfile.TemporaryDirectory() as temp_dir:
@ -2651,8 +2610,9 @@ class XPlatformClipHandoffTests(unittest.TestCase):
self.assertEqual(manifest_payload["items"][0]["clipPath"], str(shared_clip_path)) self.assertEqual(manifest_payload["items"][0]["clipPath"], str(shared_clip_path))
self.assertFalse(any(item["name"] == "clip001.mp4" for item in artifacts)) self.assertFalse(any(item["name"] == "clip001.mp4" for item in artifacts))
def test_select_handler_routes_video_target_clip(self): def test_video_target_clip_has_explicit_handler(self):
self.assertEqual(MODULE.select_handler("视频目标检测裁剪"), "video_target_clip") with mock.patch.dict(os.environ, {"DROBOTICFLOW_OPERATOR_HANDLER": "builtin_yolo_video_target_clip"}):
self.assertEqual(MODULE.runtime_handler(), "builtin_yolo_video_target_clip")
def test_video_target_clip_detects_motion_and_writes_real_clip(self): def test_video_target_clip_detects_motion_and_writes_real_clip(self):
try: try:
@ -2712,7 +2672,7 @@ class XPlatformClipHandoffTests(unittest.TestCase):
original_ffmpeg_available = MODULE.OPERATOR_HELPERS["ffmpeg_available"] original_ffmpeg_available = MODULE.OPERATOR_HELPERS["ffmpeg_available"]
MODULE.OPERATOR_HELPERS["ffmpeg_available"] = lambda: False MODULE.OPERATOR_HELPERS["ffmpeg_available"] = lambda: False
try: try:
artifacts = MODULE.BUILTIN_HANDLERS["video_target_clip"]("run-1", "target", output_dir, node_data, inputs) artifacts = MODULE.BUILTIN_HANDLERS["builtin_video_target_clip"]("run-1", "target", output_dir, node_data, inputs)
finally: finally:
MODULE.OPERATOR_HELPERS["ffmpeg_available"] = original_ffmpeg_available MODULE.OPERATOR_HELPERS["ffmpeg_available"] = original_ffmpeg_available
@ -3618,8 +3578,8 @@ class ShellCommandOperatorTests(unittest.TestCase):
def test_fixture_report_counts_direct_and_grouped_upstream_artifacts(self): def test_fixture_report_counts_direct_and_grouped_upstream_artifacts(self):
script_path = ( script_path = (
pathlib.Path(__file__).resolve().parents[1] pathlib.Path(__file__).resolve().parents[2]
/ "operators" / "operator-repos"
/ "builtin" / "builtin"
/ "shell_command" / "shell_command"
/ "approved_scripts" / "approved_scripts"
@ -3737,7 +3697,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["hf_dataset_probe"]("run-1", "hf", output_dir, node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_hf_dataset_probe"]("run-1", "hf", output_dir, node_data, [])
self.assertEqual([item["path"] for item in requests], ["/is-valid", "/splits", "/size", "/parquet", "/rows"]) self.assertEqual([item["path"] for item in requests], ["/is-valid", "/splits", "/size", "/parquet", "/rows"])
payload = MODULE.load_artifact_payload(artifacts[0]) payload = MODULE.load_artifact_payload(artifacts[0])
@ -3749,7 +3709,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
self.assertEqual(payload["parquetFileCount"], 1) self.assertEqual(payload["parquetFileCount"], 1)
def test_hf_dataset_probe_retries_incomplete_read(self): def test_hf_dataset_probe_retries_incomplete_read(self):
operator_module = MODULE.load_operator_module("backend.operators.builtin.hf_dataset_probe.operator") operator_module = MODULE.load_operator_module("hf_dataset_probe")
payload = json.dumps({"valid": True}).encode("utf-8") payload = json.dumps({"valid": True}).encode("utf-8")
responses = [http.client.IncompleteRead(b"", 100), _FakeHTTPResponse(payload)] responses = [http.client.IncompleteRead(b"", 100), _FakeHTTPResponse(payload)]
@ -3812,7 +3772,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
episodes_path.write_text("\n".join(json.dumps(item) for item in episodes), encoding="utf-8") episodes_path.write_text("\n".join(json.dumps(item) for item in episodes), encoding="utf-8")
node_data = {"label": "RLDS 轨迹概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "RLDS 轨迹概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["rlds_episode_summary"]("run-1", "rlds", pathlib.Path(temp_dir) / "out", node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_rlds_episode_summary"]("run-1", "rlds", pathlib.Path(temp_dir) / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0]) payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "rlds") self.assertEqual(payload["datasetType"], "rlds")
@ -3887,7 +3847,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(video / "episode_000001.mp4").write_bytes(b"real-mp4-bytes-1") (video / "episode_000001.mp4").write_bytes(b"real-mp4-bytes-1")
node_data = {"label": "AgiBotWorld2026 数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "AgiBotWorld2026 数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["agibot_world2026_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_agibot_world2026_validate"](
"run-1", "agibot", root / "out", node_data, [] "run-1", "agibot", root / "out", node_data, []
) )
@ -3933,7 +3893,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(recordings / "camera_0.mp4").write_bytes(b"\x00\x00\x00\x18ftypmp42real-droid-video") (recordings / "camera_0.mp4").write_bytes(b"\x00\x00\x00\x18ftypmp42real-droid-video")
node_data = {"label": "DROID Raw Episode校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "DROID Raw Episode校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["droid_raw_episode_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_droid_raw_episode_validate"](
"run-1", "droid", root / "out", node_data, [] "run-1", "droid", root / "out", node_data, []
) )
@ -3997,7 +3957,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["libero_hdf5_task_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_libero_hdf5_task_validate"](
"run-1", "libero", root / "out", node_data, [] "run-1", "libero", root / "out", node_data, []
) )
@ -4050,7 +4010,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
mask.create_dataset("train", data=np.array([b"demo_0"])) mask.create_dataset("train", data=np.array([b"demo_0"]))
node_data = {"label": "RoboCasa HDF5示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "RoboCasa HDF5示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["robocasa_hdf5_demonstration_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_robocasa_hdf5_demonstration_validate"](
"run-1", "robocasa", root / "out", node_data, [] "run-1", "robocasa", root / "out", node_data, []
) )
@ -4111,7 +4071,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
pickle.dump(demo, handle) pickle.dump(demo, handle)
node_data = {"label": "FurnitureBench PKL示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path.parents[2])}]} node_data = {"label": "FurnitureBench PKL示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path.parents[2])}]}
artifacts = MODULE.BUILTIN_HANDLERS["furniturebench_pkl_demonstration_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_furniturebench_pkl_demonstration_validate"](
"run-1", "furniturebench", path.parents[2] / "out", node_data, [] "run-1", "furniturebench", path.parents[2] / "out", node_data, []
) )
@ -4166,7 +4126,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
user_control.create_dataset("user_control_times", data=np.array([1.0, 2.0, 3.0], dtype=np.float64)) user_control.create_dataset("user_control_times", data=np.array([1.0, 2.0, 3.0], dtype=np.float64))
node_data = {"label": "RoboTurk Real HDF5校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "RoboTurk Real HDF5校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["roboturk_real_hdf5_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_roboturk_real_hdf5_validate"](
"run-1", "roboturk-real", root / "out", node_data, [] "run-1", "roboturk-real", root / "out", node_data, []
) )
@ -4228,7 +4188,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["roboset_hdf5_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_roboset_hdf5_validate"](
"run-1", "roboset", root / "out", node_data, [] "run-1", "roboset", root / "out", node_data, []
) )
@ -4286,7 +4246,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
np.save(calib / "tcp.npy", np.ones((4, 4), dtype=np.float32)) np.save(calib / "tcp.npy", np.ones((4, 4), dtype=np.float32))
node_data = {"label": "RH20T 场景结构校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "RH20T 场景结构校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["rh20t_scene_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_rh20t_scene_validate"](
"run-1", "rh20t", root / "out", node_data, [] "run-1", "rh20t", root / "out", node_data, []
) )
@ -4360,7 +4320,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}], "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
} }
artifacts = MODULE.BUILTIN_HANDLERS["robomind_hdf5_quality_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_robomind_hdf5_quality_validate"](
"run-1", "robomind", root / "out", node_data, [] "run-1", "robomind", root / "out", node_data, []
) )
@ -4413,7 +4373,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
mask.create_dataset("train", data=np.array([b"demo_1"])) mask.create_dataset("train", data=np.array([b"demo_1"]))
node_data = {"label": "HDF5 示教数据概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]} node_data = {"label": "HDF5 示教数据概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["hdf5_demonstration_summary"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_hdf5_demonstration_summary"](
"run-1", "hdf5", pathlib.Path(temp_dir) / "out", node_data, [] "run-1", "hdf5", pathlib.Path(temp_dir) / "out", node_data, []
) )
@ -4444,7 +4404,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
handle.create_dataset("action", data=np.ones((3, 14), dtype="float32")) handle.create_dataset("action", data=np.ones((3, 14), dtype="float32"))
node_data = {"label": "ALOHA HDF5 示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]} node_data = {"label": "ALOHA HDF5 示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["aloha_hdf5_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_aloha_hdf5_validate"](
"run-1", "aloha", pathlib.Path(temp_dir) / "out", node_data, [] "run-1", "aloha", pathlib.Path(temp_dir) / "out", node_data, []
) )
@ -4494,7 +4454,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
mask.create_dataset("valid", data=np.array([b"demo_2"])) mask.create_dataset("valid", data=np.array([b"demo_2"]))
node_data = {"label": "robomimic HDF5 示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]} node_data = {"label": "robomimic HDF5 示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["robomimic_hdf5_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_robomimic_hdf5_validate"](
"run-1", "robomimic", pathlib.Path(temp_dir) / "out", node_data, [] "run-1", "robomimic", pathlib.Path(temp_dir) / "out", node_data, []
) )
@ -4529,7 +4489,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
pickle.dump(["pick up the cup"], handle) pickle.dump(["pick up the cup"], handle)
node_data = {"label": "RLBench 数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "RLBench 数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["rlbench_dataset_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_rlbench_dataset_validate"](
"run-1", "rlbench", root / "out", node_data, [] "run-1", "rlbench", root / "out", node_data, []
) )
@ -4567,7 +4527,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "ManiSkill 轨迹校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "ManiSkill 轨迹校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["maniskill_trajectory_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_maniskill_trajectory_validate"](
"run-1", "maniskill", root / "out", node_data, [] "run-1", "maniskill", root / "out", node_data, []
) )
@ -4604,7 +4564,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "CALVIN Episode 校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "CALVIN Episode 校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["calvin_episode_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_calvin_episode_validate"](
"run-1", "calvin", root / "out", node_data, [] "run-1", "calvin", root / "out", node_data, []
) )
@ -4638,7 +4598,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "RT-X动作空间Schema校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "RT-X动作空间Schema校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["rtx_action_schema_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_rtx_action_schema_validate"](
"run-1", "rtx-action", root / "out", node_data, [] "run-1", "rtx-action", root / "out", node_data, []
) )
@ -4678,7 +4638,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["embodiment_metadata_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_embodiment_metadata_validate"](
"run-1", "embodiment", root / "out", node_data, [] "run-1", "embodiment", root / "out", node_data, []
) )
@ -4706,7 +4666,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "力扭矩传感器数据校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "力扭矩传感器数据校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["force_torque_sensor_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_force_torque_sensor_validate"](
"run-1", "force", root / "out", node_data, [] "run-1", "force", root / "out", node_data, []
) )
@ -4737,7 +4697,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "数据集切分泄漏校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "数据集切分泄漏校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["dataset_split_leakage_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_split_leakage_validate"](
"run-1", "split-leakage", root / "out", node_data, [] "run-1", "split-leakage", root / "out", node_data, []
) )
@ -4782,7 +4742,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "媒体引用可读性校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "媒体引用可读性校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["media_reference_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_media_reference_validate"](
"run-1", "media", root / "out", node_data, [] "run-1", "media", root / "out", node_data, []
) )
@ -4830,7 +4790,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["dataset_schema_contract_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_schema_contract_validate"](
"run-1", "schema", root / "out", node_data, [] "run-1", "schema", root / "out", node_data, []
) )
@ -4885,7 +4845,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "LeRobot 数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "LeRobot 数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["lerobot_dataset_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_lerobot_dataset_validate"](
"run-1", "lerobot-validate", pathlib.Path(temp_dir) / "out", node_data, [] "run-1", "lerobot-validate", pathlib.Path(temp_dir) / "out", node_data, []
) )
@ -4962,7 +4922,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}], "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
} }
artifacts = MODULE.BUILTIN_HANDLERS["lerobot_metadata_consistency_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_lerobot_metadata_consistency_validate"](
"run-1", "lerobot-meta", root / "out", node_data, [] "run-1", "lerobot-meta", root / "out", node_data, []
) )
@ -5035,7 +4995,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}], "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
} }
artifacts = MODULE.BUILTIN_HANDLERS["lerobot_v3_episode_index_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_lerobot_v3_episode_index_validate"](
"run-1", "lerobot-v3-index", root / "out", node_data, [] "run-1", "lerobot-v3-index", root / "out", node_data, []
) )
@ -5111,7 +5071,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "LeRobot 视频对齐校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "LeRobot 视频对齐校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["lerobot_video_alignment_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_lerobot_video_alignment_validate"](
"run-1", "lerobot-video", root / "out", node_data, [] "run-1", "lerobot-video", root / "out", node_data, []
) )
@ -5154,7 +5114,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}], "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
} }
artifacts = MODULE.BUILTIN_HANDLERS["trajectory_integrity_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_trajectory_integrity_validate"](
"run-1", "trajectory", pathlib.Path(temp_dir) / "out", node_data, [] "run-1", "trajectory", pathlib.Path(temp_dir) / "out", node_data, []
) )
@ -5198,7 +5158,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}], "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
} }
artifacts = MODULE.BUILTIN_HANDLERS["action_state_quality_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_action_state_quality_validate"](
"run-1", "action-state", root / "out", node_data, [] "run-1", "action-state", root / "out", node_data, []
) )
@ -5239,7 +5199,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "Episode 边界校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "Episode 边界校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["episode_boundary_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_episode_boundary_validate"](
"run-1", "episode-boundary", root / "out", node_data, [] "run-1", "episode-boundary", root / "out", node_data, []
) )
@ -5319,7 +5279,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["dataset_split_manifest"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_split_manifest"](
"run-1", "split", pathlib.Path(temp_dir) / "out", node_data, [] "run-1", "split", pathlib.Path(temp_dir) / "out", node_data, []
) )
@ -5332,6 +5292,61 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
self.assertTrue(csv_path.exists()) self.assertTrue(csv_path.exists())
self.assertEqual(artifacts[1]["name"], "dataset-split-manifest.csv") self.assertEqual(artifacts[1]["name"], "dataset-split-manifest.csv")
def test_dataset_split_manifest_keeps_lerobot_episode_index_zero(self):
with tempfile.TemporaryDirectory() as temp_dir:
root = pathlib.Path(temp_dir) / "lerobot"
(root / "meta").mkdir(parents=True)
(root / "meta" / "episodes.jsonl").write_text(
"\n".join(json.dumps({"episode_index": index, "tasks": ["pick"], "length": 100 + index}) for index in range(3)),
encoding="utf-8",
)
node_data = {
"label": "训练切分清单生成",
"hyperparams": [
{"key": "SOURCE_PATH", "value": str(root)},
{"key": "TRAIN_RATIO", "value": "1"},
{"key": "VAL_RATIO", "value": "0"},
{"key": "TEST_RATIO", "value": "0"},
],
}
artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_split_manifest"](
"run-1", "split", pathlib.Path(temp_dir) / "out", node_data, []
)
payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["episodeCount"], 3)
self.assertEqual(sorted(item["episodeId"] for item in payload["items"]), ["0", "1", "2"])
def test_dataset_split_leakage_validate_reads_upstream_split_manifest(self):
with tempfile.TemporaryDirectory() as temp_dir:
root = pathlib.Path(temp_dir) / "lerobot"
(root / "meta").mkdir(parents=True)
(root / "meta" / "episodes.jsonl").write_text(
"\n".join(json.dumps({"episode_index": index, "tasks": ["pick"], "length": 100}) for index in range(12)),
encoding="utf-8",
)
split_node = {"label": "训练切分清单生成", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
split_artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_split_manifest"](
"run-1", "split", pathlib.Path(temp_dir) / "split", split_node, []
)
leakage_node = {"label": "数据集切分泄漏校验", "hyperparams": [{"key": "REQUIRED_SPLITS", "value": "train"}]}
# The split manifest records the episodes file as its sourcePath; the validator must
# read the manifest itself, not the unsplit episodes it was generated from.
artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_split_leakage_validate"](
"run-1", "leakage", pathlib.Path(temp_dir) / "leakage", leakage_node, split_artifacts
)
payload = MODULE.load_artifact_payload(artifacts[0])
split_payload = MODULE.load_artifact_payload(split_artifacts[0])
self.assertEqual(payload["episodeCount"], 12)
self.assertEqual(
payload["splitCounts"],
{name: count for name, count in split_payload["splitCounts"].items() if count},
)
self.assertNotIn("missing_split", [issue["code"] for issue in payload["issues"]])
def test_mcap_topic_summary_reads_real_mcap_messages(self): def test_mcap_topic_summary_reads_real_mcap_messages(self):
try: try:
from mcap.writer import Writer # type: ignore from mcap.writer import Writer # type: ignore
@ -5359,7 +5374,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
writer.finish() writer.finish()
node_data = {"label": "MCAP 主题概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]} node_data = {"label": "MCAP 主题概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["mcap_topic_summary"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_mcap_topic_summary"](
"run-1", "mcap", pathlib.Path(temp_dir) / "out", node_data, [] "run-1", "mcap", pathlib.Path(temp_dir) / "out", node_data, []
) )
@ -5376,9 +5391,9 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
length_bytes = struct.pack("<Q", len(payload)) length_bytes = struct.pack("<Q", len(payload))
return ( return (
length_bytes length_bytes
+ struct.pack("<I", MODULE.tfrecord_structural_validate_operator._masked_crc32c(length_bytes)) + struct.pack("<I", MODULE.load_operator_module("tfrecord_structural_validate")._masked_crc32c(length_bytes))
+ payload + payload
+ struct.pack("<I", MODULE.tfrecord_structural_validate_operator._masked_crc32c(payload)) + struct.pack("<I", MODULE.load_operator_module("tfrecord_structural_validate")._masked_crc32c(payload))
) )
with tempfile.TemporaryDirectory() as temp_dir: with tempfile.TemporaryDirectory() as temp_dir:
@ -5389,7 +5404,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "TFRecord 结构校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]} node_data = {"label": "TFRecord 结构校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["tfrecord_structural_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_tfrecord_structural_validate"](
"run-1", "tfrecord", pathlib.Path(temp_dir) / "out", node_data, [] "run-1", "tfrecord", pathlib.Path(temp_dir) / "out", node_data, []
) )
@ -5406,9 +5421,9 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
length_bytes = struct.pack("<Q", len(payload)) length_bytes = struct.pack("<Q", len(payload))
return ( return (
length_bytes length_bytes
+ struct.pack("<I", MODULE.bridgedata_tfds_manifest_validate_operator._masked_crc32c(length_bytes)) + struct.pack("<I", MODULE.load_operator_module("bridgedata_tfds_manifest_validate")._masked_crc32c(length_bytes))
+ payload + payload
+ struct.pack("<I", MODULE.bridgedata_tfds_manifest_validate_operator._masked_crc32c(payload)) + struct.pack("<I", MODULE.load_operator_module("bridgedata_tfds_manifest_validate")._masked_crc32c(payload))
) )
with tempfile.TemporaryDirectory() as temp_dir: with tempfile.TemporaryDirectory() as temp_dir:
@ -5444,7 +5459,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}], "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
} }
artifacts = MODULE.BUILTIN_HANDLERS["bridgedata_tfds_manifest_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_bridgedata_tfds_manifest_validate"](
"run-1", "bridge", root / "out", node_data, [] "run-1", "bridge", root / "out", node_data, []
) )
@ -5479,7 +5494,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "数据集来源许可审计", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "数据集来源许可审计", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["dataset_provenance_audit"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_provenance_audit"](
"run-1", "provenance", pathlib.Path(temp_dir) / "out", node_data, [] "run-1", "provenance", pathlib.Path(temp_dir) / "out", node_data, []
) )
@ -5507,7 +5522,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
archive.addfile(info, io.BytesIO(payload)) archive.addfile(info, io.BytesIO(payload))
node_data = {"label": "WebDataset 分片概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(shard_path)}]} node_data = {"label": "WebDataset 分片概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(shard_path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["webdataset_shard_summary"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_webdataset_shard_summary"](
"run-1", "webdataset", root / "out", node_data, [] "run-1", "webdataset", root / "out", node_data, []
) )
@ -5555,7 +5570,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(array_path / "0").write_bytes(b"chunk-bytes") (array_path / "0").write_bytes(b"chunk-bytes")
node_data = {"label": "Zarr 轨迹数组概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "Zarr 轨迹数组概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["zarr_trajectory_summary"]("run-1", "zarr", root / "out", node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_zarr_trajectory_summary"]("run-1", "zarr", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0]) payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "zarr-trajectory-summary") self.assertEqual(payload["datasetType"], "zarr-trajectory-summary")
@ -5589,7 +5604,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
create_array(meta, "episode_ends", np.array([2, 5], dtype=np.int64), chunks=(2,)) create_array(meta, "episode_ends", np.array([2, 5], dtype=np.int64), chunks=(2,))
node_data = {"label": "UMI Zarr数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root.parent)}]} node_data = {"label": "UMI Zarr数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root.parent)}]}
artifacts = MODULE.BUILTIN_HANDLERS["umi_zarr_dataset_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_umi_zarr_dataset_validate"](
"run-1", "umi-zarr", root / "out", node_data, [] "run-1", "umi-zarr", root / "out", node_data, []
) )
@ -5623,7 +5638,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "相机标定校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "相机标定校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["camera_calibration_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_camera_calibration_validate"](
"run-1", "calibration", root / "out", node_data, [] "run-1", "calibration", root / "out", node_data, []
) )
@ -5653,7 +5668,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "机器人模型资产校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(package)}]} node_data = {"label": "机器人模型资产校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(package)}]}
artifacts = MODULE.BUILTIN_HANDLERS["robot_model_asset_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_robot_model_asset_validate"](
"run-1", "robot-model", package / "out", node_data, [] "run-1", "robot-model", package / "out", node_data, []
) )
@ -5724,7 +5739,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["partnet_mobility_asset_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_partnet_mobility_asset_validate"](
"run-1", "partnet", root / "out", node_data, [] "run-1", "partnet", root / "out", node_data, []
) )
@ -5773,7 +5788,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "MJCF 执行器校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "MJCF 执行器校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["mjcf_actuator_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_mjcf_actuator_validate"](
"run-1", "mjcf-actuator", root / "out", node_data, [] "run-1", "mjcf-actuator", root / "out", node_data, []
) )
@ -5812,7 +5827,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(root / "transforms.jsonl").write_text("\n".join(json.dumps(row) for row in rows), encoding="utf-8") (root / "transforms.jsonl").write_text("\n".join(json.dumps(row) for row in rows), encoding="utf-8")
node_data = {"label": "TF 坐标树校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "TF 坐标树校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["tf_transform_tree_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_tf_transform_tree_validate"](
"run-1", "tf-tree", root / "out", node_data, [] "run-1", "tf-tree", root / "out", node_data, []
) )
@ -5848,7 +5863,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(root / "joint_states.jsonl").write_text("\n".join(json.dumps(row) for row in rows), encoding="utf-8") (root / "joint_states.jsonl").write_text("\n".join(json.dumps(row) for row in rows), encoding="utf-8")
node_data = {"label": "ROS JointState 校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "ROS JointState 校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["ros_joint_state_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_ros_joint_state_validate"](
"run-1", "joint-state", root / "out", node_data, [] "run-1", "joint-state", root / "out", node_data, []
) )
@ -5897,7 +5912,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}], "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
} }
artifacts = MODULE.BUILTIN_HANDLERS["dexycb_dataset_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_dexycb_dataset_validate"](
"run-1", "dexycb", root / "out", node_data, [] "run-1", "dexycb", root / "out", node_data, []
) )
@ -5996,7 +6011,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["bop_dataset_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_bop_dataset_validate"](
"run-1", "bop", root / "out", node_data, [] "run-1", "bop", root / "out", node_data, []
) )
@ -6073,7 +6088,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["graspnet_dataset_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_graspnet_dataset_validate"](
"run-1", "graspnet", root / "out", node_data, [] "run-1", "graspnet", root / "out", node_data, []
) )
@ -6149,7 +6164,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["ho3d_dataset_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_ho3d_dataset_validate"](
"run-1", "ho3d", root / "out", node_data, [] "run-1", "ho3d", root / "out", node_data, []
) )
@ -6229,7 +6244,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["hand_object_pose_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_hand_object_pose_validate"](
"run-1", "hand-object", root / "out", node_data, [] "run-1", "hand-object", root / "out", node_data, []
) )
@ -6245,7 +6260,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
self.assertEqual(payload["missingMaskCount"], 0) self.assertEqual(payload["missingMaskCount"], 0)
def test_hand_removal_consumes_sam_mask_and_calls_propainter(self): def test_hand_removal_consumes_sam_mask_and_calls_propainter(self):
hand_removal_module = MODULE.load_operator_module("backend.operators.builtin.hand_removal.operator") hand_removal_module = MODULE.load_operator_module("hand_removal")
health = {"status": "ok", "model": "ProPainter", "device": "cuda"} health = {"status": "ok", "model": "ProPainter", "device": "cuda"}
result = {"status": "success", "outputVideoUrl": "/api/media/clean.mp4", "frameCount": 12} result = {"status": "success", "outputVideoUrl": "/api/media/clean.mp4", "frameCount": 12}
calls: list[str] = [] calls: list[str] = []
@ -6286,7 +6301,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
{"name": "sam3-hand-mask.mp4", "type": "file", "path": str(mask_path), "portId": "in-mask"}, {"name": "sam3-hand-mask.mp4", "type": "file", "path": str(mask_path), "portId": "in-mask"},
] ]
with mock.patch.object(hand_removal_module.request, "urlopen", side_effect=fake_urlopen): with mock.patch.object(hand_removal_module.request, "urlopen", side_effect=fake_urlopen):
artifacts = MODULE.BUILTIN_HANDLERS["hand_removal"]("run-1", "remove-hands", output_dir, node_data, inputs) artifacts = MODULE.BUILTIN_HANDLERS["builtin_hand_removal"]("run-1", "remove-hands", output_dir, node_data, inputs)
names = {artifact["name"] for artifact in artifacts} names = {artifact["name"] for artifact in artifacts}
self.assertEqual(names, {"hand-removal-result.json", "hand-removed.mp4"}) self.assertEqual(names, {"hand-removal-result.json", "hand-removed.mp4"})
@ -6298,7 +6313,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
self.assertIn("http://propainter.example/api/inpaint/video", calls) self.assertIn("http://propainter.example/api/inpaint/video", calls)
def test_wilor_hand_pose_calls_service_and_downloads_outputs(self): def test_wilor_hand_pose_calls_service_and_downloads_outputs(self):
wilor_module = MODULE.load_operator_module("backend.operators.builtin.wilor_hand_pose.operator") wilor_module = MODULE.load_operator_module("wilor_hand_pose")
health = { health = {
"status": "ok", "status": "ok",
"model": { "model": {
@ -6360,7 +6375,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
with mock.patch.object(wilor_module.request, "urlopen", side_effect=fake_urlopen): with mock.patch.object(wilor_module.request, "urlopen", side_effect=fake_urlopen):
artifacts = MODULE.BUILTIN_HANDLERS["wilor_hand_pose"]("run-1", "wilor", output_dir, node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_wilor_hand_pose"]("run-1", "wilor", output_dir, node_data, [])
names = {artifact["name"] for artifact in artifacts} names = {artifact["name"] for artifact in artifacts}
self.assertEqual( self.assertEqual(
@ -6378,7 +6393,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
self.assertIn("http://wilor.example/api/infer", calls) self.assertIn("http://wilor.example/api/infer", calls)
def test_wilor_hand_pose_prefers_upstream_media_file_over_source_manifest(self): def test_wilor_hand_pose_prefers_upstream_media_file_over_source_manifest(self):
wilor_module = MODULE.load_operator_module("backend.operators.builtin.wilor_hand_pose.operator") wilor_module = MODULE.load_operator_module("wilor_hand_pose")
self.assertEqual( self.assertEqual(
wilor_module._first_media_ref_from_payload( wilor_module._first_media_ref_from_payload(
{"entries": [{"value": {"url": "http://wilor.example/examples/from-manifest.png"}}]} {"entries": [{"value": {"url": "http://wilor.example/examples/from-manifest.png"}}]}
@ -6452,7 +6467,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
{"name": "sample-hands.png", "type": "image", "path": str(image_path), "portId": "out-1"}, {"name": "sample-hands.png", "type": "image", "path": str(image_path), "portId": "out-1"},
] ]
with mock.patch.object(wilor_module.request, "urlopen", side_effect=fake_urlopen): with mock.patch.object(wilor_module.request, "urlopen", side_effect=fake_urlopen):
artifacts = MODULE.BUILTIN_HANDLERS["wilor_hand_pose"]("run-1", "wilor", output_dir, node_data, inputs) artifacts = MODULE.BUILTIN_HANDLERS["builtin_wilor_hand_pose"]("run-1", "wilor", output_dir, node_data, inputs)
payload = MODULE.load_artifact_payload(next(item for item in artifacts if item["name"] == "wilor-result.json")) payload = MODULE.load_artifact_payload(next(item for item in artifacts if item["name"] == "wilor-result.json"))
self.assertEqual(payload["status"], "success") self.assertEqual(payload["status"], "success")
@ -6497,7 +6512,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "URDF 关节限位校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "URDF 关节限位校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["joint_limit_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_joint_limit_validate"](
"run-1", "joint-limit", root / "out", node_data, [] "run-1", "joint-limit", root / "out", node_data, []
) )
@ -6544,7 +6559,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "点云数据概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "点云数据概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["pointcloud_summary"]("run-1", "pointcloud", root / "out", node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_pointcloud_summary"]("run-1", "pointcloud", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0]) payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "pointcloud-summary") self.assertEqual(payload["datasetType"], "pointcloud-summary")
@ -6578,7 +6593,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["sensor_timestamp_sync_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_sensor_timestamp_sync_validate"](
"run-1", "timestamp-sync", root / "out", node_data, [] "run-1", "timestamp-sync", root / "out", node_data, []
) )
@ -6615,7 +6630,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
], ],
} }
artifacts = MODULE.BUILTIN_HANDLERS["parquet_table_summary"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_parquet_table_summary"](
"run-1", "parquet", root / "out", node_data, [] "run-1", "parquet", root / "out", node_data, []
) )
@ -6655,7 +6670,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "COCO 标注校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "COCO 标注校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["coco_annotation_validate"]("run-1", "coco", root / "out", node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_coco_annotation_validate"]("run-1", "coco", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0]) payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "coco-annotation-validation") self.assertEqual(payload["datasetType"], "coco-annotation-validation")
@ -6675,7 +6690,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(root / "data.yaml").write_text("names: [cube]\n", encoding="utf-8") (root / "data.yaml").write_text("names: [cube]\n", encoding="utf-8")
node_data = {"label": "YOLO 检测标注校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "YOLO 检测标注校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["yolo_detection_validate"]("run-1", "yolo", root / "out", node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_yolo_detection_validate"]("run-1", "yolo", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0]) payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "yolo-detection-validation") self.assertEqual(payload["datasetType"], "yolo-detection-validation")
@ -6697,7 +6712,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
class_names = ["person", "bicycle", "car", *[f"class_{index}" for index in range(3, 80)]] class_names = ["person", "bicycle", "car", *[f"class_{index}" for index in range(3, 80)]]
detections = list( detections = list(
MODULE.video_target_clip_operator._iter_dnn_detections_from_output( MODULE.load_operator_module("video_target_clip")._iter_dnn_detections_from_output(
output, output,
class_names, class_names,
0.2, 0.2,
@ -6726,7 +6741,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
class_names = ["person", "bicycle", "car", "motorcycle", *[f"class_{index}" for index in range(4, 80)]] class_names = ["person", "bicycle", "car", "motorcycle", *[f"class_{index}" for index in range(4, 80)]]
detections = list( detections = list(
MODULE.video_target_clip_operator._iter_dnn_detections_from_output( MODULE.load_operator_module("video_target_clip")._iter_dnn_detections_from_output(
output, output,
class_names, class_names,
0.2, 0.2,
@ -6768,7 +6783,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "RGB-D 帧对齐校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "RGB-D 帧对齐校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["rgbd_frame_pair_validate"]("run-1", "rgbd", root / "out", node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_rgbd_frame_pair_validate"]("run-1", "rgbd", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0]) payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "rgbd-frame-pair-validation") self.assertEqual(payload["datasetType"], "rgbd-frame-pair-validation")
@ -6798,7 +6813,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}, {"key": "CLASS_IDS", "value": "0,1,2"}], "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}, {"key": "CLASS_IDS", "value": "0,1,2"}],
} }
artifacts = MODULE.BUILTIN_HANDLERS["segmentation_mask_validate"]("run-1", "mask", root / "out", node_data, []) artifacts = MODULE.BUILTIN_HANDLERS["builtin_segmentation_mask_validate"]("run-1", "mask", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0]) payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "segmentation-mask-validation") self.assertEqual(payload["datasetType"], "segmentation-mask-validation")
@ -6819,7 +6834,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
) )
node_data = {"label": "语言指令校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]} node_data = {"label": "语言指令校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["language_instruction_validate"]( artifacts = MODULE.BUILTIN_HANDLERS["builtin_language_instruction_validate"](
"run-1", "language", root / "out", node_data, [] "run-1", "language", root / "out", node_data, []
) )

View File

@ -1,26 +1,20 @@
# Operator Repositories # Operator runtime helpers
This directory is the single local home for built-in operator repositories. Built-in operator source and metadata have one source of truth under `operator-repos/builtin/<slug>/`.
Each operator uses `src/operator.py`, `operator.json`, and `repository.json` from that directory.
The per-operator copies formerly under `backend/operators/builtin/<slug>/` have been removed.
Each built-in operator has a directory under `backend/operators/builtin/<operator-slug>/`. The Python modules directly under `backend/operators/builtin/` are shared runtime libraries
Executable operator code should live in that operator directory when a handler is migrated (such as structured model and HoloBrain helpers), imported by canonical operator sources.
out of the legacy `backend/operator-runner/main.py` runner. The runner remains the stable They are not alternative operator repositories or compatibility entrypoints.
container entrypoint and delegates to migrated operator modules.
Repository contract: `backend/operator-runner/main.py` dispatches only explicit handler identifiers declared in
the current catalog. It does not infer handlers from labels or expand naming aliases.
- `operator.py` is the executable module for that operator. Validate generated contracts with:
- `operator.json` is the platform catalog/runtime metadata for that operator.
- `repository.json` is the local repository manifest for that operator directory. It records
repository identity, entrypoint, runtime dependencies, external acceptance requirements,
and the no-mock/no-simulation/no-hardcoded-output acceptance policy.
- Regenerate manifests with `python3 scripts/generate_operator_repository_manifests.py --write`
and verify drift with `python3 scripts/generate_operator_repository_manifests.py --check`.
Acceptance requirements: ```bash
python3 scripts/generate_operator_repositories.py --check
- Use real input files, JSON payloads, command execution, or storage clients in tests. python3 scripts/generate_operator_repository_manifests.py --check
- Do not add mock-only, simulation-only, hard-coded, or shallow-only acceptance paths. python3 scripts/generate_operator_images.py --check
- Keep catalog metadata in `internal/api/builtin_operators_catalog.json` aligned with ```
the operator directory metadata.
- Keep public operator docs in `docs/operators/` aligned with runtime handlers.

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-act-policy-train",
"name": "ACT 策略训练",
"category": "AI",
"type": "builtin",
"runtimeHandler": "builtin_act_policy_train",
"runtimeSource": "backend/operators/builtin/act_policy_train/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,16 +0,0 @@
from __future__ import annotations
from typing import Any
from backend.operators.builtin.structured_model_operator import HelperMap, run_lerobot_act_training
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
return run_lerobot_act_training(run_id, node_id, output_dir, node_data, inputs, helpers)

View File

@ -1,79 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "AI",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-act-policy-train:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-act-policy-train@sha256:d24b5417b2eab1abf5bb07a1d66d38306ea5545226d3f2a3e34bb5aee184f4f2",
"metadata": "operator.json",
"name": "ACT 策略训练",
"operatorId": "operator-builtin-act-policy-train",
"operatorSlug": "act_policy_train",
"preferredSlug": "act_policy_train",
"pythonImport": "backend.operators.builtin.act_policy_train.operator:run",
"repositoryId": "builtin/act_policy_train",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": true,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_act_policy_train",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-act-policy-train",
"operatorSlug": "act_policy_train",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 1,
"recommendedGpuType": "NVIDIA A800 80GB",
"requiresGpu": true
},
"runtimeDependencies": [
"huggingface-lerobot-act",
"lerobot-dataset-or-local-root",
"gpu-a800"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"huggingface-lerobot-act",
"lerobot-dataset-or-local-root",
"gpu-a800"
],
"runtimeHandler": "builtin_act_policy_train",
"runtimeSource": "backend/operators/builtin/act_policy_train/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/act_policy_train",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-action-state-quality-validate",
"name": "动作状态数值质量校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_action_state_quality_validate",
"runtimeSource": "backend/operators/builtin/action_state_quality_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,360 +0,0 @@
from __future__ import annotations
import json
import math
import pathlib
from typing import Any, Callable
import pyarrow.parquet as pq
HelperMap = dict[str, Callable[..., Any]]
SUPPORTED_SUFFIXES = {".json", ".jsonl", ".parquet"}
DEFAULT_ACTION_FIELDS = ("action", "actions", "control", "command")
DEFAULT_STATE_FIELDS = (
"observation.state",
"state",
"states",
"observation.joint_positions",
"joint_positions",
"proprio",
)
def _positive_int(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, "") or "").strip()
if not raw:
return default
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _positive_float(params: dict[str, str], key: str, default: float) -> float:
raw = str(params.get(key, "") or "").strip()
if not raw:
return default
try:
value = float(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be numeric") from exc
if not math.isfinite(value) or value <= 0:
raise RuntimeError(f"{key} must be a positive finite number")
return value
def _field_list(raw: str, default: tuple[str, ...]) -> list[str]:
fields = [item.strip() for item in str(raw or "").split(",") if item.strip()]
return fields or list(default)
def _candidate_files(path: pathlib.Path) -> list[pathlib.Path]:
if path.is_file():
return [path] if path.suffix.lower() in SUPPORTED_SUFFIXES else []
data_root = path / "data"
if data_root.is_dir():
data_files = sorted(candidate for candidate in data_root.rglob("*.parquet") if candidate.is_file())
if data_files:
return data_files
preferred = [
path / "data" / "chunk-000" / "episode_000000.parquet",
path / "episodes.jsonl",
path / "trajectory.jsonl",
path / "data.jsonl",
]
files = [item for item in preferred if item.is_file() and item.suffix.lower() in SUPPORTED_SUFFIXES]
seen = {item.resolve() for item in files}
for candidate in sorted(path.rglob("*")):
if not candidate.is_file() or candidate.suffix.lower() not in SUPPORTED_SUFFIXES:
continue
resolved = candidate.resolve()
if resolved in seen:
continue
files.append(candidate)
seen.add(resolved)
return files
def _json_rows(payload: Any) -> list[dict[str, Any]]:
if isinstance(payload, dict):
for key in ("rows", "steps", "frames", "items"):
values = payload.get(key)
if isinstance(values, list):
return [item for item in values if isinstance(item, dict)]
for key in ("episodes", "trajectories"):
episodes = payload.get(key)
if isinstance(episodes, list):
return _episode_rows(episodes)
return [payload]
if isinstance(payload, list):
if all(isinstance(item, dict) and isinstance(item.get("steps"), list) for item in payload):
return _episode_rows(payload)
return [item for item in payload if isinstance(item, dict)]
return []
def _episode_rows(episodes: list[Any]) -> list[dict[str, Any]]:
rows: list[dict[str, Any]] = []
for fallback_index, episode in enumerate(episodes):
if not isinstance(episode, dict):
continue
episode_id = _first_present(episode, ("episode_index", "episode_id", "episodeId", "id"), fallback_index)
steps = episode.get("steps")
if not isinstance(steps, list):
continue
for step_index, step in enumerate(steps):
if not isinstance(step, dict):
continue
row = dict(step)
row.setdefault("episode_index", episode_id)
row.setdefault("frame_index", step_index)
rows.append(row)
return rows
def _load_rows(path: pathlib.Path, remaining: int) -> list[dict[str, Any]]:
suffix = path.suffix.lower()
if suffix == ".jsonl":
rows: list[dict[str, Any]] = []
with path.open("r", encoding="utf-8") as handle:
for line_number, line in enumerate(handle, start=1):
if len(rows) >= remaining:
break
stripped = line.strip()
if not stripped:
continue
try:
payload = json.loads(stripped)
except json.JSONDecodeError as exc:
raise RuntimeError(f"{path} line {line_number} is not valid JSON") from exc
rows.extend(_json_rows(payload))
return rows[:remaining]
if suffix == ".json":
try:
return _json_rows(json.loads(path.read_text(encoding="utf-8")))[:remaining]
except json.JSONDecodeError as exc:
raise RuntimeError(f"{path} is not valid JSON") from exc
if suffix == ".parquet":
parquet_file = pq.ParquetFile(path)
rows: list[dict[str, Any]] = []
for batch in parquet_file.iter_batches(batch_size=min(max(remaining, 1), 4096)):
rows.extend(item for item in batch.to_pylist() if isinstance(item, dict))
if len(rows) >= remaining:
break
return rows[:remaining]
return []
def _first_present(payload: dict[str, Any], fields: tuple[str, ...], fallback: Any = "") -> Any:
for field in fields:
value = payload.get(field)
if value is not None and str(value).strip():
return value
return fallback
def _get_value(payload: dict[str, Any], path: str) -> Any:
if path in payload:
return payload[path]
current: Any = payload
for part in path.split("."):
if isinstance(current, dict) and part in current:
current = current[part]
else:
return None
return current
def _flatten_numeric(value: Any) -> tuple[list[float], int]:
if value is None or value == "":
return [], 0
if isinstance(value, bool):
return [], 1
if isinstance(value, (int, float)):
return [float(value)], 0
if isinstance(value, (list, tuple)):
result: list[float] = []
non_numeric = 0
for item in value:
values, invalid_count = _flatten_numeric(item)
result.extend(values)
non_numeric += invalid_count
return result, non_numeric
return [], 1
def _first_vector(row: dict[str, Any], fields: list[str]) -> tuple[str, list[float], int]:
for field in fields:
values, non_numeric = _flatten_numeric(_get_value(row, field))
if values or non_numeric:
return field, values, non_numeric
return "", [], 0
def _vector_stats(vectors: list[list[float]], low_variance_epsilon: float) -> dict[str, Any]:
if not vectors:
return {"dimension": 0, "min": [], "max": [], "mean": [], "lowVarianceDimensions": []}
dimension = len(vectors[0])
mins = [float("inf")] * dimension
maxs = [float("-inf")] * dimension
sums = [0.0] * dimension
for vector in vectors:
for index, value in enumerate(vector[:dimension]):
mins[index] = min(mins[index], value)
maxs[index] = max(maxs[index], value)
sums[index] += value
count = max(len(vectors), 1)
low_variance = [index for index, (min_value, max_value) in enumerate(zip(mins, maxs)) if abs(max_value - min_value) <= low_variance_epsilon]
return {
"dimension": dimension,
"min": [round(value, 6) for value in mins],
"max": [round(value, 6) for value in maxs],
"mean": [round(value / count, 6) for value in sums],
"lowVarianceDimensions": low_variance,
}
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("动作状态数值质量校验需要 SOURCE_PATH 指向真实 JSON/JSONL/Parquet 数据")
max_rows = _positive_int(params, "MAX_ROWS", 10000)
max_files = _positive_int(params, "MAX_FILES", 50)
max_abs_value = _positive_float(params, "MAX_ABS_VALUE", 1_000_000.0)
low_variance_epsilon = _positive_float(params, "LOW_VARIANCE_EPSILON", 1e-9)
action_fields = _field_list(params.get("ACTION_FIELDS", ""), DEFAULT_ACTION_FIELDS)
state_fields = _field_list(params.get("STATE_FIELDS", ""), DEFAULT_STATE_FIELDS)
rows: list[dict[str, Any]] = []
parsed_files: list[str] = []
for file_path in _candidate_files(source_path)[:max_files]:
next_rows = _load_rows(file_path, max(1, max_rows - len(rows)))
if next_rows:
parsed_files.append(str(file_path))
rows.extend(next_rows)
if len(rows) >= max_rows:
break
if not rows:
raise RuntimeError(f"{source_path} does not contain readable action/state rows")
action_vectors: list[list[float]] = []
state_vectors: list[list[float]] = []
action_field_counts: dict[str, int] = {}
state_field_counts: dict[str, int] = {}
missing_action = 0
missing_state = 0
non_numeric: list[dict[str, Any]] = []
non_finite: list[dict[str, Any]] = []
out_of_range: list[dict[str, Any]] = []
action_dimension: int | None = None
state_dimension: int | None = None
action_dimension_issues: list[dict[str, Any]] = []
state_dimension_issues: list[dict[str, Any]] = []
for row_index, row in enumerate(rows):
action_field, action_values, action_non_numeric = _first_vector(row, action_fields)
state_field, state_values, state_non_numeric = _first_vector(row, state_fields)
if not action_field:
missing_action += 1
if not state_field:
missing_state += 1
if action_non_numeric:
non_numeric.append({"rowIndex": row_index, "field": action_field or "action", "count": action_non_numeric})
if state_non_numeric:
non_numeric.append({"rowIndex": row_index, "field": state_field or "state", "count": state_non_numeric})
for family, field, values in (("action", action_field, action_values), ("state", state_field, state_values)):
if not values:
continue
invalid_indexes = [index for index, value in enumerate(values) if not math.isfinite(value)]
if invalid_indexes:
non_finite.append({"rowIndex": row_index, "family": family, "field": field, "indexes": invalid_indexes[:50]})
continue
large_indexes = [index for index, value in enumerate(values) if abs(value) > max_abs_value]
if large_indexes:
out_of_range.append({"rowIndex": row_index, "family": family, "field": field, "indexes": large_indexes[:50]})
if family == "action":
action_field_counts[field] = action_field_counts.get(field, 0) + 1
if action_dimension is None:
action_dimension = len(values)
elif len(values) != action_dimension:
action_dimension_issues.append({"rowIndex": row_index, "expected": action_dimension, "actual": len(values)})
continue
action_vectors.append(values)
else:
state_field_counts[field] = state_field_counts.get(field, 0) + 1
if state_dimension is None:
state_dimension = len(values)
elif len(values) != state_dimension:
state_dimension_issues.append({"rowIndex": row_index, "expected": state_dimension, "actual": len(values)})
continue
state_vectors.append(values)
issues: list[dict[str, Any]] = []
if missing_action:
issues.append({"code": "missing_action_rows", "count": missing_action})
if missing_state:
issues.append({"code": "missing_state_rows", "count": missing_state})
if non_numeric:
issues.append({"code": "non_numeric_values", "count": len(non_numeric), "examples": non_numeric[:100]})
if non_finite:
issues.append({"code": "non_finite_values", "count": len(non_finite), "examples": non_finite[:100]})
if out_of_range:
issues.append({"code": "out_of_range_values", "count": len(out_of_range), "maxAbsValue": max_abs_value, "examples": out_of_range[:100]})
if action_dimension_issues:
issues.append({"code": "inconsistent_action_dimension", "count": len(action_dimension_issues), "examples": action_dimension_issues[:100]})
if state_dimension_issues:
issues.append({"code": "inconsistent_state_dimension", "count": len(state_dimension_issues), "examples": state_dimension_issues[:100]})
action_stats = _vector_stats(action_vectors, low_variance_epsilon)
state_stats = _vector_stats(state_vectors, low_variance_epsilon)
warnings: list[dict[str, Any]] = []
if action_stats["lowVarianceDimensions"]:
warnings.append({"code": "low_variance_action_dimensions", "indexes": action_stats["lowVarianceDimensions"][:100]})
if state_stats["lowVarianceDimensions"]:
warnings.append({"code": "low_variance_state_dimensions", "indexes": state_stats["lowVarianceDimensions"][:100]})
payload = {
"datasetType": "action-state-quality-validation",
"sourcePath": str(source_path),
"valid": not issues,
"issueCount": len(issues),
"warningCount": len(warnings),
"issues": issues,
"warnings": warnings,
"parsedFiles": parsed_files,
"rowCount": len(rows),
"actionRowCount": len(action_vectors),
"stateRowCount": len(state_vectors),
"missingActionCount": missing_action,
"missingStateCount": missing_state,
"actionFields": action_fields,
"stateFields": state_fields,
"actionFieldCounts": action_field_counts,
"stateFieldCounts": state_field_counts,
"actionDimension": action_dimension or 0,
"stateDimension": state_dimension or 0,
"actionStats": action_stats,
"stateStats": state_stats,
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"action-state-quality-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,77 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-action-state-quality-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-action-state-quality-validate@sha256:96055934c67458386848e774725ea4328cb0b1fe157e77a23e8586659e7b538d",
"metadata": "operator.json",
"name": "动作状态数值质量校验",
"operatorId": "operator-builtin-action-state-quality-validate",
"operatorSlug": "action_state_quality_validate",
"preferredSlug": "action_state_quality_validate",
"pythonImport": "backend.operators.builtin.action_state_quality_validate.operator:run",
"repositoryId": "builtin/action_state_quality_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_action_state_quality_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-action-state-quality-validate",
"operatorSlug": "action_state_quality_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"json-jsonl-parquet-files",
"pyarrow"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"json-jsonl-parquet-files",
"pyarrow"
],
"runtimeHandler": "builtin_action_state_quality_validate",
"runtimeSource": "backend/operators/builtin/action_state_quality_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/action_state_quality_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-agibot-world2026-validate",
"name": "AgiBotWorld2026 数据集校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_agibot_world2026_validate",
"runtimeSource": "backend/operators/builtin/agibot_world2026_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,523 +0,0 @@
from __future__ import annotations
import json
import pathlib
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
DEFAULT_CHUNK_SIZE = 1000
DEFAULT_MAX_PARQUET_FILES = 100
DEFAULT_REQUIRED_COLUMNS = ("episode_index", "frame_index", "timestamp", "action")
DEFAULT_DATA_TEMPLATES = (
"data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"data/chunk-{chunk_index:03d}/episode_{episode_index:06d}.parquet",
"data/episode_{episode_index:06d}.parquet",
)
DEFAULT_VIDEO_TEMPLATES = (
"videos/{video_key}/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.mp4",
"videos/{video_key}/episode_{episode_index:06d}.mp4",
)
DATA_PATH_KEYS = ("data_path", "dataPath", "file_path", "filePath", "parquet_path", "parquetPath", "path")
EPISODE_ID_KEYS = ("episode_index", "episodeIndex", "episode_id", "episodeId", "id")
LENGTH_KEYS = ("length", "num_frames", "frame_count", "episode_length")
def _require_pyarrow_parquet():
try:
import pyarrow.parquet as pq # type: ignore
except Exception as exc:
raise RuntimeError("AgiBotWorld2026 数据集校验需要 pyarrow 读取真实 Parquet 文件") from exc
return pq
def _positive_int(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, "") or "").strip()
if not raw:
return default
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _bool_param(helpers: HelperMap, params: dict[str, str], key: str, default: bool) -> bool:
return bool(helpers["parse_bool_param"](params, key, default))
def _csv_tokens(raw: str, default: tuple[str, ...]) -> list[str]:
values = [item.strip() for item in str(raw or "").split(",") if item.strip()]
return values or list(default)
def _load_json(path: pathlib.Path) -> dict[str, Any]:
if not path.is_file():
return {}
try:
payload = json.loads(path.read_text(encoding="utf-8"))
except json.JSONDecodeError as exc:
raise RuntimeError(f"{path} is not valid JSON") from exc
return payload if isinstance(payload, dict) else {}
def _load_jsonl(path: pathlib.Path) -> list[dict[str, Any]]:
rows: list[dict[str, Any]] = []
if not path.is_file():
return rows
with path.open("r", encoding="utf-8") as handle:
for line_number, line in enumerate(handle, start=1):
stripped = line.strip()
if not stripped:
continue
try:
payload = json.loads(stripped)
except json.JSONDecodeError as exc:
raise RuntimeError(f"{path} line {line_number} is not valid JSON") from exc
if isinstance(payload, dict):
rows.append(payload)
return rows
def _safe_int(value: Any, default: int = -1) -> int:
try:
return int(value)
except (TypeError, ValueError):
return default
def _first_int(row: dict[str, Any], keys: tuple[str, ...], default: int = -1) -> int:
for key in keys:
value = _safe_int(row.get(key), -1)
if value >= 0:
return value
return default
def _episode_index(row: dict[str, Any], fallback: int) -> int:
value = _first_int(row, EPISODE_ID_KEYS, -1)
return value if value >= 0 else fallback
def _episode_key(row: dict[str, Any], fallback: int) -> str:
return str(_episode_index(row, fallback))
def _episode_length(row: dict[str, Any]) -> int:
return _first_int(row, LENGTH_KEYS, -1)
def _relative(root: pathlib.Path, path: pathlib.Path) -> str:
try:
return path.relative_to(root).as_posix()
except ValueError:
return str(path)
def _find_dataset_root(source_path: pathlib.Path) -> pathlib.Path:
current = source_path if source_path.is_dir() else source_path.parent
for candidate in (current, *current.parents):
if (candidate / "meta" / "info.json").is_file() and (candidate / "data").exists():
return candidate
return current
def _episode_metadata_rows(meta_dir: pathlib.Path, pq: Any, max_files: int) -> tuple[list[dict[str, Any]], list[str]]:
rows: list[dict[str, Any]] = []
files: list[str] = []
jsonl_path = meta_dir / "episodes.jsonl"
if jsonl_path.is_file():
rows.extend({**row, "_metadataFile": jsonl_path.relative_to(meta_dir.parent).as_posix()} for row in _load_jsonl(jsonl_path))
files.append(jsonl_path.relative_to(meta_dir.parent).as_posix())
parquet_root = meta_dir / "episodes"
if parquet_root.is_dir():
for path in sorted(parquet_root.rglob("*.parquet"))[:max_files]:
table = pq.read_table(path)
relative = path.relative_to(meta_dir.parent).as_posix()
rows.extend({**row, "_metadataFile": relative} for row in table.to_pylist() if isinstance(row, dict))
files.append(relative)
return rows, files
def _task_rows(meta_dir: pathlib.Path, pq: Any, max_files: int) -> tuple[list[dict[str, Any]], list[str]]:
rows: list[dict[str, Any]] = []
files: list[str] = []
jsonl_path = meta_dir / "tasks.jsonl"
if jsonl_path.is_file():
rows.extend(_load_jsonl(jsonl_path))
files.append(jsonl_path.relative_to(meta_dir.parent).as_posix())
parquet_root = meta_dir / "tasks"
if parquet_root.is_dir():
for path in sorted(parquet_root.rglob("*.parquet"))[:max_files]:
table = pq.read_table(path)
rows.extend(row for row in table.to_pylist() if isinstance(row, dict))
files.append(path.relative_to(meta_dir.parent).as_posix())
return rows, files
def _data_parquet_paths(root: pathlib.Path, max_files: int) -> list[pathlib.Path]:
data_root = root / "data"
if not data_root.is_dir():
return []
return sorted(path for path in data_root.rglob("*.parquet") if path.is_file())[:max_files]
def _scan_data_file(path: pathlib.Path, root: pathlib.Path, pq: Any) -> dict[str, Any]:
parquet_file = pq.ParquetFile(path)
schema_names = list(parquet_file.schema_arrow.names)
row_count = int(parquet_file.metadata.num_rows)
episode_rows: dict[str, int] = {}
frame_ranges: dict[str, dict[str, int]] = {}
columns = [name for name in ("episode_index", "frame_index") if name in schema_names]
if "episode_index" in columns:
for batch in parquet_file.iter_batches(batch_size=4096, columns=columns):
payload = batch.to_pydict()
episode_values = payload.get("episode_index", [])
frame_values = payload.get("frame_index", [])
for index, episode_value in enumerate(episode_values):
episode = str(episode_value)
episode_rows[episode] = episode_rows.get(episode, 0) + 1
if frame_values:
frame_index = _safe_int(frame_values[index], -1)
if frame_index >= 0:
current = frame_ranges.get(episode)
if current is None:
frame_ranges[episode] = {"min": frame_index, "max": frame_index}
else:
current["min"] = min(current["min"], frame_index)
current["max"] = max(current["max"], frame_index)
return {
"path": _relative(root, path),
"rowCount": row_count,
"columns": schema_names,
"episodeRows": episode_rows,
"frameRanges": frame_ranges,
}
def _template_values(row: dict[str, Any], fallback: int, chunk_size: int, video_key: str = "") -> dict[str, Any]:
episode_index = _episode_index(row, fallback)
episode_chunk = _first_int(row, ("episode_chunk", "episodeChunk", "chunk_index", "chunkIndex"), -1)
if episode_chunk < 0:
episode_chunk = episode_index // chunk_size if episode_index >= 0 else 0
return {
"episode_index": episode_index,
"episode_id": episode_index,
"episode_chunk": episode_chunk,
"chunk_index": episode_chunk,
"video_key": video_key,
}
def _format_template(template: str, values: dict[str, Any]) -> str:
try:
return template.format(**values)
except (KeyError, ValueError):
return ""
def _templates(info: dict[str, Any], params: dict[str, str], param_key: str, info_keys: tuple[str, ...], defaults: tuple[str, ...]) -> list[str]:
explicit = str(params.get(param_key, "") or "").strip()
result: list[str] = [explicit] if explicit else []
for key in info_keys:
value = info.get(key)
if isinstance(value, str) and value.strip():
result.append(value.strip())
elif isinstance(value, dict):
result.extend(str(item).strip() for item in value.values() if isinstance(item, str) and item.strip())
result.extend(defaults)
deduped: list[str] = []
for template in result:
if template and template not in deduped:
deduped.append(template)
return deduped
def _explicit_path(row: dict[str, Any], keys: tuple[str, ...]) -> str:
for key in keys:
value = row.get(key)
if isinstance(value, str) and value.strip():
return value.strip()
return ""
def _resolve_existing(root: pathlib.Path, relative_or_absolute: str) -> pathlib.Path | None:
raw = str(relative_or_absolute or "").strip()
if not raw:
return None
candidate = pathlib.Path(raw)
if candidate.is_absolute():
return candidate if candidate.is_file() else None
resolved = root / raw
return resolved if resolved.is_file() else None
def _candidate_data_paths(root: pathlib.Path, info: dict[str, Any], params: dict[str, str], row: dict[str, Any], index: int, chunk_size: int) -> list[str]:
candidates: list[str] = []
explicit = _explicit_path(row, DATA_PATH_KEYS)
if explicit:
candidates.append(explicit)
values = _template_values(row, index, chunk_size)
for template in _templates(info, params, "DATA_PATH_TEMPLATE", ("data_path", "dataPath"), DEFAULT_DATA_TEMPLATES):
rendered = _format_template(template, values)
if rendered:
candidates.append(rendered)
result: list[str] = []
for candidate in candidates:
resolved = _resolve_existing(root, candidate)
if resolved is not None:
relative = _relative(root, resolved)
if relative not in result:
result.append(relative)
return result
def _feature_video_keys(info: dict[str, Any]) -> list[str]:
features = info.get("features")
keys: list[str] = []
if isinstance(features, dict):
for key, value in features.items():
if not isinstance(value, dict):
continue
dtype = str(value.get("dtype") or value.get("type") or "").lower()
if "video" in dtype or key.startswith("observation.images.") or key.startswith("observation.image."):
keys.append(str(key))
return keys
def _param_video_keys(params: dict[str, str], info: dict[str, Any]) -> list[str]:
values = _csv_tokens(params.get("VIDEO_KEYS", ""), tuple(_feature_video_keys(info)))
return list(dict.fromkeys(values))
def _explicit_video_paths(row: dict[str, Any]) -> list[str]:
for key in ("video_path", "videoPath", "video_paths", "videoPaths", "videos"):
value = row.get(key)
if isinstance(value, str) and value.strip():
return [value.strip()]
if isinstance(value, dict):
return [str(item).strip() for item in value.values() if isinstance(item, str) and str(item).strip()]
if isinstance(value, list):
return [str(item).strip() for item in value if isinstance(item, str) and str(item).strip()]
return []
def _candidate_video_paths(
root: pathlib.Path,
info: dict[str, Any],
params: dict[str, str],
row: dict[str, Any],
index: int,
chunk_size: int,
video_keys: list[str],
) -> list[str]:
candidates = _explicit_video_paths(row)
templates = _templates(info, params, "VIDEO_PATH_TEMPLATE", ("video_path", "videoPath"), DEFAULT_VIDEO_TEMPLATES)
for video_key in video_keys:
values = _template_values(row, index, chunk_size, video_key=video_key)
for template in templates:
rendered = _format_template(template, values)
if rendered:
candidates.append(rendered)
result: list[str] = []
for candidate in candidates:
resolved = _resolve_existing(root, candidate)
if resolved is not None:
relative = _relative(root, resolved)
if relative not in result:
result.append(relative)
return result
def _task_id_set(tasks: list[dict[str, Any]]) -> set[int]:
result: set[int] = set()
for row in tasks:
task_id = _first_int(row, ("task_index", "taskIndex", "task_id", "taskId", "id"), -1)
if task_id >= 0:
result.add(task_id)
return result
def _row_task_ids(row: dict[str, Any]) -> list[int]:
values: list[Any] = []
for key in ("tasks", "task_indices", "taskIndices", "task_index", "taskIndex", "task_id", "taskId"):
if key in row:
value = row[key]
if isinstance(value, list):
values.extend(value)
else:
values.append(value)
result = []
for value in values:
task_id = _safe_int(value, -1)
if task_id >= 0 and task_id not in result:
result.append(task_id)
return result
def _inferred_paths_for_episode(data_files: list[dict[str, Any]], episode_id: str) -> list[str]:
return [str(item["path"]) for item in data_files if int(item.get("episodeRows", {}).get(episode_id, 0)) > 0]
def _validate_episode(
row: dict[str, Any],
index: int,
root: pathlib.Path,
info: dict[str, Any],
params: dict[str, str],
data_files: list[dict[str, Any]],
data_files_by_path: dict[str, dict[str, Any]],
task_ids: set[int],
video_keys: list[str],
chunk_size: int,
required_columns: list[str],
check_videos: bool,
) -> dict[str, Any]:
episode_id = _episode_key(row, index)
length = _episode_length(row)
candidate_data_paths = _candidate_data_paths(root, info, params, row, index, chunk_size)
inferred_data_paths = _inferred_paths_for_episode(data_files, episode_id)
matched_data_paths = [path for path in candidate_data_paths if path in inferred_data_paths] or inferred_data_paths
data_rows = sum(int(data_files_by_path[path]["episodeRows"].get(episode_id, 0)) for path in inferred_data_paths)
video_paths = _candidate_video_paths(root, info, params, row, index, chunk_size, video_keys)
issues: list[dict[str, Any]] = []
if not inferred_data_paths:
issues.append({"code": "episode_missing_data_rows", "episodeId": episode_id})
if candidate_data_paths and not any(path in inferred_data_paths for path in candidate_data_paths):
issues.append({"code": "episode_candidate_data_path_does_not_contain_rows", "episodeId": episode_id, "candidatePaths": candidate_data_paths, "inferredPaths": inferred_data_paths})
if length >= 0 and data_rows and data_rows != length:
issues.append({"code": "episode_length_mismatch", "episodeId": episode_id, "metadataLength": length, "dataRows": data_rows})
for path in matched_data_paths:
columns = set(data_files_by_path[path].get("columns", []))
missing_columns = [column for column in required_columns if column not in columns]
if missing_columns:
issues.append({"code": "missing_required_data_columns", "episodeId": episode_id, "path": path, "columns": missing_columns})
if check_videos and video_keys and len(video_paths) < len(video_keys):
issues.append({"code": "missing_video_files", "episodeId": episode_id, "expectedVideoKeys": video_keys, "foundPaths": video_paths})
for task_id in _row_task_ids(row):
if task_ids and task_id not in task_ids:
issues.append({"code": "unknown_task_id", "episodeId": episode_id, "taskId": task_id})
frame_range = {}
if matched_data_paths:
frame_range = data_files_by_path[matched_data_paths[0]].get("frameRanges", {}).get(episode_id, {})
return {
"episodeId": episode_id,
"metadataFile": str(row.get("_metadataFile", "")),
"length": length,
"dataRows": data_rows,
"candidateDataPaths": candidate_data_paths,
"inferredDataPaths": inferred_data_paths,
"matchedDataPaths": matched_data_paths,
"videoPaths": video_paths,
"taskIds": _row_task_ids(row),
"frameRange": frame_range,
"valid": not issues,
"issues": issues,
}
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("AgiBotWorld2026 数据集校验需要 SOURCE_PATH 指向真实数据集目录")
root = _find_dataset_root(source_path)
meta_dir = root / "meta"
if not meta_dir.is_dir():
raise RuntimeError(f"{root} does not contain an AgiBotWorld2026 meta directory")
pq = _require_pyarrow_parquet()
max_files = _positive_int(params, "MAX_PARQUET_FILES", DEFAULT_MAX_PARQUET_FILES)
chunk_size = _positive_int(params, "CHUNK_SIZE", DEFAULT_CHUNK_SIZE)
check_videos = _bool_param(helpers, params, "CHECK_VIDEO_EXISTS", True)
required_columns = _csv_tokens(params.get("REQUIRED_COLUMNS", ""), DEFAULT_REQUIRED_COLUMNS)
info = _load_json(meta_dir / "info.json")
episodes, episode_files = _episode_metadata_rows(meta_dir, pq, max_files)
tasks, task_files = _task_rows(meta_dir, pq, max_files)
task_ids = _task_id_set(tasks)
video_keys = _param_video_keys(params, info)
data_paths = _data_parquet_paths(root, max_files)
data_files = [_scan_data_file(path, root, pq) for path in data_paths]
data_files_by_path = {str(item["path"]): item for item in data_files}
video_file_count = len([path for path in (root / "videos").rglob("*") if path.is_file()]) if (root / "videos").is_dir() else 0
episode_summaries = [
_validate_episode(
row,
index,
root,
info,
params,
data_files,
data_files_by_path,
task_ids,
video_keys,
chunk_size,
required_columns,
check_videos,
)
for index, row in enumerate(episodes)
]
issues: list[dict[str, Any]] = []
warnings: list[dict[str, Any]] = []
if not info:
issues.append({"code": "missing_info_json", "path": str(meta_dir / "info.json")})
if not episodes:
issues.append({"code": "missing_episode_metadata", "path": str(meta_dir / "episodes.jsonl")})
if not data_paths:
issues.append({"code": "missing_data_parquet", "path": str(root / "data")})
invalid_episodes = [item for item in episode_summaries if not item["valid"]]
if invalid_episodes:
issues.append({"code": "invalid_episode_mapping", "count": len(invalid_episodes), "examples": invalid_episodes[:100]})
if check_videos and video_keys and video_file_count == 0:
issues.append({"code": "missing_video_root_files", "path": str(root / "videos"), "videoKeys": video_keys})
if len(data_paths) >= max_files:
warnings.append({"code": "data_parquet_scan_limited", "maxParquetFiles": max_files})
payload = {
"datasetType": "agibot-world2026-validation",
"sourcePath": str(root),
"valid": not issues,
"issueCount": len(issues),
"warningCount": len(warnings),
"issues": issues,
"warnings": warnings,
"chunkSize": chunk_size,
"requiredColumns": required_columns,
"dataPathTemplates": _templates(info, params, "DATA_PATH_TEMPLATE", ("data_path", "dataPath"), DEFAULT_DATA_TEMPLATES),
"videoPathTemplates": _templates(info, params, "VIDEO_PATH_TEMPLATE", ("video_path", "videoPath"), DEFAULT_VIDEO_TEMPLATES),
"videoKeys": video_keys,
"checkVideoExists": check_videos,
"episodeMetadataCount": len(episodes),
"episodeMetadataFiles": episode_files,
"taskCount": len(tasks),
"taskFiles": task_files,
"dataParquetCount": len(data_paths),
"dataRowCount": sum(int(item["rowCount"]) for item in data_files),
"videoFileCount": video_file_count,
"validEpisodeCount": len(episode_summaries) - len(invalid_episodes),
"invalidEpisodeCount": len(invalid_episodes),
"dataFiles": data_files,
"episodes": episode_summaries[:1000],
"invalidEpisodes": invalid_episodes[:200],
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"agibot-world2026-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,79 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-agibot-world2026-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-agibot-world2026-validate@sha256:622499759d3ae4bb0bbcbd51069fb2525510f41d3a42a474e30b7d21d9df41b8",
"metadata": "operator.json",
"name": "AgiBotWorld2026 数据集校验",
"operatorId": "operator-builtin-agibot-world2026-validate",
"operatorSlug": "agibot_world2026_validate",
"preferredSlug": "agibot_world2026_validate",
"pythonImport": "backend.operators.builtin.agibot_world2026_validate.operator:run",
"repositoryId": "builtin/agibot_world2026_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_agibot_world2026_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-agibot-world2026-validate",
"operatorSlug": "agibot_world2026_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"agibotworld2026-meta-data-video-files",
"pyarrow",
"parquet-files"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"agibotworld2026-meta-data-video-files",
"pyarrow",
"parquet-files"
],
"runtimeHandler": "builtin_agibot_world2026_validate",
"runtimeSource": "backend/operators/builtin/agibot_world2026_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/agibot_world2026_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-aloha-hdf5-validate",
"name": "ALOHA HDF5 示教校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_aloha_hdf5_validate",
"runtimeSource": "backend/operators/builtin/aloha_hdf5_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,230 +0,0 @@
from __future__ import annotations
import pathlib
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
def _require_h5py():
try:
import h5py # type: ignore
except Exception as exc: # pragma: no cover - runtime dependency check
raise RuntimeError("ALOHA HDF5 校验需要 h5py 运行时依赖") from exc
return h5py
def _int_param(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, str(default)) or str(default)).strip()
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _bool_param(params: dict[str, str], key: str, default: bool) -> bool:
raw = str(params.get(key, str(default)).strip().lower())
if raw in {"1", "true", "yes", "y", "on"}:
return True
if raw in {"0", "false", "no", "n", "off"}:
return False
return default
def _find_hdf5_files(source_path: pathlib.Path, max_files: int) -> list[pathlib.Path]:
if source_path.is_file():
return [source_path] if source_path.suffix.lower() in {".hdf5", ".h5"} else []
preferred = [
source_path / "episode_0.hdf5",
source_path / "episode_000000.hdf5",
source_path / "demo.hdf5",
]
files = [item for item in preferred if item.is_file()]
files.extend(
item
for item in sorted(source_path.rglob("*"))
if item.is_file() and item.suffix.lower() in {".hdf5", ".h5"} and item not in files
)
return files[:max_files]
def _get_node(root: Any, path: str) -> Any | None:
current = root
for part in path.strip("/").split("/"):
if not part:
continue
if not hasattr(current, "keys") or part not in current:
return None
current = current[part]
return current
def _shape(node: Any | None) -> list[int]:
if node is None or not hasattr(node, "shape"):
return []
return [int(item) for item in node.shape]
def _jsonable(value: Any) -> Any:
if isinstance(value, bytes):
return value.decode("utf-8", errors="replace")
if isinstance(value, (str, int, float, bool)) or value is None:
return value
if hasattr(value, "item"):
try:
return _jsonable(value.item())
except Exception:
pass
if isinstance(value, (list, tuple)):
return [_jsonable(item) for item in value]
return str(value)
def _attrs_payload(node: Any) -> dict[str, Any]:
return {str(key): _jsonable(value) for key, value in node.attrs.items()}
def _summarize_file(path: pathlib.Path, params: dict[str, str], require_qvel: bool) -> dict[str, Any]:
h5py = _require_h5py()
action_path = str(params.get("ACTION_PATH", "/action") or "/action")
qpos_path = str(params.get("QPOS_PATH", "/observations/qpos") or "/observations/qpos")
qvel_path = str(params.get("QVEL_PATH", "/observations/qvel") or "/observations/qvel")
image_group_path = str(params.get("IMAGE_GROUP_PATH", "/observations/images") or "/observations/images")
with h5py.File(path, "r") as handle:
action = _get_node(handle, action_path)
qpos = _get_node(handle, qpos_path)
qvel = _get_node(handle, qvel_path)
image_group = _get_node(handle, image_group_path)
action_shape = _shape(action)
qpos_shape = _shape(qpos)
qvel_shape = _shape(qvel)
action_frames = int(action_shape[0]) if action_shape else 0
qpos_frames = int(qpos_shape[0]) if qpos_shape else 0
frame_candidates = [value for value in (action_frames, qpos_frames) if value > 0]
frame_count = frame_candidates[0] if frame_candidates else 0
cameras: list[dict[str, Any]] = []
if image_group is not None and hasattr(image_group, "keys"):
for camera_name in sorted(image_group.keys()):
camera_dataset = image_group[camera_name]
camera_shape = _shape(camera_dataset)
cameras.append(
{
"name": str(camera_name),
"shape": camera_shape,
"frameCount": int(camera_shape[0]) if camera_shape else 0,
"dtype": str(getattr(camera_dataset, "dtype", "")),
}
)
issues: list[dict[str, Any]] = []
if not action_shape:
issues.append({"code": "missing_action_dataset", "path": action_path})
if not qpos_shape:
issues.append({"code": "missing_qpos_dataset", "path": qpos_path})
if require_qvel and not qvel_shape:
issues.append({"code": "missing_qvel_dataset", "path": qvel_path})
if not cameras:
issues.append({"code": "missing_camera_images", "path": image_group_path})
expected_frames = frame_count
if expected_frames <= 0:
issues.append({"code": "missing_frame_dimension"})
for name, shape_value, actual_count in (
("action", action_shape, action_frames),
("qpos", qpos_shape, qpos_frames),
("qvel", qvel_shape, int(qvel_shape[0]) if qvel_shape else 0),
):
if not shape_value or (name == "qvel" and not require_qvel):
continue
if expected_frames > 0 and actual_count != expected_frames:
issues.append(
{
"code": "frame_count_mismatch",
"dataset": name,
"expected": expected_frames,
"actual": actual_count,
}
)
for camera in cameras:
if expected_frames > 0 and int(camera["frameCount"]) != expected_frames:
issues.append(
{
"code": "camera_frame_count_mismatch",
"camera": camera["name"],
"expected": expected_frames,
"actual": camera["frameCount"],
}
)
return {
"path": str(path),
"fileSizeBytes": path.stat().st_size,
"attrs": _attrs_payload(handle),
"valid": not issues,
"issueCount": len(issues),
"issues": issues,
"frameCount": expected_frames,
"actionShape": action_shape,
"qposShape": qpos_shape,
"qvelShape": qvel_shape,
"actionDimension": int(action_shape[1]) if len(action_shape) > 1 else 0,
"qposDimension": int(qpos_shape[1]) if len(qpos_shape) > 1 else 0,
"qvelDimension": int(qvel_shape[1]) if len(qvel_shape) > 1 else 0,
"cameraCount": len(cameras),
"cameraNames": [item["name"] for item in cameras],
"cameras": cameras,
}
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("ALOHA HDF5 校验需要 SOURCE_PATH 指向真实 .hdf5/.h5 文件或目录")
max_files = _int_param(params, "MAX_FILES", 20)
require_qvel = _bool_param(params, "REQUIRE_QVEL", False)
files = _find_hdf5_files(source_path, max_files)
if not files:
raise RuntimeError(f"{source_path} does not contain .hdf5/.h5 ALOHA demonstration files")
file_summaries = [_summarize_file(path, params, require_qvel) for path in files]
issues = [
{"file": item["path"], **issue}
for item in file_summaries
for issue in item.get("issues", [])
]
camera_names = sorted({name for item in file_summaries for name in item.get("cameraNames", [])})
payload = {
"datasetType": "aloha-hdf5-validation",
"sourcePath": str(source_path),
"valid": not issues,
"issueCount": len(issues),
"issues": issues[:200],
"fileCount": len(file_summaries),
"totalFrames": sum(int(item.get("frameCount", 0)) for item in file_summaries),
"cameraCount": len(camera_names),
"cameraNames": camera_names,
"actionDimensions": sorted({int(item.get("actionDimension", 0)) for item in file_summaries if item.get("actionDimension")}),
"qposDimensions": sorted({int(item.get("qposDimension", 0)) for item in file_summaries if item.get("qposDimension")}),
"files": file_summaries,
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"aloha-hdf5-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,79 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-aloha-hdf5-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-aloha-hdf5-validate@sha256:e90db43b9bf900fec24f36546724121bab2a329f9ab7b48f579e84a53eb045a8",
"metadata": "operator.json",
"name": "ALOHA HDF5 示教校验",
"operatorId": "operator-builtin-aloha-hdf5-validate",
"operatorSlug": "aloha_hdf5_validate",
"preferredSlug": "aloha_hdf5_validate",
"pythonImport": "backend.operators.builtin.aloha_hdf5_validate.operator:run",
"repositoryId": "builtin/aloha_hdf5_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_aloha_hdf5_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-aloha-hdf5-validate",
"operatorSlug": "aloha_hdf5_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"aloha-act-hdf5-files",
"h5py",
"numpy"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"aloha-act-hdf5-files",
"h5py",
"numpy"
],
"runtimeHandler": "builtin_aloha_hdf5_validate",
"runtimeSource": "backend/operators/builtin/aloha_hdf5_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/aloha_hdf5_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-audit-sample",
"name": "抽检采样",
"category": "QA",
"type": "builtin",
"runtimeHandler": "builtin_audit_sampling",
"runtimeSource": "backend/operators/builtin/audit_sample/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,68 +0,0 @@
from __future__ import annotations
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
payload = helpers["first_payload_with_keys"](inputs, "packageCount", "items")
if payload is None:
raise RuntimeError("抽检采样需要上游成品数据输入")
rules = helpers["normalize_sampling_rules"](helpers["parse_json_param"](params, "RULES_JSON", [], list))
sampled_items = []
summaries = []
for rule in rules:
rule_id = rule["id"]
field_path = rule["field"]
operator = rule["operator"]
value = rule.get("value")
percent = rule["samplePercent"]
matched = []
sampled = []
for item in payload.get("items", []):
if not isinstance(item, dict):
continue
if not helpers["compare_values"](helpers["get_field_value"](item, field_path), operator, value):
continue
matched.append(item)
package_name = str(item.get("packageName", "")).strip() or str(item.get("clipId", "")).strip()
if helpers["stable_sample_hit"](f"{rule_id}:{package_name}", percent):
sampled.append(item)
sampled_items.append({**item, "sampleRuleId": rule_id})
summaries.append(
{
"id": rule_id,
"field": field_path,
"operator": operator,
"value": value,
"samplePercent": percent,
"matchedCount": len(matched),
"sampledCount": len(sampled),
}
)
manifest = {
"datasetType": "x-platform-audit-samples",
"rules": summaries,
"sampledCount": len(sampled_items),
"items": sampled_items,
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"audit-samples.json",
manifest,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,75 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "QA",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-audit-sample:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-audit-sample@sha256:2a89baaae19e6c2c33980f41921020043888dc48db23cbc69c7de6f4670c9fc2",
"metadata": "operator.json",
"name": "抽检采样",
"operatorId": "operator-builtin-audit-sample",
"operatorSlug": "audit_sample",
"preferredSlug": "audit_sample",
"pythonImport": "backend.operators.builtin.audit_sample.operator:run",
"repositoryId": "builtin/audit_sample",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_audit_sampling",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-audit-sample",
"operatorSlug": "audit_sample",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"json-artifacts"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"json-artifacts"
],
"runtimeHandler": "builtin_audit_sampling",
"runtimeSource": "backend/operators/builtin/audit_sample/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/audit_sample",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-bop-dataset-validate",
"name": "BOP 6D姿态数据集校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_bop_dataset_validate",
"runtimeSource": "backend/operators/builtin/bop_dataset_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,500 +0,0 @@
from __future__ import annotations
import json
import math
import pathlib
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
SPLIT_PREFIXES = ("train", "val", "test", "onboarding_static", "onboarding_dynamic")
IMAGE_SUFFIXES = (".png", ".jpg", ".jpeg", ".tif", ".tiff")
def _positive_int(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, str(default)) or str(default)).strip()
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _bool_param(helpers: HelperMap, params: dict[str, str], key: str, default: bool) -> bool:
return bool(helpers["parse_bool_param"](params, key, default))
def _relative(path: pathlib.Path | None, root: pathlib.Path) -> str:
if path is None:
return ""
try:
return path.relative_to(root).as_posix()
except ValueError:
return str(path)
def _load_json(path: pathlib.Path) -> Any:
try:
return json.loads(path.read_text(encoding="utf-8"))
except json.JSONDecodeError as exc:
raise RuntimeError(f"{path} is not valid JSON") from exc
def _json_file(scene_dir: pathlib.Path, prefix: str) -> pathlib.Path | None:
exact = scene_dir / f"{prefix}.json"
if exact.is_file():
return exact
if prefix == "scene_gt":
candidates = [
path
for path in sorted(scene_dir.glob("scene_gt_*.json"))
if not path.name.startswith("scene_gt_info") and not path.name.startswith("scene_gt_coco")
]
else:
candidates = sorted(scene_dir.glob(f"{prefix}_*.json"))
return candidates[0] if candidates else None
def _is_scene_dir(path: pathlib.Path) -> bool:
return path.is_dir() and (_json_file(path, "scene_camera") is not None or _json_file(path, "scene_gt") is not None)
def _find_scene_dirs(source_path: pathlib.Path, max_scenes: int) -> list[pathlib.Path]:
if source_path.is_file():
return [source_path.parent] if _is_scene_dir(source_path.parent) else []
if _is_scene_dir(source_path):
return [source_path]
scenes: list[pathlib.Path] = []
seen: set[pathlib.Path] = set()
for candidate in sorted(source_path.rglob("*")):
if len(scenes) >= max_scenes:
break
if not _is_scene_dir(candidate):
continue
resolved = candidate.resolve()
if resolved in seen:
continue
scenes.append(candidate)
seen.add(resolved)
return scenes
def _has_split_dir(path: pathlib.Path) -> bool:
if not path.is_dir():
return False
return any(child.is_dir() and child.name.startswith(SPLIT_PREFIXES) for child in path.iterdir())
def _has_models_dir(path: pathlib.Path) -> bool:
if not path.is_dir():
return False
return any(child.is_dir() and child.name.startswith("models") for child in path.iterdir())
def _dataset_root(source_path: pathlib.Path, scene_dirs: list[pathlib.Path]) -> pathlib.Path:
base = source_path if source_path.is_dir() else source_path.parent
for candidate in [base, *base.parents]:
if _has_split_dir(candidate) or _has_models_dir(candidate) or (candidate / "camera.json").is_file():
return candidate
if scene_dirs and len(scene_dirs[0].parents) >= 2:
return scene_dirs[0].parent.parent
return base
def _scene_split(scene_dir: pathlib.Path, root: pathlib.Path) -> str:
try:
rel_parts = scene_dir.relative_to(root).parts
except ValueError:
rel_parts = scene_dir.parts
return rel_parts[0] if len(rel_parts) >= 2 else ""
def _scene_id(scene_dir: pathlib.Path) -> str:
return scene_dir.name
def _sorted_image_ids(*payloads: Any, limit: int) -> list[str]:
ids: set[str] = set()
for payload in payloads:
if isinstance(payload, dict):
ids.update(str(key) for key in payload.keys())
def sort_key(value: str) -> tuple[int, int | str]:
try:
return (0, int(value))
except ValueError:
return (1, value)
return sorted(ids, key=sort_key)[:limit]
def _frame_stem(image_id: str) -> str:
try:
return f"{int(image_id):06d}"
except ValueError:
return image_id
def _first_file(scene_dir: pathlib.Path, prefixes: tuple[str, ...], stem: str) -> pathlib.Path | None:
candidate_dirs = [
child
for child in sorted(scene_dir.iterdir()) if child.is_dir() and any(child.name == prefix or child.name.startswith(f"{prefix}_") for prefix in prefixes)
]
for directory in candidate_dirs:
for suffix in IMAGE_SUFFIXES:
candidate = directory / f"{stem}{suffix}"
if candidate.is_file():
return candidate
return None
def _mask_file(scene_dir: pathlib.Path, prefix: str, image_id: str, annotation_index: int) -> pathlib.Path | None:
stem = f"{_frame_stem(image_id)}_{annotation_index:06d}"
return _first_file(scene_dir, (prefix,), stem)
def _is_finite_number(value: Any) -> bool:
return isinstance(value, (int, float)) and not isinstance(value, bool) and math.isfinite(float(value))
def _numeric_vector(value: Any, length: int) -> bool:
return isinstance(value, list) and len(value) == length and all(_is_finite_number(item) for item in value)
def _valid_bbox(value: Any) -> bool:
if not _numeric_vector(value, 4):
return False
return float(value[2]) >= 0 and float(value[3]) >= 0
def _image_camera_issues(payload: Any) -> list[dict[str, Any]]:
issues: list[dict[str, Any]] = []
if not isinstance(payload, dict):
return [{"code": "camera_entry_not_dict"}]
if not _numeric_vector(payload.get("cam_K"), 9):
issues.append({"code": "cam_k_invalid"})
if "depth_scale" in payload and (not _is_finite_number(payload.get("depth_scale")) or float(payload["depth_scale"]) <= 0):
issues.append({"code": "depth_scale_invalid"})
if "cam_R_w2c" in payload and not _numeric_vector(payload.get("cam_R_w2c"), 9):
issues.append({"code": "cam_r_w2c_invalid"})
if "cam_t_w2c" in payload and not _numeric_vector(payload.get("cam_t_w2c"), 3):
issues.append({"code": "cam_t_w2c_invalid"})
return issues
def _annotation_issues(payload: Any, *, require_object_pose: bool) -> list[dict[str, Any]]:
issues: list[dict[str, Any]] = []
if not isinstance(payload, dict):
return [{"code": "annotation_not_dict"}]
obj_id = payload.get("obj_id")
if not isinstance(obj_id, int) or isinstance(obj_id, bool) or obj_id <= 0:
issues.append({"code": "obj_id_invalid", "value": obj_id})
if require_object_pose:
if not _numeric_vector(payload.get("cam_R_m2c"), 9):
issues.append({"code": "cam_r_m2c_invalid"})
if not _numeric_vector(payload.get("cam_t_m2c"), 3):
issues.append({"code": "cam_t_m2c_invalid"})
if "obj_bb" in payload and not _valid_bbox(payload.get("obj_bb")):
issues.append({"code": "obj_bb_invalid"})
return issues
def _gt_info_issues(payload: Any) -> list[dict[str, Any]]:
issues: list[dict[str, Any]] = []
if not isinstance(payload, dict):
return [{"code": "gt_info_entry_not_dict"}]
for key in ("bbox_obj", "bbox_visib"):
if key in payload and not _valid_bbox(payload.get(key)):
issues.append({"code": f"{key}_invalid"})
for key in ("px_count_all", "px_count_valid", "px_count_visib"):
if key in payload and (not isinstance(payload.get(key), int) or isinstance(payload.get(key), bool) or payload[key] < 0):
issues.append({"code": f"{key}_invalid"})
if "visib_fract" in payload and (
not _is_finite_number(payload.get("visib_fract")) or float(payload["visib_fract"]) < 0 or float(payload["visib_fract"]) > 1
):
issues.append({"code": "visib_fract_invalid"})
return issues
def _scene_file_load(scene_dir: pathlib.Path, root: pathlib.Path, prefix: str, required: bool) -> tuple[pathlib.Path | None, Any, list[dict[str, Any]]]:
path = _json_file(scene_dir, prefix)
if path is None:
return None, {}, ([{"code": f"missing_{prefix}", "path": _relative(scene_dir / f"{prefix}.json", root)}] if required else [])
try:
payload = _load_json(path)
except RuntimeError as exc:
return path, {}, [{"code": f"{prefix}_json_invalid", "path": _relative(path, root), "message": str(exc)}]
if not isinstance(payload, dict):
return path, {}, [{"code": f"{prefix}_not_dict", "path": _relative(path, root)}]
return path, payload, []
def _validate_scene(
scene_dir: pathlib.Path,
root: pathlib.Path,
*,
max_images_per_scene: int,
check_image_files: bool,
check_depth_files: bool,
check_mask_files: bool,
require_scene_gt: bool,
require_scene_gt_info: bool,
require_object_pose: bool,
) -> dict[str, Any]:
scene_issues: list[dict[str, Any]] = []
camera_path, scene_camera, issues = _scene_file_load(scene_dir, root, "scene_camera", True)
scene_issues.extend(issues)
gt_path, scene_gt, issues = _scene_file_load(scene_dir, root, "scene_gt", require_scene_gt)
scene_issues.extend(issues)
gt_info_path, scene_gt_info, issues = _scene_file_load(scene_dir, root, "scene_gt_info", require_scene_gt_info)
scene_issues.extend(issues)
image_ids = _sorted_image_ids(scene_camera, scene_gt, scene_gt_info, limit=max_images_per_scene)
image_summaries: list[dict[str, Any]] = []
object_counts: dict[str, int] = {}
valid_image_count = 0
annotation_count = 0
image_asset_counts = {"rgbOrGray": 0, "depth": 0, "mask": 0, "maskVisib": 0}
for image_id in image_ids:
image_issues: list[dict[str, Any]] = []
camera_entry = scene_camera.get(image_id) if isinstance(scene_camera, dict) else None
if camera_entry is None:
image_issues.append({"code": "missing_scene_camera_entry", "imageId": image_id})
else:
image_issues.extend(_image_camera_issues(camera_entry))
annotations = scene_gt.get(image_id, []) if isinstance(scene_gt, dict) else []
if annotations is None:
annotations = []
if not isinstance(annotations, list):
image_issues.append({"code": "scene_gt_image_entry_not_list", "imageId": image_id})
annotations = []
gt_infos = scene_gt_info.get(image_id, []) if isinstance(scene_gt_info, dict) else []
if gt_infos is None:
gt_infos = []
if gt_infos and not isinstance(gt_infos, list):
image_issues.append({"code": "scene_gt_info_image_entry_not_list", "imageId": image_id})
gt_infos = []
if require_scene_gt_info and len(gt_infos) != len(annotations):
image_issues.append({"code": "scene_gt_info_count_mismatch", "imageId": image_id, "gtCount": len(annotations), "infoCount": len(gt_infos)})
frame_stem = _frame_stem(image_id)
rgb_path = _first_file(scene_dir, ("rgb", "gray"), frame_stem)
depth_path = _first_file(scene_dir, ("depth",), frame_stem)
if rgb_path is not None:
image_asset_counts["rgbOrGray"] += 1
elif check_image_files:
image_issues.append({"code": "missing_rgb_or_gray_file", "imageId": image_id, "path": f"rgb/{frame_stem}.png"})
if depth_path is not None:
image_asset_counts["depth"] += 1
elif check_depth_files:
image_issues.append({"code": "missing_depth_file", "imageId": image_id, "path": f"depth/{frame_stem}.png"})
for index, annotation in enumerate(annotations):
annotation_count += 1
image_issues.extend({**issue, "annotationIndex": index} for issue in _annotation_issues(annotation, require_object_pose=require_object_pose))
if isinstance(annotation, dict) and isinstance(annotation.get("obj_id"), int) and not isinstance(annotation.get("obj_id"), bool):
obj_id = str(annotation["obj_id"])
object_counts[obj_id] = object_counts.get(obj_id, 0) + 1
if check_mask_files:
mask_path = _mask_file(scene_dir, "mask", image_id, index)
mask_visib_path = _mask_file(scene_dir, "mask_visib", image_id, index)
if mask_path is not None:
image_asset_counts["mask"] += 1
else:
image_issues.append({"code": "missing_mask_file", "imageId": image_id, "annotationIndex": index})
if mask_visib_path is not None:
image_asset_counts["maskVisib"] += 1
else:
image_issues.append({"code": "missing_mask_visib_file", "imageId": image_id, "annotationIndex": index})
if index < len(gt_infos):
image_issues.extend({**issue, "annotationIndex": index} for issue in _gt_info_issues(gt_infos[index]))
if not image_issues:
valid_image_count += 1
image_summaries.append(
{
"imageId": image_id,
"frameStem": frame_stem,
"rgbOrGrayPath": _relative(rgb_path, root),
"depthPath": _relative(depth_path, root),
"annotationCount": len(annotations),
"valid": not image_issues,
"issueCount": len(image_issues),
"issues": image_issues,
}
)
valid = not scene_issues and all(item["valid"] for item in image_summaries)
return {
"split": _scene_split(scene_dir, root),
"sceneId": _scene_id(scene_dir),
"scenePath": _relative(scene_dir, root),
"sceneCameraPath": _relative(camera_path, root),
"sceneGtPath": _relative(gt_path, root),
"sceneGtInfoPath": _relative(gt_info_path, root),
"valid": valid,
"issueCount": len(scene_issues) + sum(int(item["issueCount"]) for item in image_summaries),
"issues": scene_issues,
"imageCount": len(image_ids),
"validImageCount": valid_image_count,
"annotationCount": annotation_count,
"objectCounts": object_counts,
"imageAssetCounts": image_asset_counts,
"images": image_summaries,
}
def _model_dirs(root: pathlib.Path) -> list[pathlib.Path]:
if not root.is_dir():
return []
return [path for path in sorted(root.iterdir()) if path.is_dir() and path.name.startswith("models")]
def _validate_models(root: pathlib.Path, required: bool, require_model_files: bool) -> tuple[list[dict[str, Any]], dict[str, Any]]:
issues: list[dict[str, Any]] = []
dirs = _model_dirs(root)
if required and not dirs:
issues.append({"code": "missing_models_dir", "path": "models"})
object_ids: set[str] = set()
model_files = 0
model_info_files = 0
for directory in dirs:
info_path = directory / "models_info.json"
if not info_path.is_file():
issues.append({"code": "missing_models_info", "path": _relative(info_path, root)})
continue
model_info_files += 1
try:
payload = _load_json(info_path)
except RuntimeError as exc:
issues.append({"code": "models_info_json_invalid", "path": _relative(info_path, root), "message": str(exc)})
continue
if not isinstance(payload, dict):
issues.append({"code": "models_info_not_dict", "path": _relative(info_path, root)})
continue
for obj_id, info in payload.items():
object_ids.add(str(obj_id))
if not isinstance(info, dict):
issues.append({"code": "model_info_entry_not_dict", "objectId": str(obj_id)})
continue
if "diameter" in info and (not _is_finite_number(info.get("diameter")) or float(info["diameter"]) <= 0):
issues.append({"code": "model_diameter_invalid", "objectId": str(obj_id)})
try:
model_path = directory / f"obj_{int(obj_id):06d}.ply"
except ValueError:
issues.append({"code": "model_object_id_not_integer", "objectId": str(obj_id)})
continue
if model_path.is_file():
model_files += 1
elif require_model_files:
issues.append({"code": "missing_model_ply", "objectId": str(obj_id), "path": _relative(model_path, root)})
return issues, {
"modelDirCount": len(dirs),
"modelInfoFileCount": model_info_files,
"modelFileCount": model_files,
"modelObjectCount": len(object_ids),
"modelObjectIds": sorted(object_ids, key=lambda value: (0, int(value)) if value.isdigit() else (1, value))[:200],
}
def _merge_counts(scenes: list[dict[str, Any]], key: str) -> dict[str, int]:
result: dict[str, int] = {}
for scene in scenes:
value = str(scene.get(key) or "")
if value:
result[value] = result.get(value, 0) + 1
return result
def _merge_object_counts(scenes: list[dict[str, Any]]) -> dict[str, int]:
result: dict[str, int] = {}
for scene in scenes:
for obj_id, count in (scene.get("objectCounts") or {}).items():
result[str(obj_id)] = result.get(str(obj_id), 0) + int(count)
return result
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("BOP 6D姿态数据集校验需要 SOURCE_PATH 指向真实 BOP 数据根目录、split/scene 目录或 scene_*.json 文件")
max_scenes = _positive_int(params, "MAX_SCENES", 20)
max_images_per_scene = _positive_int(params, "MAX_IMAGES_PER_SCENE", 200)
check_image_files = _bool_param(helpers, params, "CHECK_IMAGE_FILES", True)
check_depth_files = _bool_param(helpers, params, "CHECK_DEPTH_FILES", False)
check_mask_files = _bool_param(helpers, params, "CHECK_MASK_FILES", False)
require_scene_gt = _bool_param(helpers, params, "REQUIRE_SCENE_GT", True)
require_scene_gt_info = _bool_param(helpers, params, "REQUIRE_SCENE_GT_INFO", False)
require_models_info = _bool_param(helpers, params, "REQUIRE_MODELS_INFO", True)
require_model_files = _bool_param(helpers, params, "REQUIRE_MODEL_FILES", False)
require_object_pose = _bool_param(helpers, params, "REQUIRE_OBJECT_POSE", True)
scene_dirs = _find_scene_dirs(source_path, max_scenes)
if not scene_dirs:
raise RuntimeError(f"{source_path} does not contain BOP scene_camera*.json or scene_gt*.json scene directories")
root = _dataset_root(source_path, scene_dirs)
model_issues, models = _validate_models(root, require_models_info, require_model_files)
scenes = [
_validate_scene(
scene_dir,
root,
max_images_per_scene=max_images_per_scene,
check_image_files=check_image_files,
check_depth_files=check_depth_files,
check_mask_files=check_mask_files,
require_scene_gt=require_scene_gt,
require_scene_gt_info=require_scene_gt_info,
require_object_pose=require_object_pose,
)
for scene_dir in scene_dirs
]
scene_issues = [
{"code": "invalid_scene", "scenePath": scene["scenePath"], "issues": scene["issues"], "images": [image for image in scene["images"] if not image["valid"]]}
for scene in scenes
if not scene.get("valid")
]
issues = [*model_issues, *scene_issues]
payload = {
"datasetType": "bop-dataset-validation",
"sourcePath": str(source_path),
"datasetRoot": str(root),
"valid": not issues,
"issueCount": len(issues),
"issues": issues,
"sceneCount": len(scenes),
"validSceneCount": sum(1 for scene in scenes if scene.get("valid")),
"invalidSceneCount": sum(1 for scene in scenes if not scene.get("valid")),
"imageCount": sum(int(scene.get("imageCount") or 0) for scene in scenes),
"validImageCount": sum(int(scene.get("validImageCount") or 0) for scene in scenes),
"annotationCount": sum(int(scene.get("annotationCount") or 0) for scene in scenes),
"splitCounts": _merge_counts(scenes, "split"),
"objectCounts": _merge_object_counts(scenes),
"assets": {
"hasCameraJson": (root / "camera.json").is_file(),
**models,
},
"scenes": scenes,
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"bop-dataset-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,81 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bop-dataset-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bop-dataset-validate@sha256:6b99f50e0777e02df933fb196666f6bace7c251fcdfedf1630844525905d5c1b",
"metadata": "operator.json",
"name": "BOP 6D姿态数据集校验",
"operatorId": "operator-builtin-bop-dataset-validate",
"operatorSlug": "bop_dataset_validate",
"preferredSlug": "bop_dataset_validate",
"pythonImport": "backend.operators.builtin.bop_dataset_validate.operator:run",
"repositoryId": "builtin/bop_dataset_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_bop_dataset_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-bop-dataset-validate",
"operatorSlug": "bop_dataset_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"bop-scenewise-dataset-files",
"json-files",
"rgb-depth-mask-image-files",
"ply-model-files"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"bop-scenewise-dataset-files",
"json-files",
"rgb-depth-mask-image-files",
"ply-model-files"
],
"runtimeHandler": "builtin_bop_dataset_validate",
"runtimeSource": "backend/operators/builtin/bop_dataset_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/bop_dataset_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-bos-incremental-scan",
"name": "BOS 增量扫描",
"category": "IO",
"type": "builtin",
"runtimeHandler": "builtin_source",
"runtimeSource": "backend/operators/builtin/bos_incremental_scan/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,36 +0,0 @@
from __future__ import annotations
from typing import Any, Callable
from backend.operators.builtin.real_source import operator as real_source_operator
HelperMap = dict[str, Callable[..., Any]]
def with_forced_hyperparams(node_data: dict[str, Any]) -> dict[str, Any]:
updated = {**node_data}
hyperparams = [
item
for item in list(node_data.get("hyperparams", []) or [])
if str(item.get("key", "")).strip() not in {"DATA_SOURCE", "SCAN_MODE"}
]
hyperparams.extend(
[
{"key": "DATA_SOURCE", "value": "BOS"},
{"key": "SCAN_MODE", "value": "INCREMENTAL"},
]
)
updated["hyperparams"] = hyperparams
return updated
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
return real_source_operator.run(run_id, node_id, output_dir, with_forced_hyperparams(node_data), inputs, helpers)

View File

@ -1,77 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "IO",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bos-incremental-scan:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bos-incremental-scan@sha256:75a5c7d013b115d12c21c8ca2b64bce418802cbb9eed118c1be6074f043ae1fd",
"metadata": "operator.json",
"name": "BOS 增量扫描",
"operatorId": "operator-builtin-bos-incremental-scan",
"operatorSlug": "bos_incremental_scan",
"preferredSlug": "bos_incremental_scan",
"pythonImport": "backend.operators.builtin.bos_incremental_scan.operator:run",
"repositoryId": "builtin/bos_incremental_scan",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_source",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-bos-incremental-scan",
"operatorSlug": "bos_incremental_scan",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"baidu-bos"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"baidu-bos"
],
"runtimeHandler": "builtin_source",
"runtimeSource": "backend/operators/builtin/bos_incremental_scan/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/bos_incremental_scan",
"strictPocAcceptanceExternals": [
"bos"
],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-bridgedata-tfds-manifest-validate",
"name": "BridgeData TFDS-RLDS清单校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_bridgedata_tfds_manifest_validate",
"runtimeSource": "backend/operators/builtin/bridgedata_tfds_manifest_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,293 +0,0 @@
from __future__ import annotations
import json
import pathlib
import struct
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
DEFAULT_MAX_RECORDS = 200_000
DEFAULT_MAX_FILES = 100
MASK_DELTA = 0xA282EAD8
CRC32C_POLY = 0x82F63B78
TFRECORD_SUFFIXES = {".tfrecord", ".tfrecords", ".tfrec"}
def _crc32c_table() -> list[int]:
table: list[int] = []
for index in range(256):
crc = index
for _ in range(8):
if crc & 1:
crc = (crc >> 1) ^ CRC32C_POLY
else:
crc >>= 1
table.append(crc & 0xFFFFFFFF)
return table
CRC32C_TABLE = _crc32c_table()
def _crc32c(data: bytes) -> int:
checksum = 0xFFFFFFFF
for item in data:
checksum = CRC32C_TABLE[(checksum ^ item) & 0xFF] ^ (checksum >> 8)
return (~checksum) & 0xFFFFFFFF
def _masked_crc32c(data: bytes) -> int:
value = _crc32c(data)
return (((value >> 15) | ((value << 17) & 0xFFFFFFFF)) + MASK_DELTA) & 0xFFFFFFFF
def _positive_int(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, "") or "").strip()
if not raw:
return default
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _field_tokens(raw: str, default: tuple[str, ...]) -> list[str]:
tokens = [item.strip().lower() for item in str(raw or "").split(",") if item.strip()]
return tokens or list(default)
def _load_json(path: pathlib.Path) -> Any:
with path.open("r", encoding="utf-8") as handle:
return json.load(handle)
def _optional_json(path: pathlib.Path) -> dict[str, Any]:
if not path.is_file():
return {}
payload = _load_json(path)
return payload if isinstance(payload, dict) else {}
def _find_tfrecord_files(path: pathlib.Path, max_files: int) -> list[pathlib.Path]:
if path.is_file():
return [path] if path.suffix.lower() in TFRECORD_SUFFIXES else []
return sorted(candidate for candidate in path.rglob("*") if candidate.is_file() and candidate.suffix.lower() in TFRECORD_SUFFIXES)[:max_files]
def _relative(root: pathlib.Path, path: pathlib.Path) -> str:
try:
return path.relative_to(root).as_posix()
except ValueError:
return str(path)
def _flatten_keys(value: Any, prefix: str = "") -> set[str]:
keys: set[str] = set()
if isinstance(value, dict):
for key, item in value.items():
path = f"{prefix}.{key}" if prefix else str(key)
keys.add(path)
keys.update(_flatten_keys(item, path))
elif isinstance(value, list):
for index, item in enumerate(value[:20]):
path = f"{prefix}[{index}]" if prefix else f"[{index}]"
keys.update(_flatten_keys(item, path))
return keys
def _normalized(value: str) -> str:
return value.lower().replace("/", ".").replace("_", ".").replace("-", ".")
def _has_token(feature_keys: set[str], tokens: list[str]) -> bool:
normalized_keys = [_normalized(key) for key in feature_keys]
for token in tokens:
normalized_token = _normalized(token)
if any(normalized_token in key for key in normalized_keys):
return True
return False
def _decode_preview(data: bytes) -> dict[str, Any]:
stripped = data.strip()
if not stripped:
return {"encoding": "empty", "preview": ""}
try:
parsed = json.loads(stripped.decode("utf-8"))
except Exception:
return {"encoding": "bytes", "preview": stripped[:160].decode("utf-8", errors="replace"), "sizeBytes": len(data)}
return {"encoding": "json", "preview": parsed}
def _scan_tfrecord(path: pathlib.Path, root: pathlib.Path, max_records: int, preview_records: int) -> dict[str, Any]:
issues: list[dict[str, Any]] = []
records: list[dict[str, Any]] = []
count = 0
total_payload_bytes = 0
offset = 0
with path.open("rb") as handle:
while count < max_records:
header = handle.read(12)
if not header:
break
if len(header) != 12:
issues.append({"code": "truncated_length_header", "offset": offset, "bytes": len(header)})
break
length = struct.unpack("<Q", header[:8])[0]
stored_length_crc = struct.unpack("<I", header[8:12])[0]
expected_length_crc = _masked_crc32c(header[:8])
if stored_length_crc != expected_length_crc:
issues.append({"code": "length_crc_mismatch", "offset": offset, "stored": stored_length_crc, "expected": expected_length_crc})
payload = handle.read(length)
if len(payload) != length:
issues.append({"code": "truncated_payload", "offset": offset + 12, "expected": length, "actual": len(payload)})
break
data_crc = handle.read(4)
if len(data_crc) != 4:
issues.append({"code": "truncated_payload_crc", "offset": offset + 12 + length, "bytes": len(data_crc)})
break
stored_data_crc = struct.unpack("<I", data_crc)[0]
expected_data_crc = _masked_crc32c(payload)
if stored_data_crc != expected_data_crc:
issues.append({"code": "payload_crc_mismatch", "offset": offset, "stored": stored_data_crc, "expected": expected_data_crc})
if len(records) < preview_records:
records.append({"index": count, "offset": offset, "length": length, **_decode_preview(payload)})
total_payload_bytes += int(length)
count += 1
offset += 12 + int(length) + 4
split = "unknown"
lower = _relative(root, path).lower()
for candidate in ("train", "validation", "val", "test"):
if candidate in lower:
split = "validation" if candidate == "val" else candidate
break
return {
"path": _relative(root, path),
"split": split,
"fileSizeBytes": path.stat().st_size,
"recordCount": count,
"totalPayloadBytes": total_payload_bytes,
"valid": not issues,
"issues": issues,
"records": records,
}
def _split_summary(dataset_info: dict[str, Any]) -> dict[str, int]:
splits = dataset_info.get("splits")
result: dict[str, int] = {}
if isinstance(splits, dict):
for key, value in splits.items():
if isinstance(value, dict):
count = value.get("numExamples") or value.get("num_examples") or value.get("shardLengths")
if isinstance(count, list):
result[str(key)] = sum(int(item) for item in count if isinstance(item, (int, float)))
elif isinstance(count, (int, float)):
result[str(key)] = int(count)
else:
result[str(key)] = 0
elif isinstance(value, (int, float)):
result[str(key)] = int(value)
elif isinstance(splits, list):
for item in splits:
if not isinstance(item, dict):
continue
name = str(item.get("name") or item.get("split") or "").strip()
if not name:
continue
count = item.get("numExamples") or item.get("num_examples")
result[name] = int(count) if isinstance(count, (int, float)) else 0
return result
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("BridgeData TFDS-RLDS 清单校验需要 SOURCE_PATH 指向真实 TFDS/RLDS 目录或 TFRecord 文件")
root = source_path if source_path.is_dir() else source_path.parent
max_files = _positive_int(params, "MAX_FILES", DEFAULT_MAX_FILES)
max_records = _positive_int(params, "MAX_RECORDS", DEFAULT_MAX_RECORDS)
preview_records = _positive_int(params, "PREVIEW_RECORDS", 3)
image_tokens = _field_tokens(params.get("IMAGE_FIELD_TOKENS", ""), ("image", "observation.image", "observation.images"))
action_tokens = _field_tokens(params.get("ACTION_FIELD_TOKENS", ""), ("action",))
language_tokens = _field_tokens(params.get("LANGUAGE_FIELD_TOKENS", ""), ("language_instruction", "natural_language_instruction", "instruction"))
dataset_info = _optional_json(root / "dataset_info.json")
features = _optional_json(root / "features.json")
feature_source: dict[str, Any] = {}
if isinstance(dataset_info.get("features"), dict):
feature_source["dataset_info.features"] = dataset_info["features"]
if features:
feature_source["features.json"] = features
if isinstance(dataset_info.get("schema"), dict):
feature_source["dataset_info.schema"] = dataset_info["schema"]
feature_keys = _flatten_keys(feature_source)
files = _find_tfrecord_files(source_path, max_files)
file_summaries = [_scan_tfrecord(path, root, max_records, preview_records) for path in files]
split_counts: dict[str, int] = {}
for item in file_summaries:
split_counts[item["split"]] = split_counts.get(item["split"], 0) + int(item["recordCount"])
issues: list[dict[str, Any]] = []
warnings: list[dict[str, Any]] = []
if not dataset_info:
warnings.append({"code": "missing_dataset_info_json"})
if not feature_keys:
issues.append({"code": "missing_feature_metadata", "paths": ["dataset_info.json", "features.json"]})
if not files:
issues.append({"code": "missing_tfrecord_shards", "path": str(source_path)})
if file_summaries and sum(int(item["recordCount"]) for item in file_summaries) == 0:
issues.append({"code": "empty_tfrecord_shards"})
if not _has_token(feature_keys, image_tokens):
issues.append({"code": "missing_image_feature", "tokens": image_tokens})
if not _has_token(feature_keys, action_tokens):
issues.append({"code": "missing_action_feature", "tokens": action_tokens})
if not _has_token(feature_keys, language_tokens):
issues.append({"code": "missing_language_feature", "tokens": language_tokens})
corrupt_files = [item for item in file_summaries if not item["valid"]]
if corrupt_files:
issues.append({"code": "invalid_tfrecord_crc_or_framing", "count": len(corrupt_files), "examples": corrupt_files[:20]})
payload = {
"datasetType": "bridgedata-tfds-rlds-manifest-validation",
"sourcePath": str(source_path),
"valid": not issues,
"issueCount": len(issues),
"warningCount": len(warnings),
"issues": issues,
"warnings": warnings,
"datasetInfoPresent": bool(dataset_info),
"featureMetadataPresent": bool(feature_keys),
"featureKeys": sorted(feature_keys)[:500],
"declaredSplits": _split_summary(dataset_info),
"fileCount": len(files),
"recordCount": sum(int(item["recordCount"]) for item in file_summaries),
"splitRecordCounts": split_counts,
"files": file_summaries,
"requiredFeatureTokens": {
"image": image_tokens,
"action": action_tokens,
"language": language_tokens,
},
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"bridgedata-tfds-rlds-manifest-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,79 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bridgedata-tfds-manifest-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bridgedata-tfds-manifest-validate@sha256:18c89efc04d3ca65154c07851231c16953900016178d6183041850e6e7f7e2a0",
"metadata": "operator.json",
"name": "BridgeData TFDS-RLDS清单校验",
"operatorId": "operator-builtin-bridgedata-tfds-manifest-validate",
"operatorSlug": "bridgedata_tfds_manifest_validate",
"preferredSlug": "bridgedata_tfds_manifest_validate",
"pythonImport": "backend.operators.builtin.bridgedata_tfds_manifest_validate.operator:run",
"repositoryId": "builtin/bridgedata_tfds_manifest_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_bridgedata_tfds_manifest_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-bridgedata-tfds-manifest-validate",
"operatorSlug": "bridgedata_tfds_manifest_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"bridgedata-tfds-rlds-directory",
"tfrecord-files",
"crc32c-structural-validation"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"bridgedata-tfds-rlds-directory",
"tfrecord-files",
"crc32c-structural-validation"
],
"runtimeHandler": "builtin_bridgedata_tfds_manifest_validate",
"runtimeSource": "backend/operators/builtin/bridgedata_tfds_manifest_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/bridgedata_tfds_manifest_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-calvin-episode-validate",
"name": "CALVIN Episode 校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_calvin_episode_validate",
"runtimeSource": "backend/operators/builtin/calvin_episode_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

Some files were not shown because too many files have changed in this diff Show More