Compare commits

...

176 Commits

Author SHA1 Message Date
eust-w
846b806ed5 🧪 Hold the pause-resume body mid-stream so the pause lands in flight
The native pause-resume scenario failed with both old and new builds
because the harness could not reliably see an upload in flight. Pause
itself behaved correctly.

Client progress counts bytes handed to the socket, and the daemon writes
it to SQLite once per second. Loopback buffers absorb about 1-3 MiB of a
body (sometimes over 5 MiB on Linux), so a 4 MiB PUT read as 0 or as
complete in nearly every sample. The trigger fired on the 3rd or 4th PUT
at best, later or never under load, and never on Linux. With
FILE_CONCURRENCY=2 and PUT_CONCURRENCY=1, the file queued behind the
in-flight PUT is already dispatched and finishes too, so a late pause
left nothing paused.

The fixture now holds the first direct body after 64 KiB until the
harness has paused. pause-resume uses the 12 MiB default size, so a held
body still reads as partial. The scenario asserts that the held object
arrives intact and that every received object was reserved before the
pause. The daemon already follows the documented contract: pause stops
new dispatch and lets in-flight objects finish.

pause-resume: macOS arm64 10/10, Linux arm64 10/10 (old harness 0/5 on
Linux). Full native matrix on macOS: 26/26.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 15:57:53 +08:00
eust-w
143a24b1e9 ⚡ Enable BOSFS readahead on the shared workspace PV
The workspace mount had no readahead or parallel transfer options, so
bosfs read a file back at ~3-5 MB/s. A800 checkpoint publication hashes
each 2.7G file twice through the mount, taking ~1h per checkpoint and
tripping the 1800s per-file limit. Baidu's recommended general options
raise reads to ~370-390 MB/s (verified on 192.168.80.136); the live PV
was patched the same way.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 14:12:38 +08:00
eust-w
6d4ce7a50c 📝 Record parent commit in same-size rewrite evidence
The fix was committed on top of unrelated bosfs reaper commits. Name the
comparison baseline and the actual parent separately so the evidence does
not imply a3b0bfe2 is the parent.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 12:24:23 +08:00
eust-w
e6ad7ff079 🐛 Rehash sources whose metadata has not settled
Linux stamps writes from a coarse clock, so a same-size rewrite inside one
timestamp tick can keep size, mtime, ctime and inode identical. The scan
cache, daily report and pre-upload check treated that metadata as proof of
unchanged content.

Record when each hash started and trust identity alone only when the last
change was at least three seconds older. Unsettled or legacy cache entries
are rehashed, reports verify their MD5, and uploads re-read the source
before requesting or completing a transfer. Receipt evidence keeps an
optional observedAt beside the identity (schema 7 unchanged) and is
upgraded by a later settled scan; cleanup restores stay unsettled.

Linux arm64: 300 workspace tests pass serially and in parallel; the same
probe drops stale cache reuse from 188/500 and 351/500 to 0.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 12:23:48 +08:00
eust-w
bd21154d8c 🛡️ Harden bosfs-tmp-reaper against arg drift, dir races, and silent stalls
- skip the whole cycle when any bosfs process lacks credentials/<hash>
  so live caches are never mistaken for leaks after a plugin upgrade
- stop removing empty mount directories that kubelet may still bind-mount
- touch a heartbeat per completed cycle and restart on a stale one via
  livenessProbe, so a stalled or skipping reaper shows up as restarts

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 12:03:06 +08:00
eust-w
f29ec4bfae 🐛 Reap leaked bosfs temp files that evicted A800 training mounts
CCE csi-bosplugin writes bosfs.tmp.* under host /tmp/bosfs on the node
root disk and never removes them when a mount pod ends. Leaks filled the
A800 node root disk, kubelet evicted the bosfs FUSE pod mid-training and
runs failed with Errno 107. Add a DaemonSet that deletes temp files of
dead mounts not held open by any process, and document the failure mode.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-30 11:48:24 +08:00
eust-w
a3b0bfe29a 🧪 Complete isolated Linux cleanup recovery acceptance
Verify 36 cleanup tests and 12 native CLI/API scenarios using fresh build targets. Preserve the remaining full-workspace failure, reproduce pre-existing metadata recognition limits on the baseline, and document the authorized Colima recovery without deployment or device upgrades.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-29 20:16:18 +08:00
eust-w
e14c27fc14 🐛 Safely refresh source receipts after cleanup restoration
Bind recovery to the original receipt and scope, verify the held file and MD5, persist strict restart checkpoints, and atomically refresh identity without reusing cloud authorization. Cover direct retry, replacement protection, stale journals, and transactional failures; record Linux validation limits.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-29 18:13:03 +08:00
eust-w
9fa582bc89 🧪 Verify partial cleanup across native clients and real API routes
Add isolated current/legacy CLI and cleanup API comparisons, legacy MD5 planning coverage, and reproducible evidence. Record stale deployment identities and the need to refresh source receipts after failed cleanup restoration.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-29 12:36:52 +08:00
eust-w
0839974b71 📝 Clarify drosync Rust architecture, usage, and safe cleanup
Document source versus installed versions, client/server responsibilities, configuration, sync and cleanup workflows, development checks, and release boundaries.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-28 18:12:27 +08:00
eust-w
503a45e152 🐛 Allow verified per-file cleanup from partial sync sessions
Keep MD5 receipts, source identity, live object proofs, and lease expiry checks mandatory. Recheck quarantined content before deletion and cover mixed-session retention on macOS and Linux.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-28 15:58:21 +08:00
eust-w
6b3ed706c4 🐛 Correct ego CPU action checks and split report data flow
Validate the dataset's 78-dimensional actions, export split records instead of the leakage report, and render selected training episodes with supported template fields. Add regression coverage for record round-tripping, route counts, and empty reports.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-28 15:25:09 +08:00
WishForge Agent
789145750b ✨ WishForge checkpoint 42eedbd9-b178-4bf6-a908-32f468f63a28 2026-10-28 14:12:49 +08:00
eust-w
5b4716851e 📦 Publish the corrected split leakage validator for POC
Record the poc build from 93b106d5 and its registry-verified digest. Regenerate the catalog and repository manifests, and increment the build version to 1.1.4 per project policy.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-10-28 12:00:47 +08:00
eust-w
93b106d53e 🐛 Validate upstream split manifests in the leakage check and add ego CPU extra workflow
The leakage validator resolved an upstream dataset-split-manifest artifact to the
unsplit episodes file named in its sourcePath, so every row lacked a split. It now
reads the manifest itself when no SOURCE_PATH is set. ego-stage gains a media mode
that lists staged videos as a manifest, and ego_workflows.py adds the cpu_extra
workflow covering 13 more CPU operators.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-28 02:15:28 +08:00
eust-w
8a4fb683b7 📦 Republish all builtin operator images with missing digests
Rebuild the 66 builtin operator images whose catalog digests no longer
existed in CCR, plus 13 whose repo pins were equally stale (they only
worked live because the live catalog had been repinned by hand). Built
from poc with kaniko on the current bases (operator-runner d7a2fcea,
gpu-base/yolo-base c3eaecc) and recorded automatically by
record_operator_releases.py.

verify_operator_image_digests.py now reports 103/103 pinned builtin
images present. The live POC catalog was repinned for the 66 with
sync_live_builtin_operator_images.py; the 13 keep their working live
pins (several are Fanyu-line builds) until someone promotes them.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 20:16:44 +08:00
WishForge Agent
49ec357571 ✨ WishForge checkpoint 3ccafecd-36d9-4a0f-83cc-f420f54ccce2 2026-10-27 19:43:42 +08:00
eust-w
34b2cce34e 🔧 Record operator digests after every build and verify pinned images exist
Builtin operator images were rebuilt four times after 2026-06-29 but the
catalog kept the first digests: recording a release was a manual step
that nothing ran. Once the old tags were pruned from CCR, 66 builtin
operators pointed at manifests that no longer exist.

- build-poc-images-kaniko.sh now runs record_operator_releases.py after
  operator builds (POC_KANIKO_RECORD_RELEASES, default true): it resolves
  each pushed tag to its digest, writes release.json with the stable
  :builtin tag, regenerates the catalog and repository manifests, then
  runs verify_operator_image_digests.py on the built operators.
- verify_operator_image_digests.py fails when any pinned catalog digest is
  missing from the registry (usable in CI / before deploys).
- sync_live_builtin_operator_images.py promotes catalog digests to a
  running platform (the API keeps live digests over the catalog), only
  after confirming each digest exists; dry run unless --apply.
- scripts/lib/registry_client.py parses repo:tag@sha256 references and
  handles CCR's Bearer token challenge.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 19:19:02 +08:00
eust-w
67d662a404 📦 Republish nine CPU builtin operator images with missing digests
action_state_quality_validate, camera_calibration_validate,
dataset_split_manifest, embodiment_metadata_validate,
episode_boundary_validate, language_instruction_validate,
parquet_table_summary and video_target_clip pinned digests that do not
exist in CCR. Rebuild them from poc with kaniko on the current
operator-runner base (dataset_split_manifest includes the episode_index 0
fix) and record the new digests in release.json and the builtin catalog.
The live POC catalog was repinned to the same digests.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 18:34:13 +08:00
eust-w
54ff6545bd ✨ Add CPU-only ego workflows and an episode roll-up stage mode
Add "cpu_data" (Parquet summary, action/state quality, episode
boundaries, language instructions, embodiment metadata, split manifest)
and "cpu_video" (10s slicing, motion clipping) workflows that need no
GPU. The ego-stage operator gains an "episodes" mode that rolls this
dataset's per-subtask episodes.jsonl up to one row per episode with a
length, which the split manifest needs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 18:18:56 +08:00
eust-w
770d86d906 🐛 Keep LeRobot episode_index 0 in the dataset split manifest
_episode_id used `str(value or "")`, so an episode_index of 0 counted as
missing and fell back to the row number, giving inconsistent episode ids
(e.g. ['1', '2', 'episode-0']). Treat only None/blank values as missing.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 18:18:56 +08:00
WishForge Agent
4e3cf35f1b ✨ Integrate verified WishForge commit 0acb2c95ee52 2026-10-27 18:04:25 +08:00
eust-w
1094b75e76 ✨ Add the full ego pipeline and operator repinning to the workflow script
Define "full": stage -> LeRobot overview -> Parquet schema -> metadata
consistency -> frame alignment -> SAM3.1, joined with left-camera video
QC into mask collection -> ProPainter hand removal -> upload. Workflow
inputs bind the two root nodes. Drop the ineffective runner-image
override (builtin nodes are re-resolved from the catalog by the worker)
and add pin-operator to repin builtin operators to a pushed digest.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 17:36:46 +08:00
WishForge Agent
0acb2c95ee ✨ WishForge checkpoint 515b814a-8bde-4358-96fc-0b4712f890b3 2026-10-27 17:26:18 +08:00
WishForge Agent
770cd4c897 ✨ WishForge checkpoint 42e84089-6264-4a12-a2da-9189750bafb0 2026-10-27 17:17:51 +08:00
eust-w
0c776c04fb 📦 Republish LeRobot validator images whose pinned digests were missing
The builtin catalog pinned digests for lerobot_dataset_validate,
lerobot_metadata_consistency_validate and lerobot_video_alignment_validate
that no longer exist in CCR, so every run of them sat in ImagePullBackOff
(the reconciler race had been reporting this as missing Jobs).

Rebuild the three images from poc 30d91677 with kaniko on the current
operator-runner base (droboticflow-operator-runner@sha256:d7a2fcea...)
and record the new digests through update_operator_release_manifests.py
and the generators, keeping the stable :builtin tag convention.

Note: a registry check of the live catalog found 82 of 103 builtin
digests returning 404; only these three are republished here.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 16:58:20 +08:00
eust-w
30d916774c 🐛 Fail launches whose pod stays blocked instead of hanging the run
The reconciler used to be the only place that failed a node whose pod sat
in ImagePullBackOff/Unschedulable past WORKER_PENDING_FAILURE_SECONDS. Now
that it leaves runs with a live execution lease alone (0b365155), such a
node would wait for the full launch deadline.

Have Launch check the Job's pods (at most every 10s) and, once a pod has
been blocked for PendingFailureTimeout, delete the Job and return the
blocking reason and message. The executor passes the configured pending
threshold. On POC this surfaced builtin validator images that cannot be
pulled, which the reconciler race had been masking as missing Jobs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 16:25:24 +08:00
eust-w
0b365155e7 🐛 Stop the reconciler from recovering runs that are still executing
reconcileActiveRun inspected every running run whose current node had
been running for over 2 minutes and, when it saw no Job, deleted all of
the run's Jobs (TerminateRun) and re-queued it. It did this even while
another goroutine, in this process or in the other worker replica, was
executing the run and holding its lease. On POC that deleted live Jobs
("Kubernetes job is missing; recovery attempt N/3"), flipped nodes to
failed and back, and left runs queued under a lease nobody could claim.

Skip runs that this process is executing or whose execution lease is
held by any owner and not yet expired. A crashed owner's lease lapses,
so abandoned runs are still recovered.

Also give outputs without an id a deterministic run-node-port-name id
instead of failing the node. Custom images registered before ids were
required (SAM3 collect, hand removal v4) produced correct outputs that
the worker then discarded with "operator output id is required".

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 15:43:12 +08:00
WishForge Agent
314c615c00 ✨ WishForge checkpoint ee35e3fd-cd62-421e-8ff1-a222130f2b2f 2026-10-27 15:12:24 +08:00
eust-w
f00e9b9506 ✨ Stage ego data on the workspace PVC and split workflows for the POC worker
Add the ego-stage lightweight operator: it downloads presigned BOS files
into the run (or a stable /workspace/ego-staging path), collects another
node's outputs, and registers files as artifacts with ids. Operators such
as SAM3.1 and hand removal only read local paths, and their own images
emit artifacts without ids, which the current worker rejects.

Rework scripts/ego_workflows.py around what the current worker runs
reliably: short chains, one consumer per stage, validators on the
operator-runner image, plus commands to register the stage operator,
stop runs, read logs/run details and download results.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 15:03:12 +08:00
eust-w
674397ca98 ✨ Run ego workflows on the current worker via presigned run inputs
Video QC now receives its video list as an inline workflow input whose
items carry 1h BOS presigned URLs, and WiLoR gets a fresh presigned
INPUT_URL before each run, so neither depends on the worker turning
bos:// source outputs into refs. Add logs/worker/artifacts commands for
diagnosing runs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 12:48:21 +08:00
eust-w
a4b933330a ✨ Add ego dataset workflow builder for the POC platform
scripts/ego_workflows.py inspects an egocentric LeRobot dataset on BOS
through the platform API and creates processing workflows for it:
integrity checks, left-camera video QC, WiLoR 3D hand pose, and
SAM3.1 + hand removal (node settings cloned from the proven egodex
pipeline). Source and upload nodes are bound to the org's storage
connection so the worker can turn bos:// outputs into object refs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 12:01:35 +08:00
eust-w
fa213e0e7f 🐛 Restore BOS object refs for source-node outputs in the worker
Source operators (real_source, directory scan) list BOS objects without
downloading them and emit artifacts whose path is bos://bucket/key.
7ca47c62 removed the worker branch that turned those paths into object
refs, so every workflow reading mp4/parquet from BOS failed with
"artifact_externalization_failed: inaccessible operator staging file".

Convert bos:// outputs into object refs using the node's storage
connection (falling back to the artifact-storage policy), and validate
them like any other ref: the connection must belong to the run's
organization and the object must exist. The previous version skipped
both checks.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 11:59:25 +08:00
eust-w
f560f9b638 🔒 Fix tenant-isolation holes and stale-response races
Backend:
- Reject target=platform in the database browser; it let any org admin
  read every tenant's records (including password hashes) from the
  shared platform database. The UI never uses this target.
- Check run ownership before proxying /worker-api/runs/{id}/retry so an
  org cannot re-run another org's workflow.
- Resolve symlinks when reading lightweight operator files; a symlinked
  parent directory could expose files outside the code root.
- Remove uploaded image archives after import instead of leaving
  multi-GB tarballs on the shared workspace PVC.

Frontend:
- Ignore stale responses in the lightweight code editors (component and
  Operators page) so a slow load cannot put file A's content under file
  B, where Save would overwrite B. Stop re-listing on every file click.
- Ignore stale collection queries in the database browser so edits
  cannot be saved against the wrong collection.
- Ignore stale run-detail responses in the Monitoring modal.
- Join an in-flight workflow save instead of starting a second one that
  reports a false "server version changed" conflict.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 11:35:06 +08:00
eust-w
c9f5dc5f4d 🚨 Restore lint gates: rustfmt, clippy, gofmt and prettier
- Run cargo fmt across the drosync workspace.
- Fix clippy -D warnings failures (pedantic): collapse nested ifs with
  let-chains, replace wildcard imports, add #[must_use], use
  unsigned_abs() for clamped i64->u64 casts, rename Phase.phase field,
  and allow too_many_lines/too_many_arguments where the repo already does.
- gofmt internal/lightweight/lightweight_test.go.
- Prettier-format three frontend test files.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-27 11:35:06 +08:00
WishForge Agent
4142761b56 ✨ WishForge checkpoint 98132ff7-74fb-4267-9ed0-a37a4a4f8958 2026-10-26 22:49:34 +08:00
WishForge Agent
cd2ef2fea7 ✨ WishForge checkpoint b8be37e2-e3bc-404d-a44b-118bb68b64f6 2026-10-26 20:25:40 +08:00
WishForge Agent
40c7b51745 ✨ WishForge checkpoint 4f766ff3-e4bb-4711-bbff-d74709ea3662 2026-10-26 20:07:10 +08:00
WishForge Agent
a18918e559 ✨ WishForge checkpoint f8a87367-8797-4e3e-bf00-dec2f5bff090 2026-10-26 19:59:48 +08:00
WishForge Agent
2dc346aae3 ✨ WishForge checkpoint 73ce518e-f9c2-42c1-be75-a61eebb6edbf 2026-10-26 16:50:30 +08:00
WishForge Agent
b38f628455 ✨ WishForge checkpoint e4c55b06-58cd-4301-9589-6122c84f2649 2026-10-26 11:50:44 +08:00
WishForge Agent
72bab5d622 ✨ WishForge checkpoint 3778ea4c-198d-4c4a-be36-2bcb3736c6fd 2026-10-26 05:46:40 +08:00
WishForge Agent
4a8dc3bf4f ✨ WishForge checkpoint 3778ea4c-198d-4c4a-be36-2bcb3736c6fd 2026-10-26 05:44:26 +08:00
WishForge Agent
a89949dff4 ✨ WishForge checkpoint bf95a4c1-4f4f-4589-a19f-9e9a22cd678f 2026-10-26 03:19:26 +08:00
WishForge Agent
b1fde84ef9 ✨ WishForge checkpoint f6331c6e-a5d4-407e-b85f-74b522536e76 2026-10-26 02:29:59 +08:00
WishForge Agent
64a1869494 ✨ WishForge checkpoint bf0cbebf-287b-47a1-bfc2-68a1a9205c5c 2026-10-26 00:52:36 +08:00
WishForge Agent
2be15f098a ✨ WishForge checkpoint bf0cbebf-287b-47a1-bfc2-68a1a9205c5c 2026-10-26 00:50:35 +08:00
eust-w
1579c747ac 🧪 Verify public drobotic-pull package on clean Ubuntu 22.04
Record fresh public-download installation as a normal user, UBT authentication and real BOS transfer, 12 CLI regressions, interrupted 4 GiB resume with full SHA256, and a 307-second continuous response. Document the Colima amd64 emulation boundary and that no customer device was modified.
2026-10-22 15:20:02 +08:00
eust-w
f553e40494 📦 Document public downloads for drobotic-pull 1.0.1
Publish the existing verified archive and checksum as two public-read BOS objects under a versioned prefix. Record anonymous HTTPS readback, matching SHA256, and Linux version verification without changing bucket permissions.
2026-10-22 15:01:53 +08:00
WishForge Agent
7613677dfe Merge commit 'a3f5c7fd15e2ee6694aef0b8be9e09737381d3cb' into HEAD 2026-10-22 14:58:16 +08:00
eust-w
6a4e96c835 🧪 Record Ubuntu 22.04 installation failure and update validation 2026-10-22 14:55:42 +08:00
eust-w
8780cd598c 🐛 Fix large model downloads and package drobotic-pull 1.0.1
The old shipped v1.0.0 used a 300-second whole-response deadline. Keep active transfers alive, validate ranged retries, filter BOS folder markers, and preserve accurate failure/progress reporting. Verify the Linux package with interrupted 4 GiB transfers, a 307-second stream, and the real 7.47 GiB checkpoint with matching SHA256 receipts.
2026-10-22 14:19:48 +08:00
WishForge Agent
a3f5c7fd15 ✨ WishForge checkpoint f40620ef-d04c-4903-a7e9-0c81551b0830 2026-10-22 14:14:03 +08:00
WishForge Agent
6c02c882ef ✨ Improve POC status checks and retry controls 2026-10-22 13:59:11 +08:00
eust-w
b93232d31c 🐛 Fix partial-session receipt recovery in drosync 1.1.2 2026-10-22 13:07:11 +08:00
eust-w
96a1852348 🧪 Record drosync 1.1.1 real BOS regression and unresolved Linux risks 2026-10-16 11:29:17 +08:00
eust-w
b2a8df4f28 📦 Release drosync 1.1.1 with configuration docs and Linux compatibility tests 2026-10-16 10:05:58 +08:00
eust-w
4b53f0deca 📝 Update complete drosync 1.0.35 configuration and requirements guide 2026-10-16 06:20:07 +08:00
eust-w
a1fb6a451c 🧪 Record Linux glibc compatibility verification evidence 2026-10-16 06:18:14 +08:00
eust-w
ee9d7b4272 📦 Build drosync 1.0.35 for Linux x86_64 and verify glibc 2.39 2026-10-16 06:18:08 +08:00
eust-w
3072e1c105 📝 Normalize regression evidence formatting 2026-10-16 06:12:03 +08:00
eust-w
5ec5ea4ad4 🐛 Fix missing-source classification and fallback log path resolution 2026-10-16 06:11:36 +08:00
eust-w
8fc801c9d5 🧪 Audit daily upload requirements against real BOS 2026-10-16 05:12:51 +08:00
eust-w
17b6e0c1a4 🧾 Preserve POC migration and upload test evidence 2026-10-16 03:53:42 +08:00
eust-w
11bb5e1bf5 🚀 Consolidate POC control plane and verify real BOS uploads 2026-10-16 03:51:32 +08:00
eust-w
ac1e258f48 ✅ Record large-file completion after detailed progress rollout 2026-10-15 20:15:28 +08:00
eust-w
cae97006d0 📊 Show live scan and MD5 preparation stages in daily reports 2026-10-15 20:12:18 +08:00
eust-w
0aa8b4797c ✅ Enable parallel POC manual uploads and verify persistent recovery 2026-10-15 17:30:48 +08:00
eust-w
6234e5acd8 📝 Inventory POC cutover blockers and verify v2 candidate authentication 2026-10-15 16:56:43 +08:00
eust-w
2e46d60da9 📝 Record POC manual upload space and authentication blocker 2026-10-15 15:54:19 +08:00
eust-w
ae5fc2f1eb 📝 Document local drosync resident setup and pending cloud binding 2026-10-14 15:35:31 +08:00
eust-w
f536616e59 📊 Add file-level daily reports and exact missing-file lookup 2026-10-14 11:06:47 +08:00
eust-w
d87449c003 📊 Clarify daily report scope and correct binary size units 2026-10-13 21:36:54 +08:00
eust-w
693519d093 🧪 Complete real BOS acceptance and fix client retry diagnostics 2026-10-13 20:28:36 +08:00
eust-w
29e9012e97 📋 Preserve failing readiness and report reproductions 2026-10-13 15:59:34 +08:00
eust-w
2f0c0cf110 🧪 Expand native sync fault coverage and fix readiness reporting 2026-10-13 15:56:27 +08:00
eust-w
7ec402c225 📋 Preserve redacted client diagnostic log transcripts 2026-10-13 12:55:37 +08:00
eust-w
0f17fb05ae 🧭 Enhance client sync diagnostics and correlated logs 2026-10-13 12:54:15 +08:00
eust-w
03f8c67ce4 🧪 Validate multi-file BOS sync recovery and daily reports 2026-10-13 10:48:04 +08:00
eust-w
07443970c1 🧪 Verify macOS launchd startup and crash recovery 2026-10-13 04:37:44 +08:00
eust-w
0324c9af02 🧪 Verify Ubuntu 22.04 installation and real BOS uploads 2026-10-13 03:52:01 +08:00
eust-w
1717c2aa34 🧪 Validate optimized upload flow against POC Mongo and BOS 2026-10-13 02:13:59 +08:00
eust-w
793ffd8d31 ⚡ Skip confirmed files, stream ordered pages and finalize verified uploads 2026-10-13 01:58:10 +08:00
eust-w
716ce417a0 🚢 Deploy and validate isolated POC MD5 candidate with cutover inventory 2026-10-12 16:41:42 +08:00
eust-w
c4541228e4 📦 Prepare POC MD5 deployment candidate 1.0.25 2026-10-12 16:01:38 +08:00
eust-w
26da9e5094 🧪 Record MD5-only Ubuntu and real BOS acceptance 2026-10-12 15:43:15 +08:00
eust-w
9a5f9ed547 ⚡ Use MD5-only upload integrity with explicit hash epoch migration 2026-10-12 15:34:26 +08:00
eust-w
b6862328e5 🐧 Validate installed Ubuntu uploads and fix BOS metadata identity casing 2026-10-12 11:27:51 +08:00
eust-w
64f6c2ea64 📦 Prepare drosync Ubuntu 22.04 installation acceptance build 2026-10-12 10:58:42 +08:00
eust-w
a9bd309124 📋 Preserve drosync test execution logs 2026-10-12 10:37:58 +08:00
eust-w
3cfa871ce1 🧪 Verify drosync functionality and repair stale test fixtures 2026-10-12 10:37:47 +08:00
eust-w
2dc54070c2 ⚙️ Default drosync file and upload concurrency to four 2026-10-12 04:10:24 +08:00
eust-w
ca976a8c17 🕒 Dispatch drosync uploads by capture time 2026-10-12 04:00:21 +08:00
eust-w
ede4c61f82 🚀 Upload drosync files directly to final BOS paths 2026-10-12 03:35:15 +08:00
eust-w
fbb3cdf32b 📐 Add source-backed drosync system architecture diagram 2026-10-10 18:31:31 +08:00
eust-w
5d90885c5d 📝 Record deployed organization storage isolation acceptance 2026-10-10 18:06:20 +08:00
eust-w
3fb1157172 🔄 Automatically recover pending organization storage provisioning 2026-10-10 17:52:10 +08:00
eust-w
13ffd61780 🔒 Automatically scope storage for newly created organizations 2026-10-10 17:41:52 +08:00
eust-w
bcba368c82 📝 Record UBT scope validation and POC cutover blockers 2026-10-10 16:59:25 +08:00
eust-w
cb6c52e1bb 🧪 Support scoped BOS roots in POC acceptance 2026-10-10 16:55:15 +08:00
eust-w
e3f318f58d 🔒 Enforce organization storage roots across BOS workflows 2026-10-10 16:48:55 +08:00
eust-w
67996db45d 🛡️ Protect archived uploads and surface local hash conflicts 2026-10-10 16:46:02 +08:00
eust-w
b593d78392 📝 Audit reported upload timeout, ordering and metadata polling 2026-10-10 15:49:19 +08:00
eust-w
32ff9b065c 📊 Document daily upload completion and system architecture 2026-10-10 15:18:07 +08:00
eust-w
798aabe101 📝 Correct the remote prefix requirement comparison 2026-10-09 16:52:02 +08:00
eust-w
6f4d3ea35e 📝 Record POC artifacts and real BOS acceptance results 2026-10-09 14:12:30 +08:00
eust-w
7568df7fdd 🐛 Fix durable Linux cleanup and recovery in drosync 1.0.14 2026-10-09 13:36:18 +08:00
eust-w
871f70801d 🐛 Preserve Mongo lease identities for safe cleanup in 1.0.13 2026-10-09 13:06:57 +08:00
eust-w
7bad447d89 🐛 Fix duplicate upload length headers in drosync 1.0.12 2026-10-09 12:53:50 +08:00
eust-w
b5100f6660 📦 Prepare drosync 1.0.11 for POC rollout 2026-10-09 11:53:55 +08:00
eust-w
a7b62bef98 🗓️ Use calendar selection for the daily report date 2026-10-09 11:42:23 +08:00
eust-w
c8feea8f9c 🐛 Unify upload reporting and recovery across failure states 2026-10-09 11:31:10 +08:00
eust-w
6ebcd28921 🐛 Fix daily upload audit gaps in missing files and recovery 2026-10-08 20:43:51 +08:00
eust-w
9152bcf359 ✨ Complete daily upload workflows and bounded performance controls 2026-10-08 19:22:49 +08:00
eust-w
8a447d2532 📝 Clarify read-only audit credential boundary 2026-10-08 17:24:35 +08:00
eust-w
04b89ce305 📝 Explain active POC workloads and cancellation impact 2026-10-08 17:22:05 +08:00
eust-w
ade54848fc 🛠️ Correct cutover inventory and record POC migration prerequisites 2026-10-08 16:33:02 +08:00
eust-w
49a954610f 📝 Record POC image smoke tests and coordinated cutover gate 2026-10-08 15:35:18 +08:00
eust-w
1044b507c8 🛠️ Repair resumable metadata and bounded BOS recovery 2026-10-08 15:08:01 +08:00
eust-w
018730c993 📝 Audit remaining drosync metadata and timeout failures 2026-10-08 14:08:35 +08:00
eust-w
95d94b3309 ✨ Complete drosync workflows and recovery safeguards 2026-10-08 12:25:38 +08:00
eust-w
53a4d7db63 📝 Audit drosync feature workflows and closure gaps 2026-10-07 21:44:00 +08:00
eust-w
62eadffab9 🚀 Harden drosync workflows and scale upload metadata 2026-10-03 02:48:48 +08:00
eust-w
a9d72cf74c 📝 Audit drosync entry points, reliability, and performance 2026-10-03 00:43:39 +08:00
eust-w
bf0a961a32 ♻️ Consolidate drosync operations into single canonical entries 2026-10-01 00:05:09 +08:00
eust-w
885e79f251 ⚡ Optimize drosync commit progress polling and session summaries 2026-09-30 15:11:04 +08:00
eust-w
f7f9825ab6 🛡️ Handle missing local files and non-retryable transfer errors gracefully 2026-09-30 00:36:10 +08:00
eust-w
aac339438c ✨ fix(daemon): unify service user to ubt and load config from files 2026-09-23 11:57:01 +08:00
eust-w
2ca1c7367e 🧹 docs: remove external documentation files from repo and link to live Feishu documents 2026-09-23 05:18:51 +08:00
eust-w
0c9a60013a 📚 docs: complete external developer and user documentation suite for POC 2026-09-23 05:07:05 +08:00
eust-w
3512ce1ccb 📝 docs: add external documentation architecture plan and feishu blueprint 2026-09-23 04:59:53 +08:00
eust-w
65395bdd16 📚 docs: add drosync v1.0.1 deployment and operations guide 2026-09-23 04:41:45 +08:00
eust-w
1bb26f2af0 📦 chore(release): bump drosync to v1.0.1 and document versioning rule 2026-09-23 04:37:10 +08:00
eust-w
caccedd4a1 🔧 Improve clean-install script with daemon_meta table and container check 2026-09-23 04:31:31 +08:00
eust-w
47d9a6d0c0 ✨ Remove duplicate CLI entry points and consolidate daemon management to system service 2026-09-23 03:34:08 +08:00
eust-w
2241742d9c ✨ Prioritize system state_db and add web api endpoints for status, mappings, pause, and abort 2026-09-23 03:13:41 +08:00
eust-w
a95b074b1d ✨ Support dual system socket paths and system token fallback for single entry point 2026-09-23 03:06:53 +08:00
eust-w
1523d85492 ⚡️ Decouple abort from transfer gate to eliminate deadlock 2026-09-23 02:51:01 +08:00
eust-w
b4b0d32779 ✨ Fall back to system state_db in web dashboard 2026-09-23 02:47:10 +08:00
eust-w
9481e8ee57 ✨ Unify drosync daemon entry points with automatic system socket fallback 2026-09-23 02:27:57 +08:00
eust-w
8846ec3e7d ✨ feat(drosync): add clean installation script and stale session cleanup to linux installer 2026-09-22 20:13:36 +08:00
eust-w
8fb87fc356 ✨ fix(drosync): auto-abort stale incompatible journals and enhance session abort 2026-09-22 20:03:48 +08:00
eust-w
4b397140a4 📝 docs(drosync): update feishu manual with latest release download links 2026-09-22 15:00:42 +08:00
eust-w
4d2b6025d3 🐛 fix daily report missing match when mapping uses remote_prefix 2026-09-22 14:03:07 +08:00
eust-w
c31b12e609 ✨ respect DROSYNC_REPORT_DIR in web dashboard export endpoint 2026-09-21 17:18:41 +08:00
eust-w
73c90acd22 ✨ support DROSYNC_REPORT_DIR environment variable for global report output directory 2026-09-21 16:24:37 +08:00
eust-w
bb524b3ee2 📝 docs(drosync): update feishu manual with new download links and sync troubleshooting FAQ 2026-09-21 14:44:04 +08:00
eust-w
9f297d47b9 ✨ feat(drosync): support optional mapping_id, diagnostic zero-file hint, and web one-click sync 2026-09-21 14:33:25 +08:00
eust-w
549d2e65de 📝 docs(drosync): update feishu manual with latest web-report download links 2026-09-20 17:01:56 +08:00
eust-w
112ec4bdf9 📝 Clarify POC cutover maintenance requirements 2026-09-19 21:35:16 +08:00
eust-w
7ca47c628b 🧹 Enforce current contracts and retire legacy runtime compatibility 2026-09-19 21:32:23 +08:00
eust-w
e1c6c8b2f6 🧹 Remove retired drosync pairing implementation and schemas 2026-09-19 18:09:03 +08:00
eust-w
38d5a46f33 🧹 Remove legacy user roles and reject unsupported identities 2026-09-19 17:58:37 +08:00
eust-w
6464c33f2b 📝 docs: document POC role scenarios and actual permissions 2026-09-19 17:46:07 +08:00
eust-w
ebc1316fb6 📝 docs(drobotic-pull): update user manual with download links and resume features 2026-09-18 15:28:39 +08:00
eust-w
6e8295ae01 ✨ feat(drobotic-pull): support HTTP Range resume and idle stream timeout 2026-09-18 15:00:06 +08:00
eust-w
57396ba7eb 📚 docs: update drosync manual markdown and add standalone html version 2026-09-17 17:30:56 +08:00
eust-w
9245c40e50 ✨ feat: add local unauthenticated sync report dashboard with configurable port 2026-09-17 15:24:05 +08:00
eust-w
1a95cbdf10 📊 feat(drosync): add daily upload statistics report and web dashboard 2026-09-17 14:19:22 +08:00
eust-w
ecce5c8c2b 📚 Add drosync Feishu user manual and architecture documentation 2026-09-17 10:27:06 +08:00
eust-w
b5e67add36 📚 Add drobotic-pull user manual for Feishu documentation 2026-09-17 09:15:57 +08:00
eust-w
5f75cfccf3 🔧 Ignore Rust target directories and track Cargo.lock 2026-09-17 09:04:34 +08:00
eust-w
c01947857a ✨ Fix storage connection list parsing and default bucket resolution in drobotic-pull 2026-09-17 08:30:23 +08:00
eust-w
109290eeb1 ✨ Add drobotic-pull Rust tool and directory manifest API 2026-09-17 08:16:31 +08:00
eust-w
02c654c0ea 🐛 Resolve storage connection credentials from input bindings in worker 2026-09-07 19:52:43 +08:00
eust-w
eb1f49c146 🐛 Fix sessions respawning after mapping removal
- Add database guard in scheduler sync path to re-check mapping
  existence before calling sync_mapping, closing the race window
  between the 60s in-memory cache refresh and mapping.remove
- Abort orphaned non-terminal sessions when a mapping is removed
- Clear pending journal entry on mapping removal to prevent
  restart-triggered session creation
2026-09-07 17:47:42 +08:00
eust-w
fe10b9c048 🧪 Add live drosync manifest boundary regression 2026-09-06 04:32:10 +08:00
eust-w
6a2056f67b 🧪 Add reproducible drosync POC abort regression and evidence 2026-09-05 23:10:58 +08:00
eust-w
5b80cb68e0 🐛 Fix drosync aborted session lease cleanup and heartbeat guards 2026-09-05 22:39:34 +08:00
eust-w
1f994927c0 🔒 Preserve POC rollback baseline and drosync script permissions 2026-09-05 14:29:14 +08:00
eust-w
0d5578421e 🐛 Stabilize drosync automatic scheduling 2026-09-05 14:22:21 +08:00
eust-w
76cc571c49 📚 Add drosync Chinese user manual 2026-09-05 14:22:20 +08:00
eust-w
685671f390 🔒 Support headless drosync system services 2026-09-05 14:22:20 +08:00
eust-w
927b1f7163 📦 Harden drosync Linux packages 2026-09-05 14:22:20 +08:00
eust-w
0c02227082 ✨ Add bucket-based drosync mappings 2026-09-05 14:22:20 +08:00
eust-w
6ff9e55405 📦 Preserve drosync ARM64 packaging and signed updates 2026-09-05 14:22:20 +08:00
1969 changed files with 323031 additions and 43075 deletions

View File

@ -0,0 +1,539 @@
{
"schema_version": 1,
"diagram_type": "architecture",
"meta": {
"title": "DroboticFlow 系统架构与存储边界",
"locale": "zh-CN",
"output": ".archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"quality_profile": "showcase",
"repository": {
"url": "git@gitea.d-robotics.cc:longtao.wu/droboticflow.git",
"revision": "798aabe101f34c30e160f1771c474c90fc9c06e4",
"link_mode": "local-only"
}
},
"components": [
{
"id": "web",
"type": "frontend",
"label": "Web 业务界面",
"sublabel": "工作流·审核·存储",
"pos": [
40,
70
],
"size": [
230,
100
],
"sources": [
{
"path": "src/services/api/client.ts",
"line": 67,
"end_line": 105
},
{
"path": "internal/api/auth.go",
"line": 288,
"end_line": 316
},
{
"path": "internal/api/object_storage_browser.go",
"line": 2090,
"end_line": 2124
}
],
"tag": "登录与角色权限"
},
{
"id": "api",
"type": "backend",
"label": "Go API 控制面",
"sublabel": "业务管理·设备与上传授权",
"pos": [
440,
70
],
"size": [
240,
100
],
"sources": [
{
"path": "cmd/api/main.go",
"line": 83,
"end_line": 132
},
{
"path": "internal/api/object_sync.go",
"line": 2180,
"end_line": 2255
},
{
"path": "internal/api/object_storage_browser.go",
"line": 1194,
"end_line": 1224
}
],
"tag": "连接按组织校验"
},
{
"id": "mongo",
"type": "database",
"label": "MongoDB 控制状态",
"sublabel": "任务·Session·租约·审计",
"pos": [
850,
70
],
"size": [
260,
100
],
"sources": [
{
"path": "internal/store/object_sync.go",
"line": 884,
"end_line": 914
},
{
"path": "internal/store/mongo.go",
"line": 646,
"end_line": 684
},
{
"path": "internal/store/mongo.go",
"line": 1162,
"end_line": 1240
}
]
},
{
"id": "worker",
"type": "backend",
"label": "Go Worker 调度",
"sublabel": "轮询任务·维护运行状态",
"pos": [
1280,
70
],
"size": [
240,
100
],
"sources": [
{
"path": "cmd/worker/main.go",
"line": 79,
"end_line": 119
},
{
"path": "internal/worker/runtime.go",
"line": 432,
"end_line": 452
},
{
"path": "internal/worker/artifact_storage.go",
"line": 229,
"end_line": 320
}
]
},
{
"id": "cli",
"type": "frontend",
"label": "Drosync CLI",
"sublabel": "auth / mapping / sync / clean",
"pos": [
40,
400
],
"size": [
230,
100
],
"sources": [
{
"path": "tools/drosync/crates/cli/src/main.rs",
"line": 246,
"end_line": 264
},
{
"path": "tools/drosync/crates/cli/src/main.rs",
"line": 399,
"end_line": 481
}
],
"tag": "唯一操作入口"
},
{
"id": "daemon",
"type": "backend",
"label": "Rust Daemon",
"sublabel": "扫描·调度·上传·本地恢复",
"pos": [
440,
400
],
"size": [
240,
100
],
"sources": [
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 270,
"end_line": 318
},
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 719,
"end_line": 750
},
{
"path": "tools/drosync/crates/daemon/src/clean_service.rs",
"line": 67,
"end_line": 105
}
]
},
{
"id": "bos",
"type": "cloud",
"label": "BOS 对象存储",
"sublabel": "暂存·正式对象·发布·审计",
"pos": [
850,
400
],
"size": [
260,
115
],
"sources": [
{
"path": "internal/objectsync/coordinator.go",
"line": 813,
"end_line": 927
},
{
"path": "internal/api/object_storage_browser.go",
"line": 1316,
"end_line": 1358
},
{
"path": "internal/api/object_sync.go",
"line": 500,
"end_line": 516
}
],
"tag": "同桶权限可导致可见范围重叠"
},
{
"id": "job",
"type": "backend",
"label": "Kubernetes 算子 Job",
"sublabel": "Runner 或自定义容器",
"pos": [
1280,
400
],
"size": [
240,
100
],
"sources": [
{
"path": "internal/worker/executor.go",
"line": 841,
"end_line": 875
},
{
"path": "internal/k8s/launcher.go",
"line": 1372,
"end_line": 1408
},
{
"path": "internal/k8s/launcher.go",
"line": 568,
"end_line": 655
}
],
"tag": "CPU / GPU 调度"
},
{
"id": "files",
"type": "external",
"label": "采集源文件",
"sublabel": "本机目录·稳定文件扫描",
"pos": [
40,
740
],
"size": [
230,
100
],
"sources": [
{
"path": "tools/drosync/crates/core/src/lib.rs",
"line": 570,
"end_line": 696
}
]
},
{
"id": "sqlite",
"type": "database",
"label": "SQLite 本机状态",
"sublabel": "回执·检查点·文件进度",
"pos": [
440,
740
],
"size": [
240,
100
],
"sources": [
{
"path": "tools/drosync/crates/state/src/lib.rs",
"line": 66,
"end_line": 107
},
{
"path": "tools/drosync/crates/state/src/lib.rs",
"line": 609,
"end_line": 705
},
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 37,
"end_line": 74
}
]
},
{
"id": "coordinator",
"type": "backend",
"label": "Go Drosync 协调器",
"sublabel": "规划·提交·对账·清理",
"pos": [
850,
740
],
"size": [
260,
100
],
"sources": [
{
"path": "cmd/drosync-coordinator/main.go",
"line": 57,
"end_line": 95
},
{
"path": "internal/objectsync/coordinator.go",
"line": 775,
"end_line": 930
}
],
"tag": "租约与条件发布"
},
{
"id": "workspace",
"type": "database",
"label": "共享工作区 PVC",
"sublabel": "输入·结果·算子代码",
"pos": [
1280,
740
],
"size": [
240,
100
],
"sources": [
{
"path": "internal/worker/executor.go",
"line": 431,
"end_line": 468
},
{
"path": "internal/worker/executor.go",
"line": 694,
"end_line": 755
},
{
"path": "internal/k8s/launcher.go",
"line": 568,
"end_line": 700
}
]
}
],
"connections": [
{
"id": "web-api",
"from": "web",
"to": "api",
"label": "登录 / HTTP",
"variant": "default"
},
{
"id": "api-mongo",
"from": "api",
"to": "mongo",
"label": "业务状态",
"variant": "default"
},
{
"id": "worker-mongo",
"from": "worker",
"to": "mongo",
"label": "轮询 / 更新",
"variant": "default"
},
{
"id": "worker-job",
"from": "worker",
"to": "job",
"label": "创建 Job",
"variant": "default"
},
{
"id": "job-workspace",
"from": "job",
"to": "workspace",
"label": "挂载 PVC",
"variant": "default"
},
{
"id": "worker-workspace",
"from": "worker",
"to": "workspace",
"label": "写输入 / 读结果",
"variant": "default"
},
{
"id": "cli-daemon",
"from": "cli",
"to": "daemon",
"label": "本机 IPC",
"variant": "default"
},
{
"id": "files-daemon",
"from": "files",
"to": "daemon",
"label": "扫描 / 读取",
"variant": "default"
},
{
"id": "daemon-sqlite",
"from": "daemon",
"to": "sqlite",
"label": "持久化状态",
"variant": "default"
},
{
"id": "daemon-api",
"from": "daemon",
"to": "api",
"label": "设备凭据 / 元信息",
"variant": "security"
},
{
"id": "daemon-bos",
"from": "daemon",
"to": "bos",
"label": "预签名 PUT",
"variant": "emphasis"
},
{
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"variant": "default"
},
{
"id": "coordinator-bos",
"from": "coordinator",
"to": "bos",
"label": "校验 / 条件发布",
"variant": "default"
},
{
"id": "api-bos",
"from": "api",
"to": "bos",
"label": "浏览:前缀范围未隔离",
"variant": "security"
},
{
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"variant": "dashed"
},
{
"id": "worker-bos",
"from": "worker",
"to": "bos",
"label": "产物策略:BOS 落盘",
"variant": "dashed"
}
],
"boundaries": [
{
"kind": "region",
"label": "采集机 · 本地上传服务",
"wraps": [
"cli",
"daemon",
"files",
"sqlite"
],
"pad": 28
},
{
"kind": "region",
"label": "工作流执行与持久工作区",
"wraps": [
"job",
"workspace"
],
"pad": 28
}
],
"cards": [
{
"dot": "cyan",
"title": "两条主线",
"items": [
"业务:Web → API → MongoDB;Worker 轮询任务并创建算子 Job。",
"上传:CLI → daemon → API 获取授权;文件字节直接 PUT 到 BOS,协调器确认正式提交。"
]
},
{
"dot": "rose",
"title": "组织与存储的实际边界",
"items": [
"API 按组织过滤连接、Space 和 Session;连接记录隔离不等于底层对象隔离。",
"普通存储浏览未限定组织路径;工作流浏览还存在 bucket 绑定及 sourcePath 归属校验缺口。",
"两个组织的凭据若均可访问同一 bucket,仍可能看到相同对象;预签名 GET 在有效期内直接访问 BOS。"
]
},
{
"dot": "amber",
"title": "需求实现与现场交付",
"items": [
"七项每日上传需求已有代码及测试证据:配置、命令、并发、缺失跳过、清理、日志、逐文件进度。",
"客户端 1.0.14 / 候选服务端 1.0.13 的隔离真实 BOS 验收通过;POC 业务切换和采集机升级尚未完成。",
"本图固定于 poc 源码 798aabe1,描述代码架构,不表示新候选已在业务环境运行。"
]
}
]
}

View File

@ -0,0 +1,539 @@
{
"schema_version": 1,
"diagram_type": "architecture",
"meta": {
"title": "DroboticFlow 系统架构与存储边界",
"locale": "zh-CN",
"output": ".archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"quality_profile": "showcase",
"repository": {
"url": "git@gitea.d-robotics.cc:longtao.wu/droboticflow.git",
"revision": "798aabe101f34c30e160f1771c474c90fc9c06e4",
"link_mode": "local-only"
}
},
"components": [
{
"id": "web",
"type": "frontend",
"label": "Web 业务界面",
"sublabel": "工作流·审核·存储",
"pos": [
40,
70
],
"size": [
230,
100
],
"sources": [
{
"path": "src/services/api/client.ts",
"line": 67,
"end_line": 105
},
{
"path": "internal/api/auth.go",
"line": 288,
"end_line": 316
},
{
"path": "internal/api/object_storage_browser.go",
"line": 2090,
"end_line": 2124
}
],
"tag": "登录与角色权限"
},
{
"id": "api",
"type": "backend",
"label": "Go API 控制面",
"sublabel": "业务管理·设备与上传授权",
"pos": [
440,
70
],
"size": [
240,
100
],
"sources": [
{
"path": "cmd/api/main.go",
"line": 83,
"end_line": 132
},
{
"path": "internal/api/object_sync.go",
"line": 2180,
"end_line": 2255
},
{
"path": "internal/api/object_storage_browser.go",
"line": 1194,
"end_line": 1224
}
],
"tag": "连接按组织校验"
},
{
"id": "mongo",
"type": "database",
"label": "MongoDB 控制状态",
"sublabel": "任务·Session·租约·审计",
"pos": [
850,
70
],
"size": [
260,
100
],
"sources": [
{
"path": "internal/store/object_sync.go",
"line": 884,
"end_line": 914
},
{
"path": "internal/store/mongo.go",
"line": 646,
"end_line": 684
},
{
"path": "internal/store/mongo.go",
"line": 1162,
"end_line": 1240
}
]
},
{
"id": "worker",
"type": "backend",
"label": "Go Worker 调度",
"sublabel": "轮询任务·维护运行状态",
"pos": [
1280,
70
],
"size": [
240,
100
],
"sources": [
{
"path": "cmd/worker/main.go",
"line": 79,
"end_line": 119
},
{
"path": "internal/worker/runtime.go",
"line": 432,
"end_line": 452
},
{
"path": "internal/worker/artifact_storage.go",
"line": 229,
"end_line": 320
}
]
},
{
"id": "cli",
"type": "frontend",
"label": "Drosync CLI",
"sublabel": "auth / mapping / sync / clean",
"pos": [
40,
400
],
"size": [
230,
100
],
"sources": [
{
"path": "tools/drosync/crates/cli/src/main.rs",
"line": 246,
"end_line": 264
},
{
"path": "tools/drosync/crates/cli/src/main.rs",
"line": 399,
"end_line": 481
}
],
"tag": "唯一操作入口"
},
{
"id": "daemon",
"type": "backend",
"label": "Rust Daemon",
"sublabel": "扫描·调度·上传·本地恢复",
"pos": [
440,
400
],
"size": [
240,
100
],
"sources": [
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 270,
"end_line": 318
},
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 719,
"end_line": 750
},
{
"path": "tools/drosync/crates/daemon/src/clean_service.rs",
"line": 67,
"end_line": 105
}
]
},
{
"id": "bos",
"type": "cloud",
"label": "BOS 对象存储",
"sublabel": "暂存·正式对象·发布·审计",
"pos": [
850,
400
],
"size": [
260,
115
],
"sources": [
{
"path": "internal/objectsync/coordinator.go",
"line": 813,
"end_line": 927
},
{
"path": "internal/api/object_storage_browser.go",
"line": 1316,
"end_line": 1358
},
{
"path": "internal/api/object_sync.go",
"line": 500,
"end_line": 516
}
],
"tag": "同桶权限可导致可见范围重叠"
},
{
"id": "job",
"type": "backend",
"label": "Kubernetes 算子 Job",
"sublabel": "Runner 或自定义容器",
"pos": [
1280,
400
],
"size": [
240,
100
],
"sources": [
{
"path": "internal/worker/executor.go",
"line": 841,
"end_line": 875
},
{
"path": "internal/k8s/launcher.go",
"line": 1372,
"end_line": 1408
},
{
"path": "internal/k8s/launcher.go",
"line": 568,
"end_line": 655
}
],
"tag": "CPU / GPU 调度"
},
{
"id": "files",
"type": "external",
"label": "采集源文件",
"sublabel": "本机目录·稳定文件扫描",
"pos": [
40,
740
],
"size": [
230,
100
],
"sources": [
{
"path": "tools/drosync/crates/core/src/lib.rs",
"line": 570,
"end_line": 696
}
]
},
{
"id": "sqlite",
"type": "database",
"label": "SQLite 本机状态",
"sublabel": "回执·检查点·文件进度",
"pos": [
440,
740
],
"size": [
240,
100
],
"sources": [
{
"path": "tools/drosync/crates/state/src/lib.rs",
"line": 66,
"end_line": 107
},
{
"path": "tools/drosync/crates/state/src/lib.rs",
"line": 609,
"end_line": 705
},
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 37,
"end_line": 74
}
]
},
{
"id": "coordinator",
"type": "backend",
"label": "Go Drosync 协调器",
"sublabel": "规划·提交·对账·清理",
"pos": [
850,
740
],
"size": [
260,
100
],
"sources": [
{
"path": "cmd/drosync-coordinator/main.go",
"line": 57,
"end_line": 95
},
{
"path": "internal/objectsync/coordinator.go",
"line": 775,
"end_line": 930
}
],
"tag": "租约与条件发布"
},
{
"id": "workspace",
"type": "database",
"label": "共享工作区 PVC",
"sublabel": "输入·结果·算子代码",
"pos": [
1280,
740
],
"size": [
240,
100
],
"sources": [
{
"path": "internal/worker/executor.go",
"line": 431,
"end_line": 468
},
{
"path": "internal/worker/executor.go",
"line": 694,
"end_line": 755
},
{
"path": "internal/k8s/launcher.go",
"line": 568,
"end_line": 700
}
]
}
],
"connections": [
{
"id": "web-api",
"from": "web",
"to": "api",
"label": "登录 / HTTP",
"variant": "default"
},
{
"id": "api-mongo",
"from": "api",
"to": "mongo",
"label": "业务状态",
"variant": "default"
},
{
"id": "worker-mongo",
"from": "worker",
"to": "mongo",
"label": "轮询 / 更新",
"variant": "default"
},
{
"id": "worker-job",
"from": "worker",
"to": "job",
"label": "创建 Job",
"variant": "default"
},
{
"id": "job-workspace",
"from": "job",
"to": "workspace",
"label": "挂载 PVC",
"variant": "default"
},
{
"id": "worker-workspace",
"from": "worker",
"to": "workspace",
"label": "写输入 / 读结果",
"variant": "default"
},
{
"id": "cli-daemon",
"from": "cli",
"to": "daemon",
"label": "本机 IPC",
"variant": "default"
},
{
"id": "files-daemon",
"from": "files",
"to": "daemon",
"label": "扫描 / 读取",
"variant": "default"
},
{
"id": "daemon-sqlite",
"from": "daemon",
"to": "sqlite",
"label": "持久化状态",
"variant": "default"
},
{
"id": "daemon-api",
"from": "daemon",
"to": "api",
"label": "设备凭据 / 元信息",
"variant": "security"
},
{
"id": "daemon-bos",
"from": "daemon",
"to": "bos",
"label": "预签名 PUT",
"variant": "emphasis"
},
{
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"variant": "default"
},
{
"id": "coordinator-bos",
"from": "coordinator",
"to": "bos",
"label": "校验 / 条件发布",
"variant": "default"
},
{
"id": "api-bos",
"from": "api",
"to": "bos",
"label": "浏览:前缀范围未隔离",
"variant": "security"
},
{
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"variant": "dashed"
},
{
"id": "worker-bos",
"from": "worker",
"to": "bos",
"label": "产物策略:BOS 落盘",
"variant": "dashed"
}
],
"boundaries": [
{
"kind": "region",
"label": "采集机 · 本地上传服务",
"wraps": [
"cli",
"daemon",
"files",
"sqlite"
],
"pad": 28
},
{
"kind": "region",
"label": "工作流执行与持久工作区",
"wraps": [
"job",
"workspace"
],
"pad": 28
}
],
"cards": [
{
"dot": "cyan",
"title": "两条主线",
"items": [
"业务:Web → API → MongoDB;Worker 轮询任务并创建算子 Job。",
"上传:CLI → daemon → API 获取授权;文件字节直接 PUT 到 BOS,协调器确认正式提交。"
]
},
{
"dot": "rose",
"title": "组织与存储的实际边界",
"items": [
"API 按组织过滤连接、Space 和 Session;连接记录隔离不等于底层对象隔离。",
"普通存储浏览未限定组织路径;工作流浏览还存在 bucket 绑定及 sourcePath 归属校验缺口。",
"两个组织的凭据若均可访问同一 bucket,仍可能看到相同对象;预签名 GET 在有效期内直接访问 BOS。"
]
},
{
"dot": "amber",
"title": "需求实现与现场交付",
"items": [
"七项每日上传需求已有代码及测试证据:配置、命令、并发、缺失跳过、清理、日志、逐文件进度。",
"客户端 1.0.14 / 候选服务端 1.0.13 的隔离真实 BOS 验收通过;POC 业务切换和采集机升级尚未完成。",
"本图固定于 poc 源码 798aabe1,描述代码架构,不表示新候选已在业务环境运行。"
]
}
]
}

View File

@ -0,0 +1,721 @@
{
"schemaVersion": 1,
"ok": true,
"command": "browser-check",
"evidenceKind": "automated-browser",
"status": "pass",
"visualReview": "not-requested",
"provenance": "current",
"deliveryReceiptId": "bb780bee-355b-4237-bdbd-1f86791c9d2a",
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"state": {
"detail": "read",
"motion": "still"
},
"chrome": {
"status": "available",
"executable": "/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
},
"diagnostics": [],
"containment": {
"status": "pass",
"policy": "fit-or-reader-declared-readable-vertical-scroll",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"themeStates": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1600,
"height": 1000,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1920,
"height": 1080,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1440,
"height": 900,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
}
]
},
"readability": {
"status": "pass",
"minimumProjectedNodeTextPx": 6,
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"viewerChrome": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"captures": {
"status": "not-requested",
"screenshots": [],
"contactSheet": null
},
"sidecars": {
"receipt": "droboticflow-architecture.browser-check.json",
"files": []
}
}

View File

@ -0,0 +1,17 @@
{
"schemaVersion": 1,
"receiptId": "6fb4be46-e489-4474-aa02-50be096ecfa5",
"status": "current",
"command": "deliver",
"type": "architecture",
"input": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"output": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"specification": {
"sha256": "f03380112052a1ce6252e58ab6d63562188624844855c748aaf29cd244ae1919",
"bytes": 12002
},
"artifact": {
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
}
}

View File

@ -0,0 +1,243 @@
{
"schemaVersion": 1,
"ok": true,
"command": "finalize",
"status": "pass",
"type": "architecture",
"quality": "showcase",
"specification": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"sha256": "f03380112052a1ce6252e58ab6d63562188624844855c748aaf29cd244ae1919",
"bytes": 12002
},
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"gates": {
"validate": "pass",
"deliver": "pass",
"check": "pass",
"browser-check": "pass"
},
"diagnostics": [],
"diagnosticSummary": {
"total": 0,
"shown": 0,
"truncated": false
},
"evidence": {
"receipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.finalize.json",
"summaryReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.finalize-summary.json",
"browserCheckReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.browser-check.json"
},
"update": {
"status": "current",
"installedVersion": "3.0.1",
"availableVersion": "3.0.1",
"releaseNotes": null,
"checkedAt": "2026-10-09T12:28:15.117Z",
"source": "cache",
"noticeRequired": false,
"noticeText": null
},
"visualReview": "not-requested",
"durationMs": 6689,
"visualReviewRecommendation": {
"action": "inspect-route-readability",
"signals": {
"resolvedCrossovers": 5,
"routesOverSuggestedBends": 3,
"routesOverSuggestedStretch": 1
},
"reason": "Automated gates passed, but crossings or detours still need perceptual review before claiming visual quality.",
"affectedRoutes": {
"crossings": [
{
"left": {
"id": "daemon-api",
"from": "daemon",
"to": "api",
"label": "设备凭据 / 元信息",
"collectionIndex": 9,
"artifactIndex": 10
},
"right": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"point": [
560,
396
]
},
{
"left": {
"id": "daemon-bos",
"from": "daemon",
"to": "bos",
"label": "预签名 PUT",
"collectionIndex": 10,
"artifactIndex": 11
},
"right": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"point": [
847,
472.5499999999997
]
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "coordinator-bos",
"from": "coordinator",
"to": "bos",
"label": "校验 / 条件发布",
"collectionIndex": 12,
"artifactIndex": 13
},
"point": [
973,
608
],
"sharedNode": "coordinator"
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "api-bos",
"from": "api",
"to": "bos",
"label": "浏览:前缀范围未隔离",
"collectionIndex": 13,
"artifactIndex": 14
},
"point": [
847,
443.5
]
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"point": [
847,
457.5
]
}
],
"detours": [
{
"relationship": {
"id": "worker-workspace",
"from": "worker",
"to": "workspace",
"label": "写输入 / 读结果",
"collectionIndex": 5,
"artifactIndex": 6
},
"bends": 3,
"stretch": 1.065,
"directCorridorBlockers": [
{
"id": "job",
"label": "Kubernetes 算子 Job",
"box": [
1280,
400,
240,
100
]
}
]
},
{
"relationship": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"bends": 4,
"stretch": 1.461,
"directCorridorBlockers": [
{
"id": "bos",
"label": "BOS 对象存储",
"box": [
850,
400,
260,
115
]
}
]
},
{
"relationship": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"bends": 4,
"stretch": 1
}
],
"truncated": false
},
"hints": [
"daemon → api crosses web → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"daemon → bos crosses coordinator → mongo: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"coordinator → mongo and coordinator → bos cross next to coordinator: move node mongo or bos so the two reach coordinator from different sides (for example one level with it, one directly above or below it).",
"coordinator → mongo crosses api → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"coordinator → mongo crosses web → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"web → bos needs 4 bends: move node web or bos so they share a row or column with matching centers, or sit diagonally with a clear corner."
],
"repair": "Trace these relationships at the desktop viewport. For Architecture, use references/architecture-layout-repair.md: reflow a blocked main path or tangled connected scene, and repair an isolated defect locally only when the surrounding composition is accepted. Preserve all semantic content and user-fixed geometry. Rerun finalize once after the edit."
}
}

File diff suppressed because one or more lines are too long

View File

@ -0,0 +1,20 @@
{
"diagram_type": "architecture",
"output": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"specification_sha256": "f03380112052a1ce6252e58ab6d63562188624844855c748aaf29cd244ae1919",
"artifact_sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"validation": "showcase passed; 0 errors; 0 warnings",
"browser_evidence": "passed",
"visual_review": "passed",
"visual_review_scope": [
"1440x900 light/dark",
"2048x1320 light/dark"
],
"correction_rounds": 1,
"placement_review": "One placement attempt failed validation and was restored; final original geometry passed all automated gates.",
"observations": [
"No visible node or label clipping at inspected desktop viewports.",
"Five routed crossings use visible bridges; main upload and workflow paths remain traceable."
],
"update_notice_required": false
}

View File

@ -0,0 +1,224 @@
{
"schemaVersion": 1,
"ok": false,
"command": "finalize",
"status": "fail",
"type": "architecture",
"quality": "showcase",
"specification": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"sha256": "a89f40f81a32bda1f1e7f576766709568dd934e7def3becf5c8fe3e0221818d3",
"bytes": 12006
},
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"gates": {
"validate": "fail",
"deliver": "not-run",
"check": "not-run",
"browser-check": "not-run"
},
"failedStage": "validate",
"diagnostics": [
{
"code": "layout/constraint",
"severity": "error",
"message": "Component \"mongo\" falls outside the viewBox 1588x1268 — adjust pos/size or set a larger meta.viewBox.",
"subject": {
"diagramType": "architecture"
}
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"api-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 1,
"id": "api-mongo",
"from": "api",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
704,
-180
],
[
850,
-180
]
],
"points": [
[
680,
106
],
[
704,
106
],
[
704,
-180
],
[
850,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"worker-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 2,
"id": "worker-mongo",
"from": "worker",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
],
"points": [
[
1400,
400
],
[
1400,
273
],
[
1083,
273
],
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"coordinator-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 11,
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1195,
-180
],
[
1110,
-180
]
],
"points": [
[
1280,
113
],
[
1195,
113
],
[
1195,
-180
],
[
1110,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
}
],
"diagnosticSummary": {
"total": 4,
"shown": 4,
"truncated": false
},
"evidence": {
"receipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-2/droboticflow-architecture.finalize.json",
"summaryReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-2/droboticflow-architecture.finalize-summary.json"
},
"update": {
"status": "current",
"installedVersion": "3.0.1",
"availableVersion": "3.0.1",
"releaseNotes": null,
"checkedAt": "2026-10-09T12:28:15.117Z",
"source": "cache",
"noticeRequired": false,
"noticeText": null
},
"visualReview": "not-requested",
"durationMs": 345,
"nextAction": {
"action": "edit-in-place",
"candidate": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"constraint": "Preserve all semantics and user-fixed geometry. Use references/architecture-layout-repair.md to choose a local repair or connected-scene reflow; edit the existing candidate.",
"then": "finalize-once"
}
}

View File

@ -0,0 +1,433 @@
{
"schemaVersion": 1,
"ok": false,
"command": "finalize",
"status": "fail",
"type": "architecture",
"quality": "showcase",
"startedAt": "2026-10-10T07:10:44.685Z",
"specification": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"sha256": "a89f40f81a32bda1f1e7f576766709568dd934e7def3becf5c8fe3e0221818d3",
"bytes": 12006
},
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"stages": {
"validate": {
"status": "fail",
"exitCode": 1,
"durationMs": null,
"command": [
"/opt/homebrew/Cellar/node/26.7.0/bin/node",
"/Users/d-robotics/.codex/skills/archify/bin/archify.mjs",
"deliver",
"architecture",
"/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"--quality",
"showcase",
"--repo-root",
"/Users/d-robotics/temp/droboticflow",
"--json"
],
"receipt": {
"schemaVersion": 1,
"ok": false,
"command": "deliver",
"receiptId": "03b11a60-dc04-4aac-ac27-786e21143fd1",
"stage": "render",
"type": "architecture",
"input": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"output": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"error": "Architecture layout validation failed:\n- Component \"mongo\" falls outside the viewBox 1588x1268 — adjust pos/size or set a larger meta.viewBox.\n- Connection \"api-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.\n- Connection \"worker-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.\n- Connection \"coordinator-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"diagnostics": [
{
"code": "layout/constraint",
"severity": "error",
"message": "Component \"mongo\" falls outside the viewBox 1588x1268 — adjust pos/size or set a larger meta.viewBox.",
"subject": {
"diagramType": "architecture"
},
"evidence": {},
"supportedFixes": []
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"api-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 1,
"id": "api-mongo",
"from": "api",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
704,
-180
],
[
850,
-180
]
],
"points": [
[
680,
106
],
[
704,
106
],
[
704,
-180
],
[
850,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"worker-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 2,
"id": "worker-mongo",
"from": "worker",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
],
"points": [
[
1400,
400
],
[
1400,
273
],
[
1083,
273
],
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"coordinator-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 11,
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1195,
-180
],
[
1110,
-180
]
],
"points": [
[
1280,
113
],
[
1195,
113
],
[
1195,
-180
],
[
1110,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
}
],
"provenance": "failed",
"update": {
"status": "unavailable",
"installedVersion": null,
"availableVersion": null,
"releaseNotes": null,
"checkedAt": null,
"source": null,
"noticeRequired": false,
"noticeText": null,
"reason": "disabled"
}
},
"execution": "embedded-in-deliver"
},
"deliver": {
"status": "not-run",
"execution": "blocked-by-validate"
}
},
"diagnostics": [
{
"code": "layout/constraint",
"severity": "error",
"message": "Component \"mongo\" falls outside the viewBox 1588x1268 — adjust pos/size or set a larger meta.viewBox.",
"subject": {
"diagramType": "architecture"
},
"evidence": {},
"supportedFixes": []
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"api-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 1,
"id": "api-mongo",
"from": "api",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
704,
-180
],
[
850,
-180
]
],
"points": [
[
680,
106
],
[
704,
106
],
[
704,
-180
],
[
850,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"worker-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 2,
"id": "worker-mongo",
"from": "worker",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
],
"points": [
[
1400,
400
],
[
1400,
273
],
[
1083,
273
],
[
1083,
-106
],
[
980,
-106
],
[
980,
-130
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
},
{
"code": "layout/route-out-of-bounds",
"severity": "error",
"message": "Connection \"coordinator-mongo\" extends outside the viewBox — move the measured outside route points inward or enlarge an authored viewBox for right/bottom overflow.",
"subject": {
"diagramType": "architecture",
"collection": "connections",
"index": 11,
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo"
},
"evidence": {
"viewBox": [
1588,
1268
],
"outsidePoints": [
[
1195,
-180
],
[
1110,
-180
]
],
"points": [
[
1280,
113
],
[
1195,
113
],
[
1195,
-180
],
[
1110,
-180
]
]
},
"supportedFixes": [
"move negative route coordinates inside the canvas; for right/bottom overflow, enlarge meta.viewBox or reroute inward; preserve endpoints, direction and labels, then revalidate"
]
}
],
"evidence": {
"receipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-2/droboticflow-architecture.finalize.json",
"summaryReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-2/droboticflow-architecture.finalize-summary.json"
},
"visualReview": "not-requested",
"failedStage": "validate",
"finishedAt": "2026-10-10T07:10:45.030Z",
"durationMs": 345,
"update": {
"status": "current",
"installedVersion": "3.0.1",
"availableVersion": "3.0.1",
"releaseNotes": null,
"checkedAt": "2026-10-09T12:28:15.117Z",
"source": "cache",
"noticeRequired": false,
"noticeText": null
}
}

View File

@ -0,0 +1,722 @@
{
"schemaVersion": 1,
"ok": true,
"command": "browser-check",
"evidenceKind": "automated-browser",
"status": "pass",
"visualReview": "not-requested",
"provenance": "current",
"deliveryReceiptId": "6fb4be46-e489-4474-aa02-50be096ecfa5",
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"state": {
"detail": "read",
"motion": "still"
},
"chrome": {
"status": "available",
"executable": "/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
},
"diagnostics": [],
"containment": {
"status": "pass",
"policy": "fit-or-reader-declared-readable-vertical-scroll",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"themeStates": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1600,
"height": 1000,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1920,
"height": 1080,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1440,
"height": 900,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
}
]
},
"readability": {
"status": "pass",
"minimumProjectedNodeTextPx": 6,
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"viewerChrome": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"captures": {
"status": "not-requested",
"screenshots": [],
"contactSheet": null
},
"sidecars": {
"directory": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-3",
"receipt": "droboticflow-architecture.browser-check.json",
"files": []
}
}

View File

@ -0,0 +1,243 @@
{
"schemaVersion": 1,
"ok": true,
"command": "finalize",
"status": "pass",
"type": "architecture",
"quality": "showcase",
"specification": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/candidate.json",
"sha256": "f03380112052a1ce6252e58ab6d63562188624844855c748aaf29cd244ae1919",
"bytes": 12002
},
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"gates": {
"validate": "pass",
"deliver": "pass",
"check": "pass",
"browser-check": "pass"
},
"diagnostics": [],
"diagnosticSummary": {
"total": 0,
"shown": 0,
"truncated": false
},
"evidence": {
"receipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-3/droboticflow-architecture.finalize.json",
"summaryReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-3/droboticflow-architecture.finalize-summary.json",
"browserCheckReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/review-3/droboticflow-architecture.browser-check.json"
},
"update": {
"status": "current",
"installedVersion": "3.0.1",
"availableVersion": "3.0.1",
"releaseNotes": null,
"checkedAt": "2026-10-09T12:28:15.117Z",
"source": "cache",
"noticeRequired": false,
"noticeText": null
},
"visualReview": "not-requested",
"durationMs": 2572,
"visualReviewRecommendation": {
"action": "inspect-route-readability",
"signals": {
"resolvedCrossovers": 5,
"routesOverSuggestedBends": 3,
"routesOverSuggestedStretch": 1
},
"reason": "Automated gates passed, but crossings or detours still need perceptual review before claiming visual quality.",
"affectedRoutes": {
"crossings": [
{
"left": {
"id": "daemon-api",
"from": "daemon",
"to": "api",
"label": "设备凭据 / 元信息",
"collectionIndex": 9,
"artifactIndex": 10
},
"right": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"point": [
560,
396
]
},
{
"left": {
"id": "daemon-bos",
"from": "daemon",
"to": "bos",
"label": "预签名 PUT",
"collectionIndex": 10,
"artifactIndex": 11
},
"right": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"point": [
847,
472.5499999999997
]
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "coordinator-bos",
"from": "coordinator",
"to": "bos",
"label": "校验 / 条件发布",
"collectionIndex": 12,
"artifactIndex": 13
},
"point": [
973,
608
],
"sharedNode": "coordinator"
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "api-bos",
"from": "api",
"to": "bos",
"label": "浏览:前缀范围未隔离",
"collectionIndex": 13,
"artifactIndex": 14
},
"point": [
847,
443.5
]
},
{
"left": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"right": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"point": [
847,
457.5
]
}
],
"detours": [
{
"relationship": {
"id": "worker-workspace",
"from": "worker",
"to": "workspace",
"label": "写输入 / 读结果",
"collectionIndex": 5,
"artifactIndex": 6
},
"bends": 3,
"stretch": 1.065,
"directCorridorBlockers": [
{
"id": "job",
"label": "Kubernetes 算子 Job",
"box": [
1280,
400,
240,
100
]
}
]
},
{
"relationship": {
"id": "coordinator-mongo",
"from": "coordinator",
"to": "mongo",
"label": "领取 / 提交状态",
"collectionIndex": 11,
"artifactIndex": 12
},
"bends": 4,
"stretch": 1.461,
"directCorridorBlockers": [
{
"id": "bos",
"label": "BOS 对象存储",
"box": [
850,
400,
260,
115
]
}
]
},
{
"relationship": {
"id": "web-bos",
"from": "web",
"to": "bos",
"label": "预签名 GET",
"collectionIndex": 14,
"artifactIndex": 15
},
"bends": 4,
"stretch": 1
}
],
"truncated": false
},
"hints": [
"daemon → api crosses web → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"daemon → bos crosses coordinator → mongo: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"coordinator → mongo and coordinator → bos cross next to coordinator: move node mongo or bos so the two reach coordinator from different sides (for example one level with it, one directly above or below it).",
"coordinator → mongo crosses api → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"coordinator → mongo crosses web → bos: move the node of whichever is a branch, return, or second entrance to the other side of the main path, so that relationship runs through an empty corridor.",
"web → bos needs 4 bends: move node web or bos so they share a row or column with matching centers, or sit diagonally with a clear corner."
],
"repair": "Trace these relationships at the desktop viewport. For Architecture, use references/architecture-layout-repair.md: reflow a blocked main path or tangled connected scene, and repair an isolated defect locally only when the surrounding composition is accepted. Preserve all semantic content and user-fixed geometry. Rerun finalize once after the edit."
}
}

View File

@ -0,0 +1,32 @@
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width,initial-scale=1">
<title>Archify automated browser evidence · droboticflow-architecture.html</title>
<style>
*{box-sizing:border-box}body{margin:0;padding:24px;background:#e9eef5;color:#172033;font:14px/1.5 ui-monospace,SFMono-Regular,Menlo,Consolas,monospace}header{max-width:1500px;margin:0 auto 18px}h1{margin:0 0 6px;font-size:20px}p{margin:0;color:#526176}.grid{max-width:1500px;margin:auto;display:grid;grid-template-columns:repeat(2,minmax(0,1fr));gap:18px}figure{margin:0;padding:10px;background:white;border:1px solid #c9d4e3;border-radius:12px;box-shadow:0 10px 30px rgba(15,23,42,.08)}img{display:block;width:100%;height:auto;border:1px solid #e2e8f0}figcaption{padding:9px 4px 2px;color:#526176}@media(max-width:900px){.grid{grid-template-columns:1fr}}
</style>
</head>
<body>
<header><h1>Automated browser evidence</h1><p>droboticflow-architecture.html · visual-check containment pass · perceptual visual review pending</p></header>
<main class="grid">
<figure>
<img src="droboticflow-architecture.visual-check.1440x900.light.png" alt="light 1440 by 900">
<figcaption><strong>LIGHT</strong> · 1440×900 · containment pass · readable vertical scroll</figcaption>
</figure>
<figure>
<img src="droboticflow-architecture.visual-check.1440x900.dark.png" alt="dark 1440 by 900">
<figcaption><strong>DARK</strong> · 1440×900 · containment pass · readable vertical scroll</figcaption>
</figure>
<figure>
<img src="droboticflow-architecture.visual-check.2048x1320.light.png" alt="light 2048 by 1320">
<figcaption><strong>LIGHT</strong> · 2048×1320 · containment pass</figcaption>
</figure>
<figure>
<img src="droboticflow-architecture.visual-check.2048x1320.dark.png" alt="dark 2048 by 1320">
<figcaption><strong>DARK</strong> · 2048×1320 · containment pass</figcaption>
</figure>
</main>
</body>
</html>

View File

@ -0,0 +1,962 @@
{
"schemaVersion": 1,
"ok": true,
"command": "visual-check",
"evidenceKind": "automated-browser",
"status": "pass",
"visualReview": "pending",
"provenance": "current",
"deliveryReceiptId": "6fb4be46-e489-4474-aa02-50be096ecfa5",
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/droboticflow-architecture.html",
"sha256": "983bdc054f8a4f76b2db10e187b2127199064e77193190691eda5d2d09883da5",
"bytes": 779740
},
"state": {
"detail": "read",
"motion": "still"
},
"chrome": {
"status": "available",
"executable": "/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
},
"diagnostics": [],
"containment": {
"status": "pass",
"policy": "fit-or-reader-declared-readable-vertical-scroll",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"themeStates": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1600,
"height": 1000,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1920,
"height": 1080,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1440,
"height": 900,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
}
]
},
"readability": {
"status": "pass",
"minimumProjectedNodeTextPx": 6,
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"viewerChrome": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1079,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1519,
"diagramWidth": 1489,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 870,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 7.501259445843829,
"minimumProjectedNonEdgeTextPx": 8.438916876574307,
"minimumProjectedEdgeTextPx": 7.501259445843829,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"captures": {
"status": "pass",
"screenshots": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light",
"file": "droboticflow-architecture.visual-check.1440x900.light.png"
},
{
"width": 1440,
"height": 900,
"theme": "dark",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 929,
"overflowX": false,
"overflowY": true,
"verticalScrollAccepted": true,
"overflowDisposition": "readable-vertical-scroll",
"readerLayout": "adaptive",
"readerOverflow": "authored",
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1376,
"diagramWidth": 1346,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 787,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 6.7808564231738035,
"minimumProjectedNonEdgeTextPx": 7.628463476070529,
"minimumProjectedEdgeTextPx": 6.7808564231738035,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "dark",
"file": "droboticflow-architecture.visual-check.1440x900.dark.png"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light",
"file": "droboticflow-architecture.visual-check.2048x1320.light.png"
},
{
"width": 2048,
"height": 1320,
"theme": "dark",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1902,
"diagramWidth": 1852,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1082,
"cardsPx": 0,
"viewBoxHeight": 928
},
"viewBoxWidth": 1588,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "登录 / HTTP",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "web-api",
"from": "web",
"to": "api"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "dark",
"file": "droboticflow-architecture.visual-check.2048x1320.dark.png"
}
],
"contactSheet": "droboticflow-architecture.visual-check.html"
},
"sidecars": {
"directory": "/Users/d-robotics/temp/droboticflow/.archify/architecture-droboticflow-20261010-150731/visual-check",
"receipt": "droboticflow-architecture.visual-check.json",
"contactSheet": "droboticflow-architecture.visual-check.html",
"files": [
{
"sha256": "8acc344f4bb70c305f32f9cfd8b9cae7d8d8badc0d180b05aac940503c1ee0bf",
"bytes": 2050,
"file": "droboticflow-architecture.visual-check.html"
},
{
"sha256": "b72473121297f14c92dee4a72350191372c2b010526cbcc8ba1d6f4fd2ffba8b",
"bytes": 132949,
"file": "droboticflow-architecture.visual-check.1440x900.light.png"
},
{
"sha256": "1a882fcaced196e202121dae5445612df7c07baf5ac8b1aa4804ac1862a311c2",
"bytes": 144793,
"file": "droboticflow-architecture.visual-check.1440x900.dark.png"
},
{
"sha256": "17622bd574ab69f48b1cb6d2c57333f43a7b63e5e6007dd9f2488aaef9cbbedd",
"bytes": 196475,
"file": "droboticflow-architecture.visual-check.2048x1320.light.png"
},
{
"sha256": "e17e3bc1881068a3ea4ad8eba4e541e68912a81f08a8a03feb6184d495141439",
"bytes": 214176,
"file": "droboticflow-architecture.visual-check.2048x1320.dark.png"
}
]
}
}

View File

@ -0,0 +1,9 @@
# drosync 系统架构图
打开 `drosync.html`,支持源码引用、缩放、明暗主题和图片导出。
依据 poc 提交 `5d90885c5d817605a0b56a63de489ac6568c31d6` 的代码快照。展示客户端、SQLite、平台控制面、MongoDB、协调器和 BOS;不代表运行环境已发布这一提交。
`candidate.json` 保存可编辑规范。`drosync.finalize-summary.json` 记录 validate / deliver / check / browser-check 全部通过;visual-check 目录保存浏览器截图和测量证据。
实际检查了 1440×900 深色、2048×1320 浅色截图,主链路与文字未见遮挡。自动路由交叉数为 0。截图检查与运行环境验收是不同证据。

View File

@ -0,0 +1,313 @@
{
"schema_version": 1,
"diagram_type": "architecture",
"meta": {
"title": "drosync 系统架构 · poc 代码快照",
"locale": "zh-CN",
"output": ".archify/architecture-drosync-20261010-183011/drosync.html",
"quality_profile": "showcase",
"repository": {
"url": "git@gitea.d-robotics.cc:longtao.wu/droboticflow.git",
"revision": "5d90885c5d817605a0b56a63de489ac6568c31d6",
"link_mode": "local-only"
}
},
"components": [
{
"id": "console",
"type": "frontend",
"label": "CLI 与本地 Web",
"sublabel": "操作 / 日报 / 冲突警告",
"pos": [
40,
350
],
"size": [
230,
82
],
"sources": [
{
"path": "tools/drosync/crates/cli/src/main.rs",
"line": 45,
"end_line": 58
},
{
"path": "tools/drosync/crates/cli/src/report_service.rs",
"line": 12,
"end_line": 18
}
]
},
{
"id": "files",
"type": "external",
"label": "采集目录",
"sublabel": "稳定性检查 / SHA256",
"pos": [
400,
60
],
"size": [
230,
82
],
"sources": [
{
"path": "tools/drosync/crates/core/src/lib.rs",
"line": 430,
"end_line": 447
}
]
},
{
"id": "daemon",
"type": "backend",
"label": "drosync-daemon",
"sublabel": "调度 / 扫描 / 并发传输",
"pos": [
400,
350
],
"size": [
230,
82
],
"sources": [
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 1209,
"end_line": 1245
},
{
"path": "tools/drosync/crates/daemon/src/lib.rs",
"line": 592,
"end_line": 614
}
]
},
{
"id": "sqlite",
"type": "database",
"label": "本地 SQLite",
"sublabel": "清单 / 缓存 / 回执 / 检查点",
"pos": [
40,
650
],
"size": [
230,
82
],
"sources": [
{
"path": "tools/drosync/crates/state/src/lib.rs",
"line": 245,
"end_line": 294
}
]
},
{
"id": "api",
"type": "backend",
"label": "平台 ObjectSync API",
"sublabel": "凭据鉴权 / 预签名 / 状态",
"pos": [
800,
350
],
"size": [
230,
82
],
"sources": [
{
"path": "internal/api/object_sync.go",
"line": 1831,
"end_line": 1848
},
{
"path": "internal/api/object_sync.go",
"line": 2190,
"end_line": 2210
},
{
"path": "internal/api/object_sync.go",
"line": 2630,
"end_line": 2662
}
]
},
{
"id": "bos",
"type": "cloud",
"label": "BOS 对象存储",
"sublabel": "暂存上传 → 正式归档",
"pos": [
400,
650
],
"size": [
230,
82
],
"sources": [
{
"path": "internal/api/object_sync.go",
"line": 2206
},
{
"path": "internal/objectsync/bos.go",
"line": 151,
"end_line": 185
}
]
},
{
"id": "coordinator",
"type": "backend",
"label": "ObjectSync 协调器",
"sublabel": "规划 / 租约 / 条件发布",
"pos": [
800,
650
],
"size": [
230,
82
],
"sources": [
{
"path": "internal/objectsync/coordinator.go",
"line": 645,
"end_line": 701
},
{
"path": "internal/objectsync/coordinator.go",
"line": 830,
"end_line": 880
}
]
},
{
"id": "mongo",
"type": "database",
"label": "平台 MongoDB",
"sublabel": "Session / Items / Heads / 租约",
"pos": [
1140,
650
],
"size": [
230,
82
],
"sources": [
{
"path": "internal/store/mongo.go",
"line": 80,
"end_line": 90
}
]
}
],
"connections": [
{
"id": "local-control",
"to": "daemon",
"label": "本地 IPC",
"variant": "default",
"from": "console"
},
{
"id": "local-report",
"to": "sqlite",
"label": "只读日报",
"variant": "default",
"from": "console"
},
{
"id": "scan",
"to": "daemon",
"label": "扫描与读取",
"variant": "default",
"from": "files"
},
{
"id": "checkpoint",
"to": "sqlite",
"label": "持久化",
"variant": "default",
"from": "daemon"
},
{
"id": "control",
"to": "api",
"label": "清单 / 预签名 / 提交",
"variant": "default",
"from": "daemon"
},
{
"id": "upload",
"to": "bos",
"label": "预签名 PUT / 分片",
"variant": "emphasis",
"from": "daemon"
},
{
"id": "api-state",
"to": "mongo",
"label": "状态读写",
"variant": "default",
"from": "api"
},
{
"id": "coord-state",
"to": "mongo",
"label": "认领 / 回执",
"variant": "default",
"from": "coordinator"
},
{
"id": "publication",
"to": "bos",
"label": "条件发布 / 核验",
"variant": "emphasis",
"from": "coordinator"
}
],
"cards": [
{
"dot": "cyan",
"title": "上传主路径",
"items": [
"本地扫描 → 分页清单 → 服务端规划 → 预签名上传暂存区 → 请求提交 → 协调器在 BOS 内复制发布。",
"文件字节直达 BOS;API 承担控制请求,不代理上传文件。"
]
},
{
"dot": "amber",
"title": "归档与冲突规则",
"items": [
"平台 objectSyncHeads 是正式提交清单;同 SHA256 与大小跳过,不检查已归档对象的远端变化。",
"同路径内容不同:规划拦截,页面警告;未登记同名对象也拦截。本地删除不联动云端删除。"
]
},
{
"dot": "emerald",
"title": "同步确认与恢复",
"items": [
"SQLite 保存 hash 缓存、传输分片和检查点;失败任务按阶段重试。",
"提交等待轮询进度摘要;终态恢复详细条目。本地清理仍独立核验云端证据。"
]
},
{
"dot": "slate",
"title": "范围与部署",
"items": [
"本图依据所标注 poc 提交的源码,不代表生产已部署同版本。",
"未展示标注、洗数等平台业务;BOS 内条件发布包含分片复制,仍有发布成本。"
]
}
]
}

View File

@ -0,0 +1,721 @@
{
"schemaVersion": 1,
"ok": true,
"command": "browser-check",
"evidenceKind": "automated-browser",
"status": "pass",
"visualReview": "not-requested",
"provenance": "current",
"deliveryReceiptId": "fd56d274-50cd-42fc-8548-14547f418478",
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.html",
"sha256": "55abf84d40c78f51e209b32a380f1b2810412aea9fced95cb79488d56fdd9b93",
"bytes": 762356
},
"state": {
"detail": "read",
"motion": "still"
},
"chrome": {
"status": "available",
"executable": "/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
},
"diagnostics": [],
"containment": {
"status": "pass",
"policy": "fit-or-reader-declared-readable-vertical-scroll",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"themeStates": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1600,
"height": 1000,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1920,
"height": 1080,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1440,
"height": 900,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
}
]
},
"readability": {
"status": "pass",
"minimumProjectedNodeTextPx": 6,
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"viewerChrome": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"captures": {
"status": "not-requested",
"screenshots": [],
"contactSheet": null
},
"sidecars": {
"receipt": "drosync.browser-check.json",
"files": []
}
}

View File

@ -0,0 +1,17 @@
{
"schemaVersion": 1,
"receiptId": "fd56d274-50cd-42fc-8548-14547f418478",
"status": "current",
"command": "deliver",
"type": "architecture",
"input": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/candidate.json",
"output": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.html",
"specification": {
"sha256": "02fcb55153ace833c7583923a1c589bc091c7af01d0f4fd3194f32051bf435ba",
"bytes": 7021
},
"artifact": {
"sha256": "55abf84d40c78f51e209b32a380f1b2810412aea9fced95cb79488d56fdd9b93",
"bytes": 762356
}
}

View File

@ -0,0 +1,47 @@
{
"schemaVersion": 1,
"ok": true,
"command": "finalize",
"status": "pass",
"type": "architecture",
"quality": "showcase",
"specification": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/candidate.json",
"sha256": "02fcb55153ace833c7583923a1c589bc091c7af01d0f4fd3194f32051bf435ba",
"bytes": 7021
},
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.html",
"sha256": "55abf84d40c78f51e209b32a380f1b2810412aea9fced95cb79488d56fdd9b93",
"bytes": 762356
},
"gates": {
"validate": "pass",
"deliver": "pass",
"check": "pass",
"browser-check": "pass"
},
"diagnostics": [],
"diagnosticSummary": {
"total": 0,
"shown": 0,
"truncated": false
},
"evidence": {
"receipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.finalize.json",
"summaryReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.finalize-summary.json",
"browserCheckReceipt": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.browser-check.json"
},
"update": {
"status": "current",
"installedVersion": "3.0.1",
"availableVersion": "3.0.1",
"releaseNotes": null,
"checkedAt": "2026-10-09T12:28:15.117Z",
"source": "cache",
"noticeRequired": false,
"noticeText": null
},
"visualReview": "not-requested",
"durationMs": 7687
}

File diff suppressed because it is too large Load Diff

File diff suppressed because one or more lines are too long

Binary file not shown.

After

Width:  |  Height:  |  Size: 96 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 90 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 152 KiB

Binary file not shown.

After

Width:  |  Height:  |  Size: 142 KiB

View File

@ -0,0 +1,32 @@
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width,initial-scale=1">
<title>Archify automated browser evidence · drosync.html</title>
<style>
*{box-sizing:border-box}body{margin:0;padding:24px;background:#e9eef5;color:#172033;font:14px/1.5 ui-monospace,SFMono-Regular,Menlo,Consolas,monospace}header{max-width:1500px;margin:0 auto 18px}h1{margin:0 0 6px;font-size:20px}p{margin:0;color:#526176}.grid{max-width:1500px;margin:auto;display:grid;grid-template-columns:repeat(2,minmax(0,1fr));gap:18px}figure{margin:0;padding:10px;background:white;border:1px solid #c9d4e3;border-radius:12px;box-shadow:0 10px 30px rgba(15,23,42,.08)}img{display:block;width:100%;height:auto;border:1px solid #e2e8f0}figcaption{padding:9px 4px 2px;color:#526176}@media(max-width:900px){.grid{grid-template-columns:1fr}}
</style>
</head>
<body>
<header><h1>Automated browser evidence</h1><p>drosync.html · visual-check containment pass · perceptual visual review pending</p></header>
<main class="grid">
<figure>
<img src="drosync.visual-check.1440x900.light.png" alt="light 1440 by 900">
<figcaption><strong>LIGHT</strong> · 1440×900 · containment pass</figcaption>
</figure>
<figure>
<img src="drosync.visual-check.1440x900.dark.png" alt="dark 1440 by 900">
<figcaption><strong>DARK</strong> · 1440×900 · containment pass</figcaption>
</figure>
<figure>
<img src="drosync.visual-check.2048x1320.light.png" alt="light 2048 by 1320">
<figcaption><strong>LIGHT</strong> · 2048×1320 · containment pass</figcaption>
</figure>
<figure>
<img src="drosync.visual-check.2048x1320.dark.png" alt="dark 2048 by 1320">
<figcaption><strong>DARK</strong> · 2048×1320 · containment pass</figcaption>
</figure>
</main>
</body>
</html>

View File

@ -0,0 +1,962 @@
{
"schemaVersion": 1,
"ok": true,
"command": "visual-check",
"evidenceKind": "automated-browser",
"status": "pass",
"visualReview": "pending",
"provenance": "current",
"deliveryReceiptId": "fd56d274-50cd-42fc-8548-14547f418478",
"artifact": {
"path": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/drosync.html",
"sha256": "55abf84d40c78f51e209b32a380f1b2810412aea9fced95cb79488d56fdd9b93",
"bytes": 762356
},
"state": {
"detail": "read",
"motion": "still"
},
"chrome": {
"status": "available",
"executable": "/Applications/Google Chrome.app/Contents/MacOS/Google Chrome"
},
"diagnostics": [],
"containment": {
"status": "pass",
"policy": "fit-or-reader-declared-readable-vertical-scroll",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"themeStates": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1600,
"height": 1000,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1920,
"height": 1080,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "light",
"resolvedTheme": "light",
"ok": true
},
{
"width": 1440,
"height": 900,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
},
{
"width": 2048,
"height": 1320,
"requestedTheme": "dark",
"resolvedTheme": "dark",
"ok": true
}
]
},
"readability": {
"status": "pass",
"minimumProjectedNodeTextPx": 6,
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"viewerChrome": {
"status": "pass",
"viewports": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1600,
"height": 1000,
"theme": "light",
"innerWidth": 1600,
"innerHeight": 1000,
"scrollWidth": 1600,
"scrollHeight": 1000,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1405,
"diagramWidth": 1375,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 780,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.801418439716312,
"minimumProjectedNonEdgeTextPx": 8.77659574468085,
"minimumProjectedEdgeTextPx": 7.801418439716312,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 1920,
"height": 1080,
"theme": "light",
"innerWidth": 1920,
"innerHeight": 1080,
"scrollWidth": 1920,
"scrollHeight": 1080,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1546,
"diagramWidth": 1516,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 60,
"diagramChromePx": 84,
"svgPx": 860,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light"
}
]
},
"captures": {
"status": "pass",
"screenshots": [
{
"width": 1440,
"height": 900,
"theme": "light",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light",
"file": "drosync.visual-check.1440x900.light.png"
},
{
"width": 1440,
"height": 900,
"theme": "dark",
"innerWidth": 1440,
"innerHeight": 900,
"scrollWidth": 1440,
"scrollHeight": 900,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1352,
"diagramWidth": 1322,
"pageComposition": {
"bodyPaddingPx": 12,
"headerPx": 52,
"diagramChromePx": 78,
"svgPx": 750,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 7.500709219858156,
"minimumProjectedNonEdgeTextPx": 8.438297872340426,
"minimumProjectedEdgeTextPx": 7.500709219858156,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 54,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "dark",
"file": "drosync.visual-check.1440x900.dark.png"
},
{
"width": 2048,
"height": 1320,
"theme": "light",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "light",
"file": "drosync.visual-check.2048x1320.light.png"
},
{
"width": 2048,
"height": 1320,
"theme": "dark",
"innerWidth": 2048,
"innerHeight": 1320,
"scrollWidth": 2048,
"scrollHeight": 1320,
"overflowX": false,
"overflowY": false,
"verticalScrollAccepted": false,
"overflowDisposition": "contained",
"readerLayout": "adaptive",
"readerOverflow": null,
"readerFit": "intrinsic-height",
"ok": true,
"readerWidth": 1920,
"diagramWidth": 1870,
"pageComposition": {
"bodyPaddingPx": 64,
"headerPx": 68,
"diagramChromePx": 94,
"svgPx": 1061,
"cardsPx": 0,
"viewBoxHeight": 800
},
"viewBoxWidth": 1410,
"minimumProjectedNodeTextPx": 8,
"minimumProjectedNonEdgeTextPx": 9,
"minimumProjectedEdgeTextPx": 8,
"minimumProjectedNodeText": "本地 IPC",
"minimumProjectedNodeTextDetail": "edge",
"minimumProjectedNodeTextOwner": {
"kind": "edge",
"id": "local-control",
"from": "console",
"to": "daemon"
},
"minimumRequiredNodeTextPx": 6,
"readabilityOk": true,
"hasLegend": true,
"hasNavigationDock": true,
"legendDockIntersectionArea": 0,
"dockStageIntersectionArea": 0,
"dockStageGap": 10,
"requiredDockStageGap": 10,
"viewerChromeStageOk": true,
"viewerChromeReserve": 44,
"viewerChromeActive": true,
"viewerChromeOk": true,
"resolvedTheme": "dark",
"file": "drosync.visual-check.2048x1320.dark.png"
}
],
"contactSheet": "drosync.visual-check.html"
},
"sidecars": {
"directory": "/Users/d-robotics/temp/droboticflow/.archify/architecture-drosync-20261010-183011/visual-check",
"receipt": "drosync.visual-check.json",
"contactSheet": "drosync.visual-check.html",
"files": [
{
"sha256": "bfc4e7db7f78a7e5e98c94cc23510048466b13585e5931acad4cbdfe6b54734a",
"bytes": 1886,
"file": "drosync.visual-check.html"
},
{
"sha256": "8d82ab86f00bad7f9a7be98ef32edc1f0f6be680e3027cb9b7a8c18b693df214",
"bytes": 92353,
"file": "drosync.visual-check.1440x900.light.png"
},
{
"sha256": "c48872886e1d427c44690dd2ad978ff2e89efebc225c362c6b4c1e6145946d47",
"bytes": 98610,
"file": "drosync.visual-check.1440x900.dark.png"
},
{
"sha256": "f91e144d7bd0108bc9dfd71dfa8ae7e18afa4367512f5a1f36d49b5546a98a30",
"bytes": 145811,
"file": "drosync.visual-check.2048x1320.light.png"
},
{
"sha256": "27e8c1776edae8515e9a320ec1372b12684b4cf1b7b686b8efa8fc7ca26282d4",
"bytes": 155924,
"file": "drosync.visual-check.2048x1320.dark.png"
}
]
}
}

View File

@ -7,3 +7,7 @@ coverage
.env
.env.local
*.log
**/__pycache__
**/*.pyc
**/.pytest_cache

View File

@ -36,7 +36,10 @@ AI_API_BASE_URL=
AI_MODEL=
AI_API_KEY=
DROBOTICFLOW_API_TOKEN=
DROBOTICFLOW_REQUIRE_SESSION_AUTH=false
DROBOTICFLOW_SESSION_COOKIE_SECURE=false
DROBOTICFLOW_TRUSTED_PROXY_CIDRS=
API_SERVICE_TYPE=NodePort
# drosync v2 signed-release verification key (base64 Ed25519 public key, not a secret).
# Must match the key embedded in native clients and used by the release signer.
DROSYNC_UPDATE_SIGNING_PUBLIC_KEY=

View File

@ -1,77 +1,204 @@
name: drosync-release
on:
workflow_dispatch:
inputs:
version:
description: SemVer release version
description: Exact committed Cargo version (POC only)
required: true
env:
DROSYNC_VERSION: ${{ inputs.version }}
DROSYNC_RELEASE_REF: ${{ github.ref }}
jobs:
verify:
runs-on: ubuntu-22.04
steps:
- uses: actions/checkout@v4
- uses: dtolnay/rust-toolchain@stable
- uses: dtolnay/rust-toolchain@1.89.0
- run: |
test "$DROSYNC_RELEASE_REF" = refs/heads/poc
python3 tools/drosync/packaging/build-metadata.py --version "$DROSYNC_VERSION"
sudo apt-get update && sudo apt-get install -y libdbus-1-dev pkg-config
- run: python3 scripts/generate_drosync_contract.py --check
- run: python3 tools/drosync/packaging/tests/test_installation.py
- run: cargo fmt --manifest-path tools/drosync/Cargo.toml --all -- --check
- run: cargo clippy --manifest-path tools/drosync/Cargo.toml --workspace --all-targets -- -D warnings
- run: cargo test --manifest-path tools/drosync/Cargo.toml --workspace
- run: cargo clippy --locked --manifest-path tools/drosync/Cargo.toml --workspace --all-targets -- -D warnings
- run: cargo test --locked --manifest-path tools/drosync/Cargo.toml --workspace
- uses: actions/setup-go@v5
with:
go-version-file: go.mod
- run: go test ./scripts/drosync-release-publisher
linux:
needs: verify
runs-on: ubuntu-22.04
strategy:
matrix:
platform: [linux-x86_64, linux-arm64]
env:
GNUPGHOME: ${{ runner.temp }}/drosync-gnupg
DROSYNC_GPG_SIGN_KEY: ${{ secrets.DROSYNC_GPG_SIGN_KEY }}
DROSYNC_DEB_SIGN_KEY: ${{ secrets.DROSYNC_GPG_SIGN_KEY }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64_LINUX_X86_64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64_LINUX_ARM64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
steps:
- uses: actions/checkout@v4
- uses: dtolnay/rust-toolchain@stable
- run: tools/drosync/packaging/build-release.sh linux-x86_64
- uses: dtolnay/rust-toolchain@1.89.0
with:
targets: aarch64-unknown-linux-gnu
- run: sudo apt-get update && sudo apt-get install -y libdbus-1-dev pkg-config gcc-aarch64-linux-gnu binutils-aarch64-linux-gnu debsigs debsig-verify
- name: Import isolated CI signing key
env:
DROSYNC_VERSION: ${{ inputs.version }}
DROSYNC_GPG_SIGN_KEY: ${{ secrets.DROSYNC_GPG_SIGN_KEY }}
DROSYNC_DEB_SIGN_KEY: ${{ secrets.DROSYNC_GPG_SIGN_KEY }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
DROSYNC_GPG_PRIVATE_KEY_BASE64: ${{ secrets.DROSYNC_GPG_PRIVATE_KEY_BASE64 }}
DROSYNC_GPG_PASSPHRASE: ${{ secrets.DROSYNC_GPG_PASSPHRASE }}
run: |
umask 077
mkdir -p "$GNUPGHOME"
python3 - <<'PY'
import base64, os, subprocess
material=base64.b64decode(os.environ['DROSYNC_GPG_PRIVATE_KEY_BASE64'],validate=True)
result=subprocess.run(['gpg','--batch','--quiet','--import'],input=material,stdout=subprocess.DEVNULL,stderr=subprocess.PIPE)
if result.returncode: raise SystemExit('CI signing key import failed')
passphrase=os.environ.get('DROSYNC_GPG_PASSPHRASE','')
if passphrase:
from pathlib import Path
Path(os.environ['GNUPGHOME'],'gpg-agent.conf').write_text('allow-preset-passphrase\n')
subprocess.run(['gpgconf','--reload','gpg-agent'],check=True,stdout=subprocess.DEVNULL)
listing=subprocess.run(['gpg','--batch','--with-colons','--with-keygrip','--list-secret-keys',os.environ['DROSYNC_GPG_SIGN_KEY']],capture_output=True,check=True,text=True).stdout
grips=[line.split(':')[9] for line in listing.splitlines() if line.startswith('grp:')]
if not grips: raise SystemExit('CI signing key has no private keygrip')
for grip in grips:
result=subprocess.run(['/usr/lib/gnupg/gpg-preset-passphrase','--preset',grip],input=(passphrase+'\n').encode(),stdout=subprocess.DEVNULL,stderr=subprocess.PIPE)
if result.returncode: raise SystemExit('CI signing key unlock failed')
PY
- run: tools/drosync/packaging/build-release.sh "$PLATFORM"
env:
PLATFORM: ${{ matrix.platform }}
- uses: actions/upload-artifact@v4
with:
name: drosync-linux-x86_64-${{ inputs.version }}
name: drosync-${{ matrix.platform }}
path: tools/drosync/dist/*
if-no-files-found: error
- if: always()
run: |
gpgconf --kill all || true
rm -rf "$GNUPGHOME"
macos:
needs: verify
runs-on: macos-14
env:
DROSYNC_APPLE_KEYCHAIN: ${{ runner.temp }}/drosync-signing.keychain-db
DROSYNC_APPLE_APPLICATION_IDENTITY: ${{ secrets.DROSYNC_APPLE_APPLICATION_IDENTITY }}
DROSYNC_APPLE_INSTALLER_IDENTITY: ${{ secrets.DROSYNC_APPLE_INSTALLER_IDENTITY }}
DROSYNC_APPLE_NOTARY_PROFILE: drosync-ci
DROSYNC_UPDATE_PUBLIC_KEY_BASE64_MACOS_ARM64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
steps:
- uses: actions/checkout@v4
- uses: dtolnay/rust-toolchain@stable
- run: tools/drosync/packaging/build-release.sh macos-arm64
- uses: dtolnay/rust-toolchain@1.89.0
- name: Import dedicated signing and notarization credentials
env:
DROSYNC_VERSION: ${{ inputs.version }}
DROSYNC_APPLE_APPLICATION_IDENTITY: ${{ secrets.DROSYNC_APPLE_APPLICATION_IDENTITY }}
DROSYNC_APPLE_INSTALLER_IDENTITY: ${{ secrets.DROSYNC_APPLE_INSTALLER_IDENTITY }}
DROSYNC_APPLE_NOTARY_PROFILE: ${{ secrets.DROSYNC_APPLE_NOTARY_PROFILE }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
P12_BASE64: ${{ secrets.DROSYNC_APPLE_SIGNING_P12_BASE64 }}
P12_PASSWORD: ${{ secrets.DROSYNC_APPLE_SIGNING_P12_PASSWORD }}
NOTARY_KEY_BASE64: ${{ secrets.DROSYNC_APPLE_NOTARY_KEY_BASE64 }}
NOTARY_KEY_ID: ${{ secrets.DROSYNC_APPLE_NOTARY_KEY_ID }}
NOTARY_ISSUER_ID: ${{ secrets.DROSYNC_APPLE_NOTARY_ISSUER_ID }}
run: |
umask 077
python3 - <<'PY'
import base64, os, pathlib
for variable,name in [('P12_BASE64','drosync-signing.p12'),('NOTARY_KEY_BASE64','drosync-notary.p8')]:
pathlib.Path(os.environ['RUNNER_TEMP'],name).write_bytes(base64.b64decode(os.environ[variable],validate=True))
PY
signing_password=$(openssl rand -base64 32)
security create-keychain -p "$signing_password" "$DROSYNC_APPLE_KEYCHAIN"
security unlock-keychain -p "$signing_password" "$DROSYNC_APPLE_KEYCHAIN"
security import "$RUNNER_TEMP/drosync-signing.p12" -k "$DROSYNC_APPLE_KEYCHAIN" -P "$P12_PASSWORD" -T /usr/bin/codesign -T /usr/bin/pkgbuild
security set-key-partition-list -S apple-tool:,apple: -s -k "$signing_password" "$DROSYNC_APPLE_KEYCHAIN" >/dev/null
xcrun notarytool store-credentials "$DROSYNC_APPLE_NOTARY_PROFILE" --key "$RUNNER_TEMP/drosync-notary.p8" --key-id "$NOTARY_KEY_ID" --issuer "$NOTARY_ISSUER_ID" --keychain "$DROSYNC_APPLE_KEYCHAIN"
- run: tools/drosync/packaging/build-release.sh macos-arm64
- uses: actions/upload-artifact@v4
with:
name: drosync-macos-arm64-${{ inputs.version }}
name: drosync-macos-arm64
path: tools/drosync/dist/*
if-no-files-found: error
- if: always()
run: |
security delete-keychain "$DROSYNC_APPLE_KEYCHAIN" || true
rm -f "$RUNNER_TEMP/drosync-signing.p12" "$RUNNER_TEMP/drosync-notary.p8"
windows:
needs: verify
runs-on: windows-2022
env:
DROSYNC_UPDATE_PUBLIC_KEY_BASE64_WINDOWS_X86_64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
steps:
- uses: actions/checkout@v4
- uses: dtolnay/rust-toolchain@stable
- run: cargo build --manifest-path tools/drosync/Cargo.toml --release --workspace --target x86_64-pc-windows-msvc
- uses: dtolnay/rust-toolchain@1.89.0
- name: Install isolated WiX and import signing certificate
shell: pwsh
env:
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
PFX_BASE64: ${{ secrets.DROSYNC_WINDOWS_SIGNING_PFX_BASE64 }}
PFX_PASSWORD: ${{ secrets.DROSYNC_WINDOWS_SIGNING_PFX_PASSWORD }}
run: |
$ErrorActionPreference='Stop'
dotnet tool install wix --tool-path "$env:RUNNER_TEMP\drosync-wix" --version 4.0.6
if ($LASTEXITCODE -ne 0) { throw 'WiX installation failed' }
"$env:RUNNER_TEMP\drosync-wix" | Out-File -FilePath $env:GITHUB_PATH -Append
$signTool=Get-ChildItem "${env:ProgramFiles(x86)}\Windows Kits\10\bin" -Filter signtool.exe -Recurse | Where-Object FullName -Match '\\x64\\signtool.exe$' | Sort-Object FullName -Descending | Select-Object -First 1
if (-not $signTool) { throw 'Windows signing SDK is missing' }
$signTool.DirectoryName | Out-File -FilePath $env:GITHUB_PATH -Append
$pfx=Join-Path $env:RUNNER_TEMP 'drosync-signing.pfx'
[IO.File]::WriteAllBytes($pfx,[Convert]::FromBase64String($env:PFX_BASE64))
$password=ConvertTo-SecureString $env:PFX_PASSWORD -AsPlainText -Force
$cert=Import-PfxCertificate -FilePath $pfx -CertStoreLocation Cert:\CurrentUser\My -Password $password
"DROSYNC_AUTHENTICODE_CERT_THUMBPRINT=$($cert.Thumbprint)" | Out-File -FilePath $env:GITHUB_ENV -Append
- run: cargo build --locked --manifest-path tools/drosync/Cargo.toml --release --workspace --target x86_64-pc-windows-msvc
- shell: pwsh
run: tools/drosync/packaging/windows/build-msi.ps1
env:
DROSYNC_VERSION: ${{ inputs.version }}
DROSYNC_AUTHENTICODE_CERT_THUMBPRINT: ${{ secrets.DROSYNC_AUTHENTICODE_CERT_THUMBPRINT }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
- uses: actions/upload-artifact@v4
with:
name: drosync-windows-x86_64-${{ inputs.version }}
name: drosync-windows-x86_64
path: tools/drosync/dist/*
if-no-files-found: error
- if: always()
shell: pwsh
run: |
if ($env:DROSYNC_AUTHENTICODE_CERT_THUMBPRINT) { Remove-Item "Cert:\CurrentUser\My\$env:DROSYNC_AUTHENTICODE_CERT_THUMBPRINT" -ErrorAction SilentlyContinue }
Remove-Item "$env:RUNNER_TEMP\drosync-signing.pfx" -ErrorAction SilentlyContinue
publish:
needs: [linux, macos, windows]
runs-on: ubuntu-22.04
env:
DROSYNC_RELEASE_ENVIRONMENT: poc
DROSYNC_POC_RELEASE_PUBLIC_BASE_URL: ${{ secrets.DROSYNC_POC_RELEASE_PUBLIC_BASE_URL }}
DROSYNC_POC_RELEASE_BOS_ENDPOINT: ${{ secrets.DROSYNC_POC_RELEASE_BOS_ENDPOINT }}
DROSYNC_POC_RELEASE_BUCKET: ${{ secrets.DROSYNC_POC_RELEASE_BUCKET }}
DROSYNC_POC_RELEASE_BOS_ACCESS_KEY: ${{ secrets.DROSYNC_POC_RELEASE_BOS_ACCESS_KEY }}
DROSYNC_POC_RELEASE_BOS_SECRET_KEY: ${{ secrets.DROSYNC_POC_RELEASE_BOS_SECRET_KEY }}
DROSYNC_POC_RELEASE_API_URL: ${{ secrets.DROSYNC_POC_RELEASE_API_URL }}
DROSYNC_RELEASE_ADMIN_EMAIL: ${{ secrets.DROSYNC_RELEASE_ADMIN_EMAIL }}
DROSYNC_RELEASE_ADMIN_PASSWORD: ${{ secrets.DROSYNC_RELEASE_ADMIN_PASSWORD }}
DROSYNC_UPDATE_SIGNING_PRIVATE_KEY: ${{ secrets.DROSYNC_UPDATE_SIGNING_PRIVATE_KEY }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: ${{ secrets.DROSYNC_UPDATE_PUBLIC_KEY_BASE64 }}
steps:
- uses: actions/checkout@v4
- uses: actions/download-artifact@v4
with:
pattern: drosync-*
path: release-artifacts
merge-multiple: true
- uses: dtolnay/rust-toolchain@1.89.0
- uses: actions/setup-go@v5
with:
go-version-file: go.mod
- run: python3 tools/drosync/packaging/build-metadata.py --version "$DROSYNC_VERSION"
- run: cargo build --locked --release --manifest-path tools/drosync/Cargo.toml -p drosync-updater --bin drosync-sign-manifest
- run: go run ./scripts/drosync-release-publisher --version "$DROSYNC_VERSION" --artifacts release-artifacts --manifest release-manifest.json
- uses: actions/upload-artifact@v4
with:
name: registered-drosync-manifest
path: release-manifest.json
if-no-files-found: error

View File

@ -13,7 +13,6 @@ permissions:
env:
DROSYNC_VERSION: ${{ inputs.version }}
DROSYNC_UPDATE_PUBLIC_KEY_BASE64: AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA=
jobs:
verify:

2
.gitignore vendored
View File

@ -14,3 +14,5 @@ docs.zip
__pycache__/
*.py[cod]
.operator-source-repos/
target/
**/target/

View File

@ -0,0 +1,21 @@
Type: task
Status: resolved
Blocked by:
# 01: 对外开发人员文档架构与协议规范规划
## Question
面向外部开发人员(算法工程师、系统集成工程师、采集工具开发者),必须提供哪些文档?各个文档的具体定位、章节大纲、输入输出契约、核心接口与依赖标准是什么?
需覆盖的三大核心模块:
1. **自定义容器算子开发指南 (Custom Container Operator Guide)**
2. **开放 REST API 与自动化集成指南 (API Integration Guide)**
3. **drosync 采集工具与客户端集成开发手册 (drosync Client Guide)**
## Answer
已完成面向外部技术人员的三套标准化开发指南文档编制,统一保存在 `docs/external/developer/` 目录下:
1. [A1-自定义容器算子开发与接入指南.md](file:///Users/d-robotics/temp/droboticflow/docs/external/developer/A1-%E8%87%AA%E5%AE%9A%E4%B9%89%E5%AE%B9%E5%99%A8%E7%AE%97%E5%AD%90%E5%BC%80%E5%8F%91%E4%B8%8E%E6%8E%A5%E5%85%A5%E6%8C%87%E5%8D%97.md):详述 K8s Job 独立沙箱模型、平台注入环境变量协议、`input-bindings.json` 解析、`result.json` 契约(含 inline 与 ref 模式)、百度云 CCR 镜像打包推送规范、Web 平台注册流程及常见失败排查表。
2. [A2-平台开放API与自动化集成指南.md](file:///Users/d-robotics/temp/droboticflow/docs/external/developer/A2-%E5%B9%B3%E5%8F%B0%E5%BC%80%E6%94%BEAPI%E4%B8%8E%E8%87%AA%E5%8A%A8%E5%8C%96%E9%9B%86%E6%88%90%E6%8C%87%E5%8D%97.md):提供基于 API Token 的免交互鉴权规范、工作流触发、状态与日志轮询、产物拉取与数据血缘追溯接口,并提供完整的 Python 端到端自动化集成脚本。
3. [A3-drosync数据采集客户端集成手册.md](file:///Users/d-robotics/temp/droboticflow/docs/external/developer/A3-drosync%E6%95%B0%E6%8D%AE%E9%87%87%E9%9B%86%E5%AE%A2%E6%88%B7%E7%AB%AF%E9%9B%86%E6%88%90%E6%8C%87%E5%8D%97.md):阐述受限设备凭证安全机制、CLI/Daemon 命令参数、60s 静默期防截断设计、工控机实机 Systemd 自动化常驻及采集脚本集成方案。

View File

@ -0,0 +1,27 @@
Type: task
Status: resolved
Blocked by:
# 02: 对外使用人员操作手册与业务角色旅程规划
## Question
面向外部不同业务使用人员,如何按实际业务旅程与权责分工规划成套操作手册?每本手册的适用角色、操作 SOP、界面指引与核心步骤是什么?
需规划的五大业务手册:
1. **平台管理员手册 (Platform Administrator Manual)**
2. **流程工程师编排与调试手册 (Pipeline Engineer Manual)**
3. **数据运营与监控手册 (Data Operator Manual)**
4. **现场采集人员快速指南 (Field Collector Guide)**
5. **质检验收与评审手册 (QA Reviewer Manual)**
6. **合规审计与数据溯源手册 (Compliance Auditor Manual)**
## Answer
已完成面向外部六类业务角色的成套标准化操作手册编制,统一保存在 `docs/external/user/` 目录下:
1. [B1-平台管理员与系统配置指南.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B1-%E5%B9%B3%E5%8F%B0%E7%AE%A1%E7%90%86%E5%91%98%E4%B8%8E%E7%B3%BB%E7%BB%9F%E9%85%8D%E7%BD%AE%E6%8C%87%E5%8D%97.md):明确超级管理员与平台管理员权责边界,详细列出 5 类业务角色 RBAC 权限矩阵红线、BOS/Mongo 存储连接配置、drosync 同步空间划分与设备密钥签发、异常任务干预与租约释放 SOP。
2. [B2-流程工程师编排与调试手册.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B2-%E6%B5%81%E7%A8%8B%E5%B7%A5%E7%A8%8B%E5%B8%88%E7%BC%96%E6%8E%92%E4%B8%8E%E8%B0%83%E8%AF%95%E6%89%8B%E5%86%8C.md):指导内建与自定义算子注册、工作流画布可视化拖拽、数据边与控制边连接规则、单步调试与日志下钻、版本发布不可变锁定及沉淀为组织级模板。
3. [B3-数据运营与任务监控手册.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B3-%E6%95%B0%E6%8D%AE%E8%BF%90%E8%90%A5%E4%B8%8E%E4%BB%BB%E5%8A%A1%E7%9B%91%E6%8E%A7%E6%89%8B%E5%86%8C.md):详述任务执行大盘状态流转、单节点原地增量重试 SOP、优雅停止与强制销毁、数据资产检索与每日同步双 Sheet Excel 报表导出。
4. [B4-现场采集人员极简操作指南.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B4-%E7%8E%B0%E5%9C%BA%E9%87%87%E9%9B%86%E4%BA%BA%E5%91%98%E6%9E%81%E7%AE%80%E6%93%8D%E4%BD%9C%E6%8C%87%E5%8D%97.md):极简 3 步指南(配置、静默 60 秒、看 8080 绿灯),辅以外场常见异常速查问答。
5. [B5-质检验收与人工审核手册.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B5-%E8%B4%A8%E6%A3%80%E9%AA%8C%E6%94%B6%E4%B8%8E%E4%BA%BA%E5%B7%A5%E5%AE%A1%E6%A0%B8%E6%89%8B%E5%86%8C.md):覆盖人工审核节点挂起流转、多模态样本数据在线评审、质检打标判定及下游分支准出。
6. [B6-合规审计与数据溯源手册.md](file:///Users/d-robotics/temp/droboticflow/docs/external/user/B6-%E5%90%88%E8%A7%84%E5%AE%A1%E8%AE%A1%E4%B8%8E%E6%95%B0%E6%8D%AE%E6%BA%AF%E6%BA%90%E6%89%8B%E5%86%8C.md):只读审计视角、全链路数据血缘图谱反向穿透溯源、系统操作审计与同步证据链导出。

View File

@ -0,0 +1,25 @@
Type: prototype
Status: resolved
Blocked by: 01
# 03: 自定义容器算子“5分钟极速开发”示例原型
## Question
如何为外部算法开发者设计一个极简、端到端跑通的“Hello World 级”自定义容器算子开发示范原型?
需包含的原型资产:
1. 最小可工作的 Python 算子脚本(处理输入图片/JSON,生成带指标的输出 Artifact)。
2. 配套极简 Dockerfile(以轻量 Python 为基底,非 root 运行)。
3. 本地模拟测试命令(无需 K8s 集群,纯 docker run 验证环境变量与产物目录结构)。
4. 百度云 CCR 打包推送命令模板。
5. 平台前端注册所需的 `operator.json` 元数据配置示例。
## Answer
已在 [`docs/external/examples/quickstart-operator/`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/) 目录下交付了一套完整的开箱即用示范工程原型:
1. [`operator.py`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/operator.py):接收上游输入绑定,根据置信度阈值进行数据过滤,输出持久化 JSON 数据与内存级指标,并产出符合规范的 `result.json`。
2. [`Dockerfile`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/Dockerfile):生产级轻量容器配置,采用非 root 用户(UID 1000)。
3. [`operator.json`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/operator.json):提供平台直接导入注册所需的端口与超参完整定义。
4. [`test_local.sh`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/test_local.sh):提供一键本地模拟测试脚本,验证实际执行顺利通过且契约 100% 吻合。
5. [`README.md`](file:///Users/d-robotics/temp/droboticflow/docs/external/examples/quickstart-operator/README.md):极速 3 步上手指南。

View File

@ -0,0 +1,21 @@
Type: task
Status: resolved
Blocked by: 01, 02, 03
# 04: 飞书文档规范主蓝图与知识库规划交付
## Question
如何将外部开发文档架构、平台使用手册架构与原型规范综合为一份深度适配飞书排版、可一键导入飞书知识库或飞书云文档的 Master Blueprint《POC 对外开发与使用文档全景规划及目录规范说明书》?
交付标准:
1. 飞书原生适配:全面支持 Markdown 导入至飞书文档(标题层级清晰、Mermaid 架构流程图、信息卡片/引用块、标准表格排版、待办清单)。
2. 全景规划树:提供外部开发、管理配置、业务编排、日常运营、现场采集、质检验收六大分册的完整目录和章节展开。
3. 写作标准:规定术语清单、契约安全红线、脱敏准则、交付优先级路线图。
## Answer
已完成面向飞书知识库的 Master Blueprint 及文档导航中心建设:
1. [`docs/external/飞书知识库-POC对外开发与使用文档体系全景规划.md`](file:///Users/d-robotics/temp/droboticflow/docs/external/%E9%A3%9E%E4%B9%A6%E7%9F%A5%E8%AF%86%E5%BA%93-POC%E5%AF%B9%E5%A4%96%E5%BC%80%E5%8F%91%E4%B8%8E%E4%BD%BF%E7%94%A8%E6%96%87%E6%A1%A3%E4%BD%93%E7%B3%BB%E5%85%A8%E6%99%AF%E8%A7%84%E5%88%92.md):包含两大体系、九大分册的完整架构拓扑、受众画像、敏感信息脱敏红线规约、飞书一键导入 SOP 及分阶段里程碑。
2. [`docs/external/README.md`](file:///Users/d-robotics/temp/droboticflow/docs/external/README.md):对外文档中心全局导航大纲,全面串联开发套件(A1-A3、Demo 原型)与使用套件(B1-B6)。
3. 所有文档均通过标准 Markdown 编写,完美兼容飞书导入器与复制粘贴原生渲染。

View File

@ -0,0 +1,40 @@
# Wayfinder Map: POC 对外开发与使用文档体系规划
## Destination
交付一份完整、脱敏且已针对飞书(Feishu)知识库排版优化的《POC 对外开发与使用文档全景规划及目录规范说明书》,明确对外开发人员(算子/API/同步)与对外使用人员(管理员/流程/运营/采集/质检/审计)所需提供的全部文档清单、章节大纲、协议边界与交付物。
## Notes
- Domain: Droboticflow POC 具身智能与机器人数据工作流平台 (`droboticflow` 命名空间,`120.48.164.19`)
- Skills to consult: `domain-modeling`, `codebase-design`, `research`
- Standing preferences:
- 角色严格分离:对外开发人员(External Developers)与平台使用人员(Platform Users)独立成册。
- 算子开发边界限定为“标准化自定义容器算子(Custom Container Operator)”,严禁暴露内置算子代码与底层 operator-runner 源码。
- 彻底脱敏:剔除所有内部测试环境路径、历史弃用代码兼容说明及非公开信息。
- 格式完美适配飞书:支持一键导入飞书知识库或直接复制粘贴无损转换。
## Decisions so far
- [Decision 01 - 规划终点定义](file://.scratch/poc-external-docs/issues/00-initial-grilling.md): 先交付《文档体系规划与目录规范说明书》作为阶段终点,确定全景树与章节大纲后再开展批量编写。
- [Decision 02 - 目标受众与角色分类](file://.scratch/poc-external-docs/issues/00-initial-grilling.md): 划分为外部开发者(算子开发、系统集成)与平台使用者(平台管理员、流程工程师、数据运营、现场采集人员、质检验收、审计观察员)共两层八类角色。
- [Decision 03 - 算子开发开放边界](file://.scratch/poc-external-docs/issues/00-initial-grilling.md): 以基于 Docker 的自定义容器算子为主干协议,辅以快速验证能力,完全屏蔽内部 Builtin 源码。
- [Decision 04 - 独立对外专区与脱敏策略](file://.scratch/poc-external-docs/issues/00-initial-grilling.md): 在独立对外文档专区构建,去除内部技术黑话与兼容历史。
- [Decision 05 - 交付载体与飞书格式](file://.scratch/poc-external-docs/issues/00-initial-grilling.md): 产出深度适配飞书文档规范的 Markdown 体系与主文档,支持一键导入飞书知识库。
- [01-external-developer-docs-architecture](file://.scratch/poc-external-docs/issues/01-external-developer-docs-architecture.md): 完成三大开发者指南(A1 算子容器开发、A2 REST API 自动化集成、A3 drosync 客户端集成)。
- [02-platform-user-manuals-architecture](file://.scratch/poc-external-docs/issues/02-platform-user-manuals-architecture.md): 完成六大业务角色操作手册(B1 管理员、B2 流程工程师、B3 数据运营、B4 现场采集、B5 质检验收、B6 合规审计)。
- [03-custom-operator-quickstart-prototype](file://.scratch/poc-external-docs/issues/03-custom-operator-quickstart-prototype.md): 完成极速自定义容器算子 Demo 原型(包含 `operator.py`, `Dockerfile`, `operator.json`, `test_local.sh`, `README.md`),并通过本地单机契约验证。
- [04-feishu-docs-blueprint-synthesis](file://.scratch/poc-external-docs/issues/04-feishu-docs-blueprint-synthesis.md): 交付飞书 Master Blueprint 及对外文档中心全局导航 Hub(`docs/external/README.md`)。
## Not yet specified
- 飞书 Open API 自动化同步脚本(待后续提供企业自建应用凭据后落地)。
- 算子本地调试仿真沙箱环境 CLI(类似本地轻量 minikube/mock runner)。
- 外部开发人员专用的 Swagger / Redoc 静态交互式 API 站点生成流程。
## Out of scope
- 内部 Builtin 算子底层 Python 运行器与调度器修改文档。
- Fanyu 分支专有功能及未发布特性的对外说明。
- 历史废弃接口兼容层与清理说明(仅限内部研发可见)。
- 多租户商业计费与账单系统文档。

View File

@ -0,0 +1,25 @@
# Specification: POC 对外开发与使用文档体系规范
本文档为 Droboticflow POC 对外文档体系的技术规约。所有文档均已脱离本仓库,直接发布至**飞书云文档**专区。
## 1. 体系目标
面向 POC 外部开发人员(算子、API、同步客户端)与使用人员(管理员、流程编排、数据运营、现场采集、质检验收、合规审计)提供成套、角色闭环、零工程内部黑话泄露的正式交付文档。
## 2. 飞书文档发布中心与全量链接
飞书主文件夹:[📁 Droboticflow (POC) 对外文档中心](https://horizonrobotics.feishu.cn/drive/folder/JrCDfUkDQl43LadGBCZc4wuznQg)
| 体系分册 | 文档名称 | 飞书在线文档链接 | 适用受众 |
| :--- | :--- | :--- | :--- |
| **导航主页** | 平台对外文档中心导航大纲 | [在线阅读](https://horizonrobotics.feishu.cn/docx/N7IAd1UtToWU4ox9zn3cDGLcnPe) | 全体外部人员 |
| **全景规划** | 文档体系全景规划与规范说明书 | [在线阅读](https://horizonrobotics.feishu.cn/docx/KE54diBzPoBYzuxQD3QcWTMJnLb) | 负责人与架构师 |
| **开发分册 A1** | 自定义容器算子开发与接入指南 | [在线阅读](https://horizonrobotics.feishu.cn/docx/Pk6rdRMNoolEjaxBLZEcS92Nnah) | 算法/模型开发 |
| **开发分册 A2** | 平台开放 REST API 与自动化集成指南 | [在线阅读](https://horizonrobotics.feishu.cn/docx/Pk60dr6ploTDVBxtY8Pcul4injg) | 系统集成/后端 |
| **开发分册 A3** | drosync 数据采集客户端集成手册 | [在线阅读](https://horizonrobotics.feishu.cn/docx/SxA5dliHpozzrrxKxz8cuC8vnbb) | 采集工具运维 |
| **开发范例** | 5分钟算子极速上手工程原型 (QuickStart) | [在线阅读](https://horizonrobotics.feishu.cn/docx/VJZVd9KZUoEMCfxkWItcys1dn3f) | 算法开发工程师 |
| **使用分册 B1** | 平台管理员与系统配置指南 | [在线阅读](https://horizonrobotics.feishu.cn/docx/GRnDd31gloa9gIxUzXCcv1zKn6c) | 平台/超级管理员 |
| **使用分册 B2** | 流程工程师编排与调试手册 | [在线阅读](https://horizonrobotics.feishu.cn/docx/VqWedTTiToHfYZxN4bzcLQzrnOh) | 流程工程师 |
| **使用分册 B3** | 数据运营与任务监控手册 | [在线阅读](https://horizonrobotics.feishu.cn/docx/QxtCdDvIfonLfVxNlftcJJX7nGb) | 数据运营人员 |
| **使用分册 B4** | 现场采集人员极简操作指南 | [在线阅读](https://horizonrobotics.feishu.cn/docx/Zei8dBvm4oLM2DxZFFoc6xY0n96) | 现场随车采集员 |
| **使用分册 B5** | 质检验收与人工审核手册 | [在线阅读](https://horizonrobotics.feishu.cn/docx/U6gvdK665oToPdxkpAAciVFQnPe) | 质检验收人员 |
| **使用分册 B6** | 合规审计与数据溯源手册 | [在线阅读](https://horizonrobotics.feishu.cn/docx/Je9kdbD2noTSaexZWbSc3txnnDh) | 合规审计人员 |

View File

@ -2,9 +2,10 @@
## Deployment Environment
- The `dev` branch uses the `poc` deployment and test environment.
- Leave `DEPLOY_ENV` unset on `dev`; the deploy scripts should resolve it to `poc`.
- Do not deploy `dev` to `wjzh` unless the user explicitly overrides this rule.
- The `poc` branch uses the POC environment (namespace `droboticflow`, public entry `120.48.164.19`).
- Keep the pre-Fanyu baseline `d947a20b` plus drosync changes. Do not merge `dev` or Fanyu commits into `poc`.
- Build POC images from `poc` and publish them under `dataflow-poc`, never from the Fanyu development branch.
- Fanyu is a separate environment and is not a target of POC deployment commands.
## Git Workflow
@ -14,3 +15,7 @@
- Commit automatically with an English, emoji-prefixed commit message.
- Push the current branch after a successful commit.
- Do not stage or commit unrelated user changes already present in the working tree.
## Release Versioning
- Every time a new release package/build is generated for the user, increment the last digit of the version by +1 in `tools/drosync/Cargo.toml` (e.g., `1.0.0` -> `1.0.1` -> `1.0.2`).

49
CONTEXT.md Normal file
View File

@ -0,0 +1,49 @@
# Droboticflow POC
Domain vocabulary for Droboticflow POC environment workflow orchestration, custom operators, and data synchronization.
## Language
**POC Environment**:
The isolated deployment and validation environment operating under namespace droboticflow at 120.48.164.19 on git branch poc.
_Avoid_: Dev, Fanyu, Production
**Custom Operator**:
A user-defined data transformation or validation module packaged as a standard Docker container communicating through input/output artifacts and environment variables.
_Avoid_: Builtin operator, internal runner handler, plugin
**Builtin Operator**:
A platform-managed, canonical operator embedded in the central catalog whose container images are maintained by the platform team.
_Avoid_: Core script, system operator
**Workflow**:
A directed acyclic graph (DAG) composed of operator nodes, data connections, and hyperparameters executed by the Go worker and scheduled on Kubernetes.
_Avoid_: Pipeline (when referring to an individual DAG instance), Job
**Artifact**:
A discrete, typed, addressable data object or reference produced by an operator execution node.
_Avoid_: Output file, blob, payload, log
**drosync**:
The high-reliability, one-way synchronization tool transferring local robotics sensor datasets to Baidu Object Storage (BOS) with conflict protection.
_Avoid_: File sync, rsync, robopull
**Platform Administrator**:
The user role responsible for managing an organization's business accounts, storage connections, drosync spaces, and access keys.
_Avoid_: SuperAdmin, root
**Pipeline Engineer**:
The user role responsible for registering custom operators, designing workflow templates, orchestrating DAGs, and publishing workflow versions.
_Avoid_: Algorithm dev, pipeline designer
**Data Operator**:
The user role responsible for tracking daily data ingestion, monitoring live runs, pausing/resuming workflows, and retrying failed nodes.
_Avoid_: Operator (overloaded), worker
**QA Reviewer**:
The user role responsible for reviewing human audit tasks, conducting sample quality inspections, and evaluating final data assets.
_Avoid_: Auditor, inspector
**Compliance Auditor**:
The user role responsible for viewing audit trails, data provenance, run lineage, and synchronization evidence.
_Avoid_: QA, security guard

View File

@ -17,6 +17,7 @@ RUN pip install --no-cache-dir numpy opencv-python-headless bce-python-sdk pymon
RUN groupadd --system --gid 10001 droboticflow && useradd --system --uid 10001 --gid droboticflow --home-dir /app --shell /usr/sbin/nologin droboticflow
COPY --chown=10001:10001 backend ./backend
COPY --chown=10001:10001 operator-repos ./operator-repos
USER 10001:10001
CMD ["python", "/app/backend/operator-runner/main.py"]

View File

@ -1,5 +1,7 @@
# Drobodata
The current branch retires historical runtime compatibility. Read [the cutover and retired-capability record](doc/兼容代码清理记录.md) before deployment. New browser sessions, artifact payloads, operator handlers, credentials and client journals must use the current contracts. No production cutover is implied by this source change.
Drobodata is a workflow orchestration platform for embodied AI and vision pipelines. This repository now contains:
- a React/Vite frontend
@ -114,9 +116,9 @@ Key environment variables:
- `OPERATOR_COMMAND_ALLOWLIST_REGEX`: optional regular expression that explicit shell commands must match
- `OPERATOR_COMMAND_DENYLIST_REGEX`: optional regular expression that rejects matching explicit shell commands
- `DROBOTICFLOW_API_TOKEN`: optional shared API token for non-browser API clients. When set, non-public API calls require `Authorization: Bearer <token>` or `X-Droboticflow-API-Token` unless a valid session cookie is already present while session auth is enabled.
- `DROBOTICFLOW_REQUIRE_SESSION_AUTH`: optional cookie-session auth enforcement for business APIs, default `false` locally; public LoadBalancer deploys force it to `true`
- Browser business APIs always require cookie-session authentication; there is no authentication-off setting.
- `DROBOTICFLOW_SESSION_COOKIE_SECURE`: sets the `Secure` attribute on session cookies, default `false` for local development; enable it behind HTTPS
- `DROBOTICFLOW_ACCEPTANCE_EMAIL` / `DROBOTICFLOW_ACCEPTANCE_PASSWORD`: optional credentials used by live acceptance and reconcile scripts to log in, persist cookies, and send CSRF headers against session-authenticated deployments. Workflow acceptance checks can use admin, pipeline-engineer, data-operator, or legacy operator accounts depending on the exercised surface; reconcile still needs an admin account when it updates settings or management resources.
- `DROBOTICFLOW_ACCEPTANCE_EMAIL` / `DROBOTICFLOW_ACCEPTANCE_PASSWORD`: optional credentials used by live acceptance and reconcile scripts to log in, persist cookies, and send CSRF headers against session-authenticated deployments. Workflow acceptance checks can use admin, pipeline-engineer, or data-operator accounts depending on the exercised surface; reconcile still needs an admin account when it updates settings or management resources.
- `DROBOTICFLOW_TRUSTED_PROXY_CIDRS`: optional comma/space-separated proxy CIDRs whose `X-Forwarded-For` or `X-Real-IP` headers may be trusted for rate limiting; empty means trust no forwarded headers
- `API_SERVICE_TYPE`: Kubernetes API service type for rendered manifests, `NodePort` by default and `ClusterIP` when exposure is handled by LoadBalancer or ingress
- `AI_API_BASE_URL`: OpenAI-compatible endpoint used by server-side AI generation; required when `AI_API_KEY` is set
@ -124,7 +126,7 @@ Key environment variables:
- `AI_API_KEY`: server-side OpenAI-compatible API key used for workflow/operator generation; leave unset to disable AI generation
- `VITE_API_BASE_URL`: optional frontend API base URL override; leave empty for same-origin `/api`, or set an absolute `http://` / `https://` URL
- `VITE_DEV_API_BASE_URL`: optional Vite dev proxy target for `/api`, default `http://127.0.0.1:3001`
- `VITE_DEV_WORKER_BASE_URL`: optional Vite dev proxy target for `/worker-api`, default `http://127.0.0.1:3002`
- Browser `/worker-api` routes use the same `VITE_DEV_API_BASE_URL` proxy as `/api`; direct Worker proxy overrides are retired so session and role checks always apply.
- `WORKFLOW_ACCEPTANCE_REQUIRE_EXPLICIT_ENDPOINT`: set to `true` for deployed-environment workflow acceptance so omitted API endpoints fail instead of falling back to localhost.
Explicit startup values are validated before API/worker startup, before Kubernetes manifest rendering, and before `scripts/deploy-k8s.sh` performs cluster writes. `MONGO_URI` is required at runtime and must be a `mongodb://` or `mongodb+srv://` URI without whitespace or unreplaced placeholder markers. `PORT`/`WORKER_PORT` must be valid TCP ports, Mongo retry count and retry delay must be positive, worker poll interval must be positive, replica counts must be non-negative in manifests, NodePort must be in the Kubernetes `30000..32767` range, and `OPERATOR_JOB_TTL_SECONDS` must be non-negative (`0` disables TTL injection). Manifest, build, and deploy wrappers no longer carry a repository-default image registry: callers must set `API_IMAGE`, `WORKER_IMAGE`, and `OPERATOR_RUNNER_IMAGE` explicitly, or set `REGISTRY_HOST` and `REGISTRY_NAMESPACE` so those image references can be derived from `IMAGE_TAG`; all three wrappers validate generated or explicit image references before Docker or Kubernetes calls. Manifest and deploy wrappers also reject invalid Kubernetes namespace/Secret/PVC/Service names, non-absolute workspace mount paths, malformed worker/BOS service URLs, malformed non-empty AI service URLs, missing AI base/model when an AI key is configured, and container image references with whitespace. Multi-line ConfigMap block values such as GPU tolerations JSON and shell command allow/deny regexes are indented before manifest output so readable multi-line input stays valid YAML. Explicit boolean env values accept `true/false`, `1/0`, `yes/no`, or `on/off`; other spellings fail fast instead of silently falling back, and accepted true aliases drive deploy-time branches such as public LoadBalancer creation.
@ -132,9 +134,9 @@ Explicit startup values are validated before API/worker startup, before Kubernet
Development and acceptance entrypoints resolve API endpoints through shared helpers instead of each script carrying its own localhost default. Node/Vite entrypoints use `scripts/lib/service-endpoints.mjs`, Python operational scripts use `scripts/lib/droboticflow_env.py`, and shell wrappers use `scripts/lib/service-endpoints.sh`. `BASE_URL` is accepted by browser-oriented acceptance scripts, while deployment/reconcile wrappers preserve `API_BASE_URL` as their primary environment variable. Explicit endpoint values must be absolute `http://` or `https://` URLs so malformed values fail before Vite, curl, Playwright, or urllib requests are attempted. Browser-side `VITE_API_BASE_URL` follows the same rule, with the empty value reserved for same-origin API requests.
The frontend never reads the AI key directly. Workflow generation and operator generation are proxied through the Go API so secrets stay on the server side. AI-generated operators use an explicit publication lifecycle: `draft -> built -> verified -> published`. Generated drafts can be saved and exercised only in sandbox workflows; production workflows, templates, runs, and AI workflow generation accept only published AI operators with repository, digest, fixture, test, and acceptance evidence.
The settings page can update K8s access details, the worker defaults, the global `timezone`, `provider`, `baseURL`, `model`, and the server-side AI key. `GET /api/settings` only returns whether secrets exist via `k8s.hasKubeconfig` / `ai.hasAPIKey`; it does not echo plaintext kubeconfig or API keys back to the browser. When session auth is required, `/api/settings`, `/api/users`, database browser routes, object-storage management routes, Mongo connection tests, and external business-DB token management are organization-admin surfaces; creating a user or setting a password requires a non-blank password value, user names cannot be blank, and account status must be `active` or `disabled`. Business roles are modeled around embodied-AI data production: `admin` owns organization/system governance, `pipeline_engineer` owns operators/templates/workflow design and AI-assisted generation, `data_operator` owns project execution, run control, production monitoring, and storage browsing, `qa_reviewer` owns workflow audit decisions and post-package sampling acceptance, and `compliance_auditor` is read-only for monitoring, data assets, and audit traceability. Legacy `operator` and `auditor` users remain accepted for migration compatibility. Project mutations reject blank names and unknown statuses; project status must be `active` or `archived`. Workflow and template mutations reject blank names and unknown metadata enum values before persistence. Operator mutations reject blank metadata, unknown operator/port enum values, duplicate port IDs, and invalid resource defaults before persistence. Reusable storage/Mongo connection list/get routes and workflow storage browse helpers require admin, pipeline engineer, data operator, or legacy operator role so workflow editors and production operators can select real connections without exposing connection or bucket metadata to reviewers. Creating, updating, deleting, or testing connections remains admin-only. Model-backed AI generation requires admin, pipeline engineer, or legacy operator role. Non-admin pages use `/api/public/settings`, which exposes only `timezone`, and users can update only their own sidebar `name` / `email` through `/api/users/me`. Worker polling and concurrency values are positive-integer gated in the browser, the shared settings payload builder, and the API, so values such as `0`, `1.5`, `60s`, or blank strings fail instead of being ignored. Default CPU/MEM resource values are trimmed and validated as positive Kubernetes resource quantities when settings are saved, and default GPU must be a positive integer when present. Timestamps in the UI are rendered in the configured IANA timezone with compact minute-level formatting for cards, lists, and summaries, while logs keep finer granularity when needed. OSS-related bucket and path settings belong on OSS operators in workflows, not in the global system settings page. Scan workflows can now reference reusable BOS storage connections via `scanConfig.connectionId`, so endpoint and AK/SK are stored once in `/api/storage/connections` and resolved by the API/worker at preview and execution time instead of being duplicated into each workflow; if a scan config or connection omits endpoint, both API preview and worker execution use the validated `BOS_ENDPOINT` startup value when it is set, otherwise real BOS requests fail with an explicit missing-endpoint error.
The settings page can update K8s access details, the worker defaults, the global `timezone`, `provider`, `baseURL`, `model`, and the server-side AI key. `GET /api/settings` only returns whether secrets exist via `k8s.hasKubeconfig` / `ai.hasAPIKey`; it does not echo plaintext kubeconfig or API keys back to the browser. When session auth is required, `/api/settings`, `/api/users`, database browser routes, object-storage management routes, Mongo connection tests, and external business-DB token management are organization-admin surfaces; creating a user or setting a password requires a non-blank password value, user names cannot be blank, and account status must be `active` or `disabled`. Business roles are modeled around embodied-AI data production: `admin` owns organization/system governance, `pipeline_engineer` owns operators/templates/workflow design and AI-assisted generation, `data_operator` owns project execution, run control, production monitoring, and storage browsing, `qa_reviewer` owns workflow audit decisions and post-package sampling acceptance, and `compliance_auditor` reads monitoring, data assets, and audit traces; the current task-audit API also permits its approval/rejection decisions. Only these five business roles are accepted. Unsupported role values cannot be assigned, log in, reuse sessions, or become public-preview identities. See [role scenarios and permissions](doc/角色使用想定与权限说明.md) for the UI/API boundaries. Project mutations reject blank names and unknown statuses; project status must be `active` or `archived`. Workflow and template mutations reject blank names and unknown metadata enum values before persistence. Operator mutations reject blank metadata, unknown operator/port enum values, duplicate port IDs, and invalid resource defaults before persistence. Reusable storage/Mongo connection list/get routes and workflow storage browse helpers require admin, pipeline engineer, or data operator role so workflow editors and production operators can select real connections without exposing connection or bucket metadata to reviewers. Creating, updating, deleting, or testing connections remains admin-only. Model-backed AI generation requires admin or pipeline engineer role. Non-admin pages use `/api/public/settings`, which exposes only `timezone`, and users can update only their own sidebar `name` / `email` through `/api/users/me`. Worker polling and concurrency values are positive-integer gated in the browser, the shared settings payload builder, and the API, so values such as `0`, `1.5`, `60s`, or blank strings fail instead of being ignored. Default CPU/MEM resource values are trimmed and validated as positive Kubernetes resource quantities when settings are saved, and default GPU must be a positive integer when present. Timestamps in the UI are rendered in the configured IANA timezone with compact minute-level formatting for cards, lists, and summaries, while logs keep finer granularity when needed. OSS-related bucket and path settings belong on OSS operators in workflows, not in the global system settings page. Scan workflows can now reference reusable BOS storage connections via `scanConfig.connectionId`, so endpoint and AK/SK are stored once in `/api/storage/connections` and resolved by the API/worker at preview and execution time instead of being duplicated into each workflow; if a scan config or connection omits endpoint, both API preview and worker execution use the validated `BOS_ENDPOINT` startup value when it is set, otherwise real BOS requests fail with an explicit missing-endpoint error.
The API now includes a cookie-session account foundation for organization-based access. Auth endpoints cover bootstrap, login, logout, current session, and super-admin organization/user management. Existing local deployments remain compatible by default; public LoadBalancer deploys require `DROBOTICFLOW_REQUIRE_SESSION_AUTH=true` so browser business APIs keep role checks. Session-authenticated unsafe requests, including logout, use a double-submit `droboticflow_csrf` cookie plus `X-Droboticflow-CSRF-Token` header. Browser JSON, object-storage preview, and multipart object upload requests share the same credentials and CSRF header path; object-storage preview byte-count headers are accepted only when they are exact safe non-negative integers. Worker control endpoints under `/worker-api` require an admin, pipeline engineer, data operator, or legacy operator session, or an API token when session auth is not enforced. Bundled acceptance and reconcile scripts can log in with `DROBOTICFLOW_ACCEPTANCE_EMAIL` / `DROBOTICFLOW_ACCEPTANCE_PASSWORD` and will send CSRF headers on writes. Do not embed `DROBOTICFLOW_API_TOKEN` into frontend builds; it is intended for machine-to-machine calls only.
The API now includes a cookie-session account foundation for organization-based access. Auth endpoints cover bootstrap, login, logout, current session, and super-admin organization/user management. All browser business APIs require cookie-session authentication; there is no public-preview identity or authentication-off mode. Session-authenticated unsafe requests, including logout, use a double-submit `droboticflow_csrf` cookie plus `X-Droboticflow-CSRF-Token` header. Browser JSON, object-storage preview, and multipart object upload requests share the same credentials and CSRF header path; object-storage preview byte-count headers are accepted only when they are exact safe non-negative integers. Worker control endpoints under `/worker-api` require an admin, pipeline engineer, or data operator session. Bundled acceptance and reconcile scripts can log in with `DROBOTICFLOW_ACCEPTANCE_EMAIL` / `DROBOTICFLOW_ACCEPTANCE_PASSWORD` and will send CSRF headers on writes. Do not embed `DROBOTICFLOW_API_TOKEN` into frontend builds; it is intended for machine-to-machine calls only.
The Kubernetes runtime now assumes a shared workspace PVC. Worker writes per-node `input-artifacts.json` files into the shared workspace, operator-runner Jobs read those files through `INPUT_ARTIFACTS_PATH`, then persist `result.json` and `stage-manifest.json` back into the same PVC. Large artifact lists no longer need to travel through giant env vars or stdout payloads. Node CPU and memory requests/limits are applied to Kubernetes Job container resources and must be valid positive Kubernetes resource quantities; malformed explicit values fail before a Job is created instead of being omitted. Operator defaults and workflow-node overrides can also set `sharedMemorySize` for a writable `/dev/shm` memory volume; the effective order is node override, operator default, then `DROBOTICFLOW_SHARED_MEMORY_SIZE` (POC default `8Gi`). GPU requests use `nvidia.com/gpu` when the node or default resource config sets a positive GPU count. GPU scheduling requires a cluster with GPU nodes and the NVIDIA device plugin/runtime installed. Optional GPU node selector, tolerations, and runtime class settings are only injected into Jobs that request a positive GPU count. Invalid GPU selector or tolerations configuration fails worker startup instead of being ignored. Operator-runner Jobs also receive `ttlSecondsAfterFinished` from `OPERATOR_JOB_TTL_SECONDS`, and the cleanup script can remove old completed Jobs that were created before TTL was enabled. Run `npm run acceptance:gpu` against a real GPU cluster to validate allocatable GPU resources, scheduling, runtime, and `nvidia-smi` execution; the acceptance script rejects invalid namespace, image, timeout, GPU count, selector, toleration, resource-name, Job-name, and runtime-class inputs before it touches the cluster, and renders dynamic manifest values as quoted YAML scalars. Runs that execute on NVIDIA hardware report GPU utilization, GPU memory, GPU count, and GPU model in the resource samples shown on the monitoring page.
@ -142,7 +144,7 @@ Explicit `COMMAND` / `SCRIPT` execution is disabled by default. Deployments that
Kubernetes Job failures include operator logs plus Job conditions, Pod phase, container waiting or termination reasons, and Pod events in the run error path. This makes image pull, scheduling, PVC mount, timeout, and GPU allocation failures visible without separately describing the Pod.
The worker exposes lightweight runtime metrics at `/worker-api/metrics` in Prometheus text format. The endpoint reports run status gauges, dispatch counters, node execution counters, cumulative duration counters, duration histograms, and the latest dispatch queue depth. Access through the API requires an admin, pipeline-engineer, data-operator, or legacy operator session or an API token when session auth is not enforced; the in-cluster worker Service keeps Prometheus scrape annotations for internal collection.
The worker exposes lightweight runtime metrics at `/worker-api/metrics` in Prometheus text format. The endpoint reports run status gauges, dispatch counters, node execution counters, cumulative duration counters, duration histograms, and the latest dispatch queue depth. Access through the API requires an admin, pipeline-engineer, or data-operator session; the in-cluster worker Service keeps Prometheus scrape annotations for internal collection.
Workflow execution concurrency now has two levels:

View File

@ -4882,7 +4882,7 @@ def builtin_model_inference(
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.model_inference.operator', run_id, node_id, output_dir, node_data, inputs)
return run_operator_module('model_inference', run_id, node_id, output_dir, node_data, inputs)
def builtin_vla_model_train(
@ -4892,7 +4892,7 @@ def builtin_vla_model_train(
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.vla_model_train.operator', run_id, node_id, output_dir, node_data, inputs)
return run_operator_module('vla_model_train', run_id, node_id, output_dir, node_data, inputs)
def builtin_sim3d_asset_generate(
@ -4902,7 +4902,7 @@ def builtin_sim3d_asset_generate(
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.sim3d_asset_generate.operator', run_id, node_id, output_dir, node_data, inputs)
return run_operator_module('sim3d_asset_generate', run_id, node_id, output_dir, node_data, inputs)
def builtin_holobrain_data_prepare(
@ -4912,7 +4912,7 @@ def builtin_holobrain_data_prepare(
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.holobrain_data_prepare.operator', run_id, node_id, output_dir, node_data, inputs)
return run_operator_module('holobrain_data_prepare', run_id, node_id, output_dir, node_data, inputs)
def builtin_holobrain_train(
@ -4922,7 +4922,7 @@ def builtin_holobrain_train(
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.holobrain_train.operator', run_id, node_id, output_dir, node_data, inputs)
return run_operator_module('holobrain_train', run_id, node_id, output_dir, node_data, inputs)
def builtin_holobrain_export(
@ -4932,7 +4932,7 @@ def builtin_holobrain_export(
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.holobrain_export.operator', run_id, node_id, output_dir, node_data, inputs)
return run_operator_module('holobrain_export', run_id, node_id, output_dir, node_data, inputs)
def builtin_holobrain_robotwin_eval(
@ -4942,7 +4942,7 @@ def builtin_holobrain_robotwin_eval(
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.holobrain_robotwin_eval.operator', run_id, node_id, output_dir, node_data, inputs)
return run_operator_module('holobrain_robotwin_eval', run_id, node_id, output_dir, node_data, inputs)
def builtin_holobrain_inference_test(
@ -4952,7 +4952,7 @@ def builtin_holobrain_inference_test(
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.holobrain_inference_test.operator', run_id, node_id, output_dir, node_data, inputs)
return run_operator_module('holobrain_inference_test', run_id, node_id, output_dir, node_data, inputs)
def builtin_vla_model_inference(
@ -4962,7 +4962,7 @@ def builtin_vla_model_inference(
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.vla_model_inference.operator', run_id, node_id, output_dir, node_data, inputs)
return run_operator_module('vla_model_inference', run_id, node_id, output_dir, node_data, inputs)
def builtin_vla_model_evaluate(
@ -4972,7 +4972,7 @@ def builtin_vla_model_evaluate(
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.vla_model_evaluate.operator', run_id, node_id, output_dir, node_data, inputs)
return run_operator_module('vla_model_evaluate', run_id, node_id, output_dir, node_data, inputs)
def builtin_shell_command(
@ -4982,7 +4982,7 @@ def builtin_shell_command(
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
) -> list[dict[str, Any]]:
return run_operator_module('backend.operators.builtin.shell_command.operator', run_id, node_id, output_dir, node_data, inputs)
return run_operator_module('shell_command', run_id, node_id, output_dir, node_data, inputs)
def execute_command(
@ -5112,28 +5112,21 @@ OPERATOR_HELPERS = {
BuiltinHandler = Any
_OPERATOR_MODULE_CACHE: dict[str, Any] = {}
_OPERATOR_MODULE_ALIASES: dict[str, str] = {
f"{path.name}_operator": f"backend.operators.builtin.{path.name}.operator"
for path in (PROJECT_ROOT / "backend" / "operators" / "builtin").iterdir()
if path.is_dir() and (path / "operator.py").exists()
}
def load_operator_module(module_path: str) -> Any:
module = _OPERATOR_MODULE_CACHE.get(module_path)
def load_operator_module(slug: str) -> Any:
if not re.fullmatch(r"[a-z0-9_]+", slug):
raise ValueError(f"invalid operator slug: {slug}")
source = PROJECT_ROOT / "operator-repos" / "builtin" / slug / "src" / "operator.py"
module = _OPERATOR_MODULE_CACHE.get(slug)
if module is None:
module = importlib.import_module(module_path)
_OPERATOR_MODULE_CACHE[module_path] = module
spec = importlib.util.spec_from_file_location("droboticflow_operator_" + slug, source)
if spec is None or spec.loader is None:
raise RuntimeError(f"cannot load operator source: {source}")
module = importlib.util.module_from_spec(spec)
spec.loader.exec_module(module)
_OPERATOR_MODULE_CACHE[slug] = module
return module
def __getattr__(name: str) -> Any:
module_path = _OPERATOR_MODULE_ALIASES.get(name)
if module_path:
return load_operator_module(module_path)
raise AttributeError(f"module {__name__!r} has no attribute {name!r}")
def run_operator_module(
module_path: str,
run_id: str,
@ -5168,244 +5161,119 @@ def builtin_generic_handler(run_id: str, node_id: str, output_dir: pathlib.Path,
return builtin_generic(run_id, node_id, output_dir, node_label, node_data, inputs)
BUILTIN_HANDLER_RULES: tuple[tuple[str, tuple[str, ...]], ...] = (
("bos_incremental_scan", ("bos 增量扫描", "bos incremental", "增量扫描")),
("human_review", ("人工审核", "人工验收", "任务审核", "human review")),
("mongodb_write", ("mongodb", "mongo 写入", "mongo write", "写入 mongo")),
("xplatform_index", ("x 平台数据集索引", "x-platform", "数据集索引", "dataset index")),
("collection_validate", ("采集目录校验", "目录校验", "validate collection")),
("video_quality", ("视频质检", "quality check", "quality")),
("dataset_filter", ("数据过滤", "dataset filter", "video filter")),
("video_slicing", ("视频切片", "video slicing", "slice")),
("yolo_video_target_clip", ("yolo 视频目标检测裁剪", "yolo target clip", "yolo video detection")),
("video_target_clip", ("视频目标检测裁剪", "目标检测裁剪", "视频目标检测", "target clip", "object detection clip", "video object detection")),
("video_annotation", ("视频标注", "annotation", "annotate")),
("result_package", ("成品打包", "package output", "package result")),
("audit_sampling", ("抽检采样", "audit sample", "sampling")),
("hf_dataset_probe", ("hf 数据集探测", "huggingface dataset", "hf dataset", "dataset viewer")),
("agibot_world2026_validate", ("agibotworld2026", "agibot world", "agibotworld", "智元 world", "智元数据集")),
("bridgedata_tfds_manifest_validate", ("bridgedata", "bridge data", "tfds-rlds", "tfds rlds 清单")),
("rlds_episode_summary", ("rlds", "tfds", "open x-embodiment", "轨迹概览")),
("droid_raw_episode_validate", ("droid raw", "droid episode", "droid trajectory", "droid raw episode", "droid 数据校验")),
("libero_hdf5_task_validate", ("libero hdf5", "libero 任务", "libero 数据集", "libero benchmark")),
("robocasa_hdf5_demonstration_validate", ("robocasa hdf5", "robocasa 示教", "robocasa 数据集", "robocasa demonstration")),
("furniturebench_pkl_demonstration_validate", ("furniturebench", "furniture bench", "家具装配", "furniture pkl")),
("roboturk_real_hdf5_validate", ("roboturk real", "roboturk hdf5", "roboturk aligned", "roboturk 真实", "robo turk")),
("roboset_hdf5_validate", ("roboset hdf5", "roboset 数据", "robo set", "robohive dataset", "robohive hdf5")),
("rh20t_scene_validate", ("rh20t", "rh20t 场景", "rh20t scene", "real human 20t")),
("robomind_hdf5_quality_validate", ("robomind hdf5", "robomind 质量", "robomind 数据", "multi-embodiment intelligence")),
("aloha_hdf5_validate", ("aloha hdf5", "aloha 示教", "act hdf5", "aloha 数据校验")),
("robomimic_hdf5_validate", ("robomimic hdf5", "robomimic 示教", "robomimic 数据校验", "robomimic dataset")),
("hdf5_demonstration_summary", ("hdf5 示教", "hdf5 demo", "robomimic", "droid hdf5")),
("holobrain_data_prepare", ("holobrain 数据准备", "holobrain data prepare", "robotwin2.0 数据准备", "robotwin 数据准备")),
("holobrain_train", ("holobrain 完整训练", "holobrain train", "holobrain 训练")),
("holobrain_export", ("holobrain 模型导出", "holobrain export")),
("holobrain_robotwin_eval", ("holobrain robotwin 评测", "holobrain robotwin eval", "robotwin 评测")),
("holobrain_inference_test", ("holobrain 模型测试", "holobrain inference test", "holobrain 推理测试")),
("openvla_finetune", ("openvla 微调", "openvla finetune", "openvla 训练")),
("openvla_inference", ("openvla 推理", "openvla inference")),
("vla_sample_manifest_validate", ("vla 样本", "vla manifest", "视觉语言动作样本", "droid manifest")),
("rlbench_dataset_validate", ("rlbench", "rlbench 数据集", "rlbench dataset")),
("maniskill_trajectory_validate", ("maniskill", "maniskill 轨迹", "mani skill")),
("calvin_episode_validate", ("calvin episode", "calvin 数据", "calvin episode 校验")),
("rtx_action_schema_validate", ("rt-x 动作", "rtx action", "open x action", "动作空间schema")),
("embodiment_metadata_validate", ("embodiment 元信息", "多机器人embodiment", "robot embodiment", "具身元信息")),
("force_torque_sensor_validate", ("力扭矩", "force torque", "wrench", "ft sensor", "力/扭矩")),
("lerobot_video_alignment_validate", ("lerobot 视频对齐", "lerobot video", "video alignment", "视频对齐校验")),
("lerobot_v3_episode_index_validate", ("lerobot v3 episode", "episode索引", "episode index", "data path template")),
("lerobot_dataset_validate", ("lerobot 数据集校验", "lerobot validate", "lerobot validation")),
("lerobot_metadata_consistency_validate", ("lerobot 元数据", "lerobot metadata", "metadata consistency")),
("trajectory_integrity_validate", ("轨迹多模态完整性校验", "trajectory integrity", "multimodal integrity")),
("action_state_quality_validate", ("动作状态数值", "action state quality", "action/state", "状态数值")),
("episode_boundary_validate", ("episode 边界", "episode boundary", "终止标志", "terminal flag")),
("joint_limit_validate", ("关节限位", "joint limit", "urdf limit", "qpos limit")),
("dataset_split_leakage_validate", ("切分泄漏", "split leakage", "leakage validation", "数据泄漏")),
("dataset_split_manifest", ("训练切分清单", "dataset split", "split manifest")),
("media_reference_validate", ("媒体引用", "media reference", "media readability", "引用可读")),
("dataset_schema_contract_validate", ("schema 合约", "schema contract", "数据集schema", "schema 校验")),
("mcap_topic_summary", ("mcap 主题概览", "mcap topic", "mcap summary")),
("tfrecord_structural_validate", ("tfrecord 结构校验", "tf record", "tfrecord validate")),
("dataset_provenance_audit", ("数据集来源许可审计", "dataset provenance", "license audit", "来源许可")),
("webdataset_shard_summary", ("webdataset 分片", "webdataset shard", "tar shard", "分片概览")),
("diffusion_policy_train", ("diffusion policy 训练", "diffusion policy train", "扩散策略训练")),
("umi_zarr_dataset_validate", ("umi zarr", "umi 数据", "universal manipulation interface", "diffusion policy zarr", "umi dataset")),
("zarr_trajectory_summary", ("zarr 轨迹", "zarr trajectory", "zarr array", "数组轨迹")),
("camera_calibration_validate", ("相机标定校验", "camera calibration", "intrinsics", "extrinsics")),
("tf_transform_tree_validate", ("tf 坐标树", "transform tree", "tf tree", "坐标树校验", "frametree")),
("ros_joint_state_validate", ("ros jointstate", "jointstate", "joint state", "joint_states", "ros 关节状态")),
("graspnet_dataset_validate", ("graspnet", "graspnet-1billion", "抓取数据集", "6d grasp", "general object grasping")),
("bop_dataset_validate", ("bop 6d", "bop 数据集", "bop dataset", "6d姿态", "6d pose", "object pose benchmark")),
("dexycb_dataset_validate", ("dexycb 数据集", "dex-ycb", "dexycb", "ycb hand", "hand grasping object")),
("ho3d_dataset_validate", ("ho3d 数据集", "ho-3d", "ho3d", "h2o3d", "h2o-3d", "honnotate")),
("wilor_hand_pose", ("wilor", "wilor 手部", "手部姿态估计", "3d hand pose", "hand pose estimation")),
("hand_removal", ("hand removal", "视频去手", "手部移除", "去除手臂", "propainter")),
("hand_object_pose_validate", ("手-物体姿态", "手物体姿态", "hand object pose", "dexycb", "ho3d")),
("partnet_mobility_asset_validate", ("partnet-mobility", "partnet mobility", "sapien asset", "sapien 资产", "mobility.urdf", "可交互物体")),
("mjcf_actuator_validate", ("mjcf 执行器", "mjcf actuator", "mujoco actuator", "执行器校验", "ctrlrange")),
("robot_model_asset_validate", ("机器人模型资产校验", "robot model asset", "urdf", "mjcf")),
("pointcloud_summary", ("点云数据概览", "point cloud", "pointcloud", "pcd", "ply")),
("sensor_timestamp_sync_validate", ("多传感器时间同步", "timestamp sync", "sensor sync", "时间同步")),
("parquet_table_summary", ("parquet 表摘要", "parquet summary", "parquet table", "parquet")),
("coco_annotation_validate", ("coco 标注", "coco annotation", "coco validate", "coco")),
("yolo_embodied_detection_train", ("yolo 具身目标检测训练", "yolo detection train", "yolo 训练")),
("yolo_video_target_clip", ("yolo 视频目标检测裁剪", "yolo target clip", "yolo video detection")),
("yolo_detection_validate", ("yolo 检测", "yolo label", "yolo 标注", "yolo")),
("rgbd_frame_pair_validate", ("rgb-d", "rgbd", "rgb-d 帧", "深度帧", "帧对齐")),
("segmentation_mask_validate", ("分割 mask", "segmentation mask", "semantic mask", "mask 校验")),
("language_instruction_validate", ("语言指令", "language instruction", "instruction validate", "vla 指令")),
("lerobot", ("lerobot",)),
("rosbag", ("rosbag", "mcap", "ros bag")),
("csv_to_json", ("csv 转 json", "csv转json", "csv to json", "tsv 转 json", "tsv转json", "tsv to json")),
("json_to_csv", ("json 转 csv", "json转csv", "json to csv")),
("json_extract", ("字段提取", "json提取", "json 提取", "extract")),
("json_filter", ("json过滤", "json 过滤", "filter")),
("json_map", ("json映射", "json 映射", "rename", "映射重命名")),
("text_template", ("模板渲染", "template")),
("condition_router", ("条件分流", "conditional", "router", "route")),
("directory_scan", ("目录扫描", "directory", "browse", "browse dir")),
("merge", ("merge", "合并")),
("intersection", ("intersect", "交集")),
("distribution", ("distribution", "分配")),
("upload", ("upload", "export", "上传", "导出")),
("act_policy_train", ("act 策略训练", "act policy train", "act training")),
("vla_model_train", ("vla 模型训练", "vla training", "视觉语言动作训练", "policy training")),
("sim3d_asset_generate", ("3d 资产仿真生成", "3d资产仿真生成", "仿真资产生成", "simulation asset", "sim3d asset")),
("vla_model_inference", ("vla 模型推理", "vla inference", "视觉语言动作推理", "policy inference")),
("vla_model_evaluate", ("vla 模型评测", "vla 评测", "vla evaluation", "policy evaluation")),
("model_inference", ("模型推理", "model inference", "inference")),
("shell_command", ("shell 命令", "shell command")),
("source", ("source", "scanner", "oss", "scan", "扫描", "数据源")),
)
BUILTIN_HANDLERS: dict[str, BuiltinHandler] = {
"source": operator_handler('backend.operators.builtin.real_source.operator'),
"act_policy_train": operator_handler('backend.operators.builtin.act_policy_train.operator'),
"bos_incremental_scan": operator_handler('backend.operators.builtin.bos_incremental_scan.operator'),
"merge": operator_handler('backend.operators.builtin.merge.operator'),
"intersection": builtin_intersection,
"distribution": builtin_distribution,
"json_extract": operator_handler('backend.operators.builtin.json_field_extract.operator'),
"json_filter": operator_handler('backend.operators.builtin.json_filter.operator'),
"json_map": operator_handler('backend.operators.builtin.json_map_rename.operator'),
"mongodb_write": operator_handler('backend.operators.builtin.mongodb_write.operator'),
"text_template": operator_handler('backend.operators.builtin.template_render.operator'),
"csv_to_json": operator_handler('backend.operators.builtin.csv_to_json.operator'),
"json_to_csv": operator_handler('backend.operators.builtin.json_to_csv.operator'),
"directory_scan": operator_handler('backend.operators.builtin.directory_scan.operator'),
"diffusion_policy_train": operator_handler('backend.operators.builtin.diffusion_policy_train.operator'),
"xplatform_index": operator_handler('backend.operators.builtin.xplatform_dataset_index.operator'),
"collection_validate": operator_handler('backend.operators.builtin.xplatform_dataset_validate.operator'),
"video_quality": operator_handler('backend.operators.builtin.video_quality.operator'),
"dataset_filter": operator_handler('backend.operators.builtin.video_filter.operator'),
"video_slicing": operator_handler('backend.operators.builtin.video_slice.operator'),
"video_target_clip": operator_handler('backend.operators.builtin.video_target_clip.operator'),
"video_annotation": operator_handler('backend.operators.builtin.video_annotate.operator'),
"result_package": operator_handler('backend.operators.builtin.package.operator'),
"audit_sampling": operator_handler('backend.operators.builtin.audit_sample.operator'),
"hf_dataset_probe": operator_handler('backend.operators.builtin.hf_dataset_probe.operator'),
"agibot_world2026_validate": operator_handler('backend.operators.builtin.agibot_world2026_validate.operator'),
"rlds_episode_summary": operator_handler('backend.operators.builtin.rlds_episode_summary.operator'),
"bridgedata_tfds_manifest_validate": operator_handler('backend.operators.builtin.bridgedata_tfds_manifest_validate.operator'),
"droid_raw_episode_validate": operator_handler('backend.operators.builtin.droid_raw_episode_validate.operator'),
"libero_hdf5_task_validate": operator_handler('backend.operators.builtin.libero_hdf5_task_validate.operator'),
"hdf5_demonstration_summary": operator_handler('backend.operators.builtin.hdf5_demonstration_summary.operator'),
"aloha_hdf5_validate": operator_handler('backend.operators.builtin.aloha_hdf5_validate.operator'),
"robomimic_hdf5_validate": operator_handler('backend.operators.builtin.robomimic_hdf5_validate.operator'),
"robocasa_hdf5_demonstration_validate": operator_handler('backend.operators.builtin.robocasa_hdf5_demonstration_validate.operator'),
"furniturebench_pkl_demonstration_validate": operator_handler('backend.operators.builtin.furniturebench_pkl_demonstration_validate.operator'),
"roboturk_real_hdf5_validate": operator_handler('backend.operators.builtin.roboturk_real_hdf5_validate.operator'),
"roboset_hdf5_validate": operator_handler('backend.operators.builtin.roboset_hdf5_validate.operator'),
"rh20t_scene_validate": operator_handler('backend.operators.builtin.rh20t_scene_validate.operator'),
"robomind_hdf5_quality_validate": operator_handler('backend.operators.builtin.robomind_hdf5_quality_validate.operator'),
"vla_sample_manifest_validate": operator_handler('backend.operators.builtin.vla_sample_manifest_validate.operator'),
"rlbench_dataset_validate": operator_handler('backend.operators.builtin.rlbench_dataset_validate.operator'),
"maniskill_trajectory_validate": operator_handler('backend.operators.builtin.maniskill_trajectory_validate.operator'),
"calvin_episode_validate": operator_handler('backend.operators.builtin.calvin_episode_validate.operator'),
"rtx_action_schema_validate": operator_handler('backend.operators.builtin.rtx_action_schema_validate.operator'),
"embodiment_metadata_validate": operator_handler('backend.operators.builtin.embodiment_metadata_validate.operator'),
"force_torque_sensor_validate": operator_handler('backend.operators.builtin.force_torque_sensor_validate.operator'),
"lerobot_video_alignment_validate": operator_handler('backend.operators.builtin.lerobot_video_alignment_validate.operator'),
"lerobot_v3_episode_index_validate": operator_handler('backend.operators.builtin.lerobot_v3_episode_index_validate.operator'),
"lerobot_dataset_validate": operator_handler('backend.operators.builtin.lerobot_dataset_validate.operator'),
"lerobot_metadata_consistency_validate": operator_handler('backend.operators.builtin.lerobot_metadata_consistency_validate.operator'),
"trajectory_integrity_validate": operator_handler('backend.operators.builtin.trajectory_integrity_validate.operator'),
"action_state_quality_validate": operator_handler('backend.operators.builtin.action_state_quality_validate.operator'),
"episode_boundary_validate": operator_handler('backend.operators.builtin.episode_boundary_validate.operator'),
"joint_limit_validate": operator_handler('backend.operators.builtin.joint_limit_validate.operator'),
"dataset_split_leakage_validate": operator_handler('backend.operators.builtin.dataset_split_leakage_validate.operator'),
"dataset_split_manifest": operator_handler('backend.operators.builtin.dataset_split_manifest.operator'),
"media_reference_validate": operator_handler('backend.operators.builtin.media_reference_validate.operator'),
"dataset_schema_contract_validate": operator_handler('backend.operators.builtin.dataset_schema_contract_validate.operator'),
"mcap_topic_summary": operator_handler('backend.operators.builtin.mcap_topic_summary.operator'),
"tfrecord_structural_validate": operator_handler('backend.operators.builtin.tfrecord_structural_validate.operator'),
"dataset_provenance_audit": operator_handler('backend.operators.builtin.dataset_provenance_audit.operator'),
"graspnet_dataset_validate": operator_handler('backend.operators.builtin.graspnet_dataset_validate.operator'),
"bop_dataset_validate": operator_handler('backend.operators.builtin.bop_dataset_validate.operator'),
"dexycb_dataset_validate": operator_handler('backend.operators.builtin.dexycb_dataset_validate.operator'),
"ho3d_dataset_validate": operator_handler('backend.operators.builtin.ho3d_dataset_validate.operator'),
"wilor_hand_pose": operator_handler('backend.operators.builtin.wilor_hand_pose.operator'),
"hand_removal": operator_handler('backend.operators.builtin.hand_removal.operator'),
"webdataset_shard_summary": operator_handler('backend.operators.builtin.webdataset_shard_summary.operator'),
"umi_zarr_dataset_validate": operator_handler('backend.operators.builtin.umi_zarr_dataset_validate.operator'),
"zarr_trajectory_summary": operator_handler('backend.operators.builtin.zarr_trajectory_summary.operator'),
"camera_calibration_validate": operator_handler('backend.operators.builtin.camera_calibration_validate.operator'),
"tf_transform_tree_validate": operator_handler('backend.operators.builtin.tf_transform_tree_validate.operator'),
"ros_joint_state_validate": operator_handler('backend.operators.builtin.ros_joint_state_validate.operator'),
"hand_object_pose_validate": operator_handler('backend.operators.builtin.hand_object_pose_validate.operator'),
"partnet_mobility_asset_validate": operator_handler('backend.operators.builtin.partnet_mobility_asset_validate.operator'),
"mjcf_actuator_validate": operator_handler('backend.operators.builtin.mjcf_actuator_validate.operator'),
"robot_model_asset_validate": operator_handler('backend.operators.builtin.robot_model_asset_validate.operator'),
"pointcloud_summary": operator_handler('backend.operators.builtin.pointcloud_summary.operator'),
"sensor_timestamp_sync_validate": operator_handler('backend.operators.builtin.sensor_timestamp_sync_validate.operator'),
"parquet_table_summary": operator_handler('backend.operators.builtin.parquet_table_summary.operator'),
"coco_annotation_validate": operator_handler('backend.operators.builtin.coco_annotation_validate.operator'),
"yolo_detection_validate": operator_handler('backend.operators.builtin.yolo_detection_validate.operator'),
"rgbd_frame_pair_validate": operator_handler('backend.operators.builtin.rgbd_frame_pair_validate.operator'),
"segmentation_mask_validate": operator_handler('backend.operators.builtin.segmentation_mask_validate.operator'),
"language_instruction_validate": operator_handler('backend.operators.builtin.language_instruction_validate.operator'),
"condition_router": operator_handler('backend.operators.builtin.conditional_route.operator'),
"human_review": operator_handler('backend.operators.builtin.human_review.operator'),
"builtin_human_review": operator_handler('backend.operators.builtin.human_review.operator'),
"lerobot": operator_handler('backend.operators.builtin.lerobot_summary.operator'),
"rosbag": operator_handler('backend.operators.builtin.rosbag_summary.operator'),
"upload": operator_handler('backend.operators.builtin.upload.operator'),
"holobrain_data_prepare": operator_handler('backend.operators.builtin.holobrain_data_prepare.operator'),
"holobrain_train": operator_handler('backend.operators.builtin.holobrain_train.operator'),
"holobrain_export": operator_handler('backend.operators.builtin.holobrain_export.operator'),
"holobrain_robotwin_eval": operator_handler('backend.operators.builtin.holobrain_robotwin_eval.operator'),
"holobrain_inference_test": operator_handler('backend.operators.builtin.holobrain_inference_test.operator'),
"openvla_finetune": operator_handler('backend.operators.builtin.openvla_finetune.operator'),
"openvla_inference": operator_handler('backend.operators.builtin.openvla_inference.operator'),
"vla_model_train": operator_handler('backend.operators.builtin.vla_model_train.operator'),
"sim3d_asset_generate": operator_handler('backend.operators.builtin.sim3d_asset_generate.operator'),
"vla_model_inference": operator_handler('backend.operators.builtin.vla_model_inference.operator'),
"vla_model_evaluate": operator_handler('backend.operators.builtin.vla_model_evaluate.operator'),
"model_inference": builtin_model_inference,
"yolo_embodied_detection_train": operator_handler('backend.operators.builtin.yolo_embodied_detection_train.operator'),
"yolo_video_target_clip": operator_handler('backend.operators.builtin.yolo_video_target_clip.operator'),
"shell_command": builtin_shell_command,
"generic": builtin_generic_handler,
"builtin_source": operator_handler('real_source'),
"source": operator_handler('real_source'),
"builtin_act_policy_train": operator_handler('act_policy_train'),
"builtin_bos_incremental_scan": operator_handler('bos_incremental_scan'),
"builtin_merge": operator_handler('merge'),
"builtin_intersection": builtin_intersection,
"builtin_distribution": builtin_distribution,
"builtin_json_extract": operator_handler('json_field_extract'),
"builtin_json_filter": operator_handler('json_filter'),
"builtin_json_map": operator_handler('json_map_rename'),
"builtin_mongodb_write": operator_handler('mongodb_write'),
"builtin_text_template": operator_handler('template_render'),
"builtin_csv_to_json": operator_handler('csv_to_json'),
"builtin_json_to_csv": operator_handler('json_to_csv'),
"builtin_directory_scan": operator_handler('directory_scan'),
"builtin_diffusion_policy_train": operator_handler('diffusion_policy_train'),
"builtin_xplatform_index": operator_handler('xplatform_dataset_index'),
"builtin_collection_validate": operator_handler('xplatform_dataset_validate'),
"builtin_video_quality": operator_handler('video_quality'),
"builtin_dataset_filter": operator_handler('video_filter'),
"builtin_video_slicing": operator_handler('video_slice'),
"builtin_video_target_clip": operator_handler('video_target_clip'),
"builtin_video_annotation": operator_handler('video_annotate'),
"builtin_result_package": operator_handler('package'),
"builtin_audit_sampling": operator_handler('audit_sample'),
"builtin_hf_dataset_probe": operator_handler('hf_dataset_probe'),
"builtin_agibot_world2026_validate": operator_handler('agibot_world2026_validate'),
"builtin_rlds_episode_summary": operator_handler('rlds_episode_summary'),
"builtin_bridgedata_tfds_manifest_validate": operator_handler('bridgedata_tfds_manifest_validate'),
"builtin_droid_raw_episode_validate": operator_handler('droid_raw_episode_validate'),
"builtin_libero_hdf5_task_validate": operator_handler('libero_hdf5_task_validate'),
"builtin_hdf5_demonstration_summary": operator_handler('hdf5_demonstration_summary'),
"builtin_aloha_hdf5_validate": operator_handler('aloha_hdf5_validate'),
"builtin_robomimic_hdf5_validate": operator_handler('robomimic_hdf5_validate'),
"builtin_robocasa_hdf5_demonstration_validate": operator_handler('robocasa_hdf5_demonstration_validate'),
"builtin_furniturebench_pkl_demonstration_validate": operator_handler('furniturebench_pkl_demonstration_validate'),
"builtin_roboturk_real_hdf5_validate": operator_handler('roboturk_real_hdf5_validate'),
"builtin_roboset_hdf5_validate": operator_handler('roboset_hdf5_validate'),
"builtin_rh20t_scene_validate": operator_handler('rh20t_scene_validate'),
"builtin_robomind_hdf5_quality_validate": operator_handler('robomind_hdf5_quality_validate'),
"vla_sample_manifest_validate": operator_handler('vla_sample_manifest_validate'),
"builtin_rlbench_dataset_validate": operator_handler('rlbench_dataset_validate'),
"builtin_maniskill_trajectory_validate": operator_handler('maniskill_trajectory_validate'),
"builtin_calvin_episode_validate": operator_handler('calvin_episode_validate'),
"builtin_rtx_action_schema_validate": operator_handler('rtx_action_schema_validate'),
"builtin_embodiment_metadata_validate": operator_handler('embodiment_metadata_validate'),
"builtin_force_torque_sensor_validate": operator_handler('force_torque_sensor_validate'),
"builtin_lerobot_video_alignment_validate": operator_handler('lerobot_video_alignment_validate'),
"builtin_lerobot_v3_episode_index_validate": operator_handler('lerobot_v3_episode_index_validate'),
"builtin_lerobot_dataset_validate": operator_handler('lerobot_dataset_validate'),
"builtin_lerobot_metadata_consistency_validate": operator_handler('lerobot_metadata_consistency_validate'),
"builtin_trajectory_integrity_validate": operator_handler('trajectory_integrity_validate'),
"builtin_action_state_quality_validate": operator_handler('action_state_quality_validate'),
"builtin_episode_boundary_validate": operator_handler('episode_boundary_validate'),
"builtin_joint_limit_validate": operator_handler('joint_limit_validate'),
"builtin_dataset_split_leakage_validate": operator_handler('dataset_split_leakage_validate'),
"builtin_dataset_split_manifest": operator_handler('dataset_split_manifest'),
"builtin_media_reference_validate": operator_handler('media_reference_validate'),
"builtin_dataset_schema_contract_validate": operator_handler('dataset_schema_contract_validate'),
"builtin_mcap_topic_summary": operator_handler('mcap_topic_summary'),
"builtin_tfrecord_structural_validate": operator_handler('tfrecord_structural_validate'),
"builtin_dataset_provenance_audit": operator_handler('dataset_provenance_audit'),
"builtin_graspnet_dataset_validate": operator_handler('graspnet_dataset_validate'),
"builtin_bop_dataset_validate": operator_handler('bop_dataset_validate'),
"builtin_dexycb_dataset_validate": operator_handler('dexycb_dataset_validate'),
"builtin_ho3d_dataset_validate": operator_handler('ho3d_dataset_validate'),
"builtin_wilor_hand_pose": operator_handler('wilor_hand_pose'),
"builtin_hand_removal": operator_handler('hand_removal'),
"builtin_webdataset_shard_summary": operator_handler('webdataset_shard_summary'),
"builtin_umi_zarr_dataset_validate": operator_handler('umi_zarr_dataset_validate'),
"builtin_zarr_trajectory_summary": operator_handler('zarr_trajectory_summary'),
"builtin_camera_calibration_validate": operator_handler('camera_calibration_validate'),
"builtin_tf_transform_tree_validate": operator_handler('tf_transform_tree_validate'),
"builtin_ros_joint_state_validate": operator_handler('ros_joint_state_validate'),
"builtin_hand_object_pose_validate": operator_handler('hand_object_pose_validate'),
"builtin_partnet_mobility_asset_validate": operator_handler('partnet_mobility_asset_validate'),
"builtin_mjcf_actuator_validate": operator_handler('mjcf_actuator_validate'),
"builtin_robot_model_asset_validate": operator_handler('robot_model_asset_validate'),
"builtin_pointcloud_summary": operator_handler('pointcloud_summary'),
"builtin_sensor_timestamp_sync_validate": operator_handler('sensor_timestamp_sync_validate'),
"builtin_parquet_table_summary": operator_handler('parquet_table_summary'),
"builtin_coco_annotation_validate": operator_handler('coco_annotation_validate'),
"builtin_yolo_detection_validate": operator_handler('yolo_detection_validate'),
"builtin_rgbd_frame_pair_validate": operator_handler('rgbd_frame_pair_validate'),
"builtin_segmentation_mask_validate": operator_handler('segmentation_mask_validate'),
"builtin_language_instruction_validate": operator_handler('language_instruction_validate'),
"builtin_condition_router": operator_handler('conditional_route'),
"builtin_human_review": operator_handler('human_review'),
"lerobot": operator_handler('lerobot_summary'),
"rosbag": operator_handler('rosbag_summary'),
"builtin_upload": operator_handler('upload'),
"builtin_holobrain_data_prepare": operator_handler('holobrain_data_prepare'),
"builtin_holobrain_train": operator_handler('holobrain_train'),
"builtin_holobrain_export": operator_handler('holobrain_export'),
"builtin_holobrain_robotwin_eval": operator_handler('holobrain_robotwin_eval'),
"builtin_holobrain_inference_test": operator_handler('holobrain_inference_test'),
"builtin_openvla_finetune": operator_handler('openvla_finetune'),
"builtin_openvla_inference": operator_handler('openvla_inference'),
"vla_model_train": operator_handler('vla_model_train'),
"sim3d_asset_generate": operator_handler('sim3d_asset_generate'),
"vla_model_inference": operator_handler('vla_model_inference'),
"vla_model_evaluate": operator_handler('vla_model_evaluate'),
"builtin_model_inference": builtin_model_inference,
"builtin_yolo_embodied_detection_train": operator_handler('yolo_embodied_detection_train'),
"builtin_yolo_video_target_clip": operator_handler('yolo_video_target_clip'),
"builtin_shell_command": builtin_shell_command,
"builtin_generic": builtin_generic_handler,
}
for _handler_name, _handler in tuple(BUILTIN_HANDLERS.items()):
if _handler_name != "generic":
BUILTIN_HANDLERS.setdefault(f"builtin_{_handler_name}", _handler)
BUILTIN_HANDLERS.setdefault("builtin_lerobot_summary", BUILTIN_HANDLERS["lerobot"])
BUILTIN_HANDLERS.setdefault("builtin_rosbag_summary", BUILTIN_HANDLERS["rosbag"])
def select_handler(node_label: str) -> str:
normalized = node_label.lower()
for handler, tokens in BUILTIN_HANDLER_RULES:
if any(token in normalized for token in tokens):
return handler
return "generic"
def runtime_handler_override() -> str:
def runtime_handler() -> str:
handler = os.getenv("DROBOTICFLOW_OPERATOR_HANDLER", "").strip()
if not handler:
return ""
raise RuntimeError("DROBOTICFLOW_OPERATOR_HANDLER is required; label-based dispatch is not supported")
if handler not in BUILTIN_HANDLERS:
known = ", ".join(sorted(BUILTIN_HANDLERS))
raise RuntimeError(f"DROBOTICFLOW_OPERATOR_HANDLER={handler!r} is not registered; known handlers: {known}")
@ -5448,10 +5316,10 @@ def main() -> int:
append_log("INFO", "Executing explicit command")
artifacts = execute_command(run_id, node_id, output_dir, node_data, command)
else:
handler = runtime_handler_override() or select_handler(node_label)
handler = runtime_handler()
append_log("INFO", f"Selected built-in handler: {handler}")
builtin_handler = BUILTIN_HANDLERS.get(handler, BUILTIN_HANDLERS["generic"])
if handler == "generic":
builtin_handler = BUILTIN_HANDLERS[handler]
if handler == "builtin_generic":
artifacts = builtin_handler(run_id, node_id, output_dir, node_label, node_data, inputs)
else:
artifacts = builtin_handler(run_id, node_id, output_dir, node_data, inputs)

View File

@ -332,65 +332,23 @@ class SourcePathFromItemTests(unittest.TestCase):
class RuntimeFileContractTests(unittest.TestCase):
def test_select_handler_prefers_specific_operator_routes(self):
self.assertEqual(MODULE.select_handler("BOS 增量扫描"), "bos_incremental_scan")
self.assertEqual(MODULE.select_handler("人工审核"), "human_review")
self.assertEqual(MODULE.select_handler("ALOHA HDF5 示教校验"), "aloha_hdf5_validate")
self.assertEqual(MODULE.select_handler("robomimic HDF5 示教校验"), "robomimic_hdf5_validate")
self.assertEqual(MODULE.select_handler("VLA 样本清单校验"), "vla_sample_manifest_validate")
self.assertEqual(MODULE.select_handler("ACT 策略训练"), "act_policy_train")
self.assertEqual(MODULE.select_handler("Diffusion Policy 训练"), "diffusion_policy_train")
self.assertEqual(MODULE.select_handler("HoloBrain 数据准备"), "holobrain_data_prepare")
self.assertEqual(MODULE.select_handler("HoloBrain 完整训练"), "holobrain_train")
self.assertEqual(MODULE.select_handler("HoloBrain 模型导出"), "holobrain_export")
self.assertEqual(MODULE.select_handler("HoloBrain RoboTwin 评测"), "holobrain_robotwin_eval")
self.assertEqual(MODULE.select_handler("HoloBrain 模型测试"), "holobrain_inference_test")
self.assertEqual(MODULE.select_handler("OpenVLA 微调训练"), "openvla_finetune")
self.assertEqual(MODULE.select_handler("OpenVLA 推理"), "openvla_inference")
self.assertEqual(MODULE.select_handler("YOLO 具身目标检测训练"), "yolo_embodied_detection_train")
self.assertEqual(MODULE.select_handler("YOLO 视频目标检测裁剪"), "yolo_video_target_clip")
self.assertEqual(MODULE.select_handler("URDF 关节限位校验"), "joint_limit_validate")
self.assertEqual(MODULE.select_handler("MJCF 执行器校验"), "mjcf_actuator_validate")
self.assertEqual(MODULE.select_handler("TF 坐标树校验"), "tf_transform_tree_validate")
self.assertEqual(MODULE.select_handler("LeRobot 视频对齐校验"), "lerobot_video_alignment_validate")
self.assertEqual(MODULE.select_handler("ROS JointState 校验"), "ros_joint_state_validate")
self.assertEqual(MODULE.select_handler("GraspNet 抓取数据集校验"), "graspnet_dataset_validate")
self.assertEqual(MODULE.select_handler("BOP 6D姿态数据集校验"), "bop_dataset_validate")
self.assertEqual(MODULE.select_handler("DexYCB 数据集校验"), "dexycb_dataset_validate")
self.assertEqual(MODULE.select_handler("HO3D/H2O3D 数据集校验"), "ho3d_dataset_validate")
self.assertEqual(MODULE.select_handler("WiLoR 3D手部姿态估计"), "wilor_hand_pose")
self.assertEqual(MODULE.select_handler("Hand Removal 视频去手"), "hand_removal")
self.assertEqual(MODULE.select_handler("手-物体姿态标注校验"), "hand_object_pose_validate")
self.assertEqual(MODULE.select_handler("PartNet-Mobility 资产校验"), "partnet_mobility_asset_validate")
self.assertEqual(MODULE.select_handler("RLBench 数据集校验"), "rlbench_dataset_validate")
self.assertEqual(MODULE.select_handler("ManiSkill 轨迹校验"), "maniskill_trajectory_validate")
self.assertEqual(MODULE.select_handler("CALVIN Episode 校验"), "calvin_episode_validate")
self.assertEqual(MODULE.select_handler("RT-X动作空间Schema校验"), "rtx_action_schema_validate")
self.assertEqual(MODULE.select_handler("多机器人Embodiment元信息校验"), "embodiment_metadata_validate")
self.assertEqual(MODULE.select_handler("力扭矩传感器数据校验"), "force_torque_sensor_validate")
self.assertEqual(MODULE.select_handler("AgiBotWorld2026 数据集校验"), "agibot_world2026_validate")
self.assertEqual(MODULE.select_handler("BridgeData TFDS-RLDS清单校验"), "bridgedata_tfds_manifest_validate")
self.assertEqual(MODULE.select_handler("DROID Raw Episode校验"), "droid_raw_episode_validate")
self.assertEqual(MODULE.select_handler("LIBERO HDF5任务校验"), "libero_hdf5_task_validate")
self.assertEqual(MODULE.select_handler("RoboCasa HDF5示教校验"), "robocasa_hdf5_demonstration_validate")
self.assertEqual(MODULE.select_handler("FurnitureBench PKL示教校验"), "furniturebench_pkl_demonstration_validate")
self.assertEqual(MODULE.select_handler("RoboTurk Real HDF5校验"), "roboturk_real_hdf5_validate")
self.assertEqual(MODULE.select_handler("RoboSet HDF5轨迹校验"), "roboset_hdf5_validate")
self.assertEqual(MODULE.select_handler("RH20T 场景结构校验"), "rh20t_scene_validate")
self.assertEqual(MODULE.select_handler("RoboMIND HDF5质量校验"), "robomind_hdf5_quality_validate")
self.assertEqual(MODULE.select_handler("UMI Zarr数据集校验"), "umi_zarr_dataset_validate")
self.assertEqual(MODULE.select_handler("LeRobot v3 Episode索引校验"), "lerobot_v3_episode_index_validate")
self.assertEqual(MODULE.select_handler("数据集切分泄漏校验"), "dataset_split_leakage_validate")
self.assertEqual(MODULE.select_handler("媒体引用可读性校验"), "media_reference_validate")
self.assertEqual(MODULE.select_handler("数据集Schema合约校验"), "dataset_schema_contract_validate")
def test_dispatch_requires_explicit_current_handler(self):
with mock.patch.dict(os.environ, {"DROBOTICFLOW_OPERATOR_HANDLER": ""}):
with self.assertRaisesRegex(RuntimeError, "is required"):
MODULE.runtime_handler()
with mock.patch.dict(os.environ, {"DROBOTICFLOW_OPERATOR_HANDLER": "undeclared-handler"}):
with self.assertRaisesRegex(RuntimeError, "is not registered"):
MODULE.runtime_handler()
with mock.patch.dict(os.environ, {"DROBOTICFLOW_OPERATOR_HANDLER": "builtin_source"}):
self.assertEqual(MODULE.runtime_handler(), "builtin_source")
def test_builtin_handler_aliases_match_runtime_contract_names(self):
self.assertIs(MODULE.BUILTIN_HANDLERS["builtin_lerobot"], MODULE.BUILTIN_HANDLERS["lerobot"])
self.assertIs(MODULE.BUILTIN_HANDLERS["builtin_lerobot_summary"], MODULE.BUILTIN_HANDLERS["lerobot"])
self.assertIs(
MODULE.BUILTIN_HANDLERS["builtin_action_state_quality_validate"],
MODULE.BUILTIN_HANDLERS["action_state_quality_validate"],
)
def test_registry_uses_only_current_catalog_handler_names(self):
catalog = json.loads((MODULE.PROJECT_ROOT / "internal" / "api" / "builtin_operators_catalog.json").read_text())
for item in catalog:
if item.get("type") == "builtin":
self.assertIn(item["runtimeHandler"], MODULE.BUILTIN_HANDLERS)
self.assertNotIn("csv_to_json", MODULE.BUILTIN_HANDLERS)
self.assertNotIn("builtin_lerobot", MODULE.BUILTIN_HANDLERS)
def test_operator_helpers_do_not_expose_legacy_builtin_handlers(self):
legacy_keys = sorted(key for key in MODULE.OPERATOR_HELPERS if key.startswith("builtin_"))
@ -409,7 +367,7 @@ class RuntimeFileContractTests(unittest.TestCase):
"outputs": [{"id": "out-1", "name": "table", "type": "json"}],
}
artifacts = MODULE.BUILTIN_HANDLERS["csv_to_json"]("run-1", "csv", output_dir, node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_csv_to_json"]("run-1", "csv", output_dir, node_data, [])
payload = json.loads(pathlib.Path(artifacts[0]["path"]).read_text(encoding="utf-8"))
self.assertEqual(payload["columns"], ["id", "name", "score"])
@ -427,7 +385,7 @@ class RuntimeFileContractTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["json_filter"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_json_filter"](
"run-1",
"filter",
output_dir,
@ -533,6 +491,7 @@ class RuntimeFileContractTests(unittest.TestCase):
"WORKFLOW_ID": "wf-1",
"NODE_ID": "node-1",
"NODE_LABEL": "通用处理",
"DROBOTICFLOW_OPERATOR_HANDLER": "builtin_generic",
"OUTPUT_DIR": str(output_dir),
"NODE_DATA_JSON": '{"label":"通用处理","hyperparams":[]}',
"INPUT_ARTIFACTS_PATH": str(input_artifacts_path),
@ -1048,7 +1007,7 @@ class SourceOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["source"]("run-test", "source-json-payload", output_dir, node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_source"]("run-test", "source-json-payload", output_dir, node_data, [])
payload_artifact = next(item for item in artifacts if item["name"] == "payload.json")
payload = json.loads(pathlib.Path(payload_artifact["path"]).read_text(encoding="utf-8"))
@ -1080,7 +1039,7 @@ class SourceOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["source"]("run-test", "source-json-list-payload", output_dir, node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_source"]("run-test", "source-json-list-payload", output_dir, node_data, [])
payload_artifact = next(item for item in artifacts if item["name"] == "payload.json")
payload = json.loads(pathlib.Path(payload_artifact["path"]).read_text(encoding="utf-8"))
@ -1104,7 +1063,7 @@ class SourceOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["source"]("run-test", "source-csv-payload", output_dir, node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_source"]("run-test", "source-csv-payload", output_dir, node_data, [])
csv_artifact = next(item for item in artifacts if item["name"] == "report.csv")
self.assertEqual(csv_artifact["portId"], "csv")
@ -1128,7 +1087,7 @@ class SourceOperatorTests(unittest.TestCase):
}
with self.assertRaisesRegex(RuntimeError, "OUTPUT_NAME"):
MODULE.BUILTIN_HANDLERS["source"]("run-test", "source-unsafe-payload", output_dir, node_data, [])
MODULE.BUILTIN_HANDLERS["builtin_source"]("run-test", "source-unsafe-payload", output_dir, node_data, [])
def test_builtin_source_prefers_source_json_over_bos_env(self):
with tempfile.TemporaryDirectory() as temp_dir:
@ -2651,8 +2610,9 @@ class XPlatformClipHandoffTests(unittest.TestCase):
self.assertEqual(manifest_payload["items"][0]["clipPath"], str(shared_clip_path))
self.assertFalse(any(item["name"] == "clip001.mp4" for item in artifacts))
def test_select_handler_routes_video_target_clip(self):
self.assertEqual(MODULE.select_handler("视频目标检测裁剪"), "video_target_clip")
def test_video_target_clip_has_explicit_handler(self):
with mock.patch.dict(os.environ, {"DROBOTICFLOW_OPERATOR_HANDLER": "builtin_yolo_video_target_clip"}):
self.assertEqual(MODULE.runtime_handler(), "builtin_yolo_video_target_clip")
def test_video_target_clip_detects_motion_and_writes_real_clip(self):
try:
@ -2712,7 +2672,7 @@ class XPlatformClipHandoffTests(unittest.TestCase):
original_ffmpeg_available = MODULE.OPERATOR_HELPERS["ffmpeg_available"]
MODULE.OPERATOR_HELPERS["ffmpeg_available"] = lambda: False
try:
artifacts = MODULE.BUILTIN_HANDLERS["video_target_clip"]("run-1", "target", output_dir, node_data, inputs)
artifacts = MODULE.BUILTIN_HANDLERS["builtin_video_target_clip"]("run-1", "target", output_dir, node_data, inputs)
finally:
MODULE.OPERATOR_HELPERS["ffmpeg_available"] = original_ffmpeg_available
@ -3618,8 +3578,8 @@ class ShellCommandOperatorTests(unittest.TestCase):
def test_fixture_report_counts_direct_and_grouped_upstream_artifacts(self):
script_path = (
pathlib.Path(__file__).resolve().parents[1]
/ "operators"
pathlib.Path(__file__).resolve().parents[2]
/ "operator-repos"
/ "builtin"
/ "shell_command"
/ "approved_scripts"
@ -3737,7 +3697,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["hf_dataset_probe"]("run-1", "hf", output_dir, node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_hf_dataset_probe"]("run-1", "hf", output_dir, node_data, [])
self.assertEqual([item["path"] for item in requests], ["/is-valid", "/splits", "/size", "/parquet", "/rows"])
payload = MODULE.load_artifact_payload(artifacts[0])
@ -3749,7 +3709,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
self.assertEqual(payload["parquetFileCount"], 1)
def test_hf_dataset_probe_retries_incomplete_read(self):
operator_module = MODULE.load_operator_module("backend.operators.builtin.hf_dataset_probe.operator")
operator_module = MODULE.load_operator_module("hf_dataset_probe")
payload = json.dumps({"valid": True}).encode("utf-8")
responses = [http.client.IncompleteRead(b"", 100), _FakeHTTPResponse(payload)]
@ -3812,7 +3772,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
episodes_path.write_text("\n".join(json.dumps(item) for item in episodes), encoding="utf-8")
node_data = {"label": "RLDS 轨迹概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["rlds_episode_summary"]("run-1", "rlds", pathlib.Path(temp_dir) / "out", node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_rlds_episode_summary"]("run-1", "rlds", pathlib.Path(temp_dir) / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "rlds")
@ -3887,7 +3847,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(video / "episode_000001.mp4").write_bytes(b"real-mp4-bytes-1")
node_data = {"label": "AgiBotWorld2026 数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["agibot_world2026_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_agibot_world2026_validate"](
"run-1", "agibot", root / "out", node_data, []
)
@ -3933,7 +3893,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(recordings / "camera_0.mp4").write_bytes(b"\x00\x00\x00\x18ftypmp42real-droid-video")
node_data = {"label": "DROID Raw Episode校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["droid_raw_episode_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_droid_raw_episode_validate"](
"run-1", "droid", root / "out", node_data, []
)
@ -3997,7 +3957,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["libero_hdf5_task_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_libero_hdf5_task_validate"](
"run-1", "libero", root / "out", node_data, []
)
@ -4050,7 +4010,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
mask.create_dataset("train", data=np.array([b"demo_0"]))
node_data = {"label": "RoboCasa HDF5示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["robocasa_hdf5_demonstration_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_robocasa_hdf5_demonstration_validate"](
"run-1", "robocasa", root / "out", node_data, []
)
@ -4111,7 +4071,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
pickle.dump(demo, handle)
node_data = {"label": "FurnitureBench PKL示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path.parents[2])}]}
artifacts = MODULE.BUILTIN_HANDLERS["furniturebench_pkl_demonstration_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_furniturebench_pkl_demonstration_validate"](
"run-1", "furniturebench", path.parents[2] / "out", node_data, []
)
@ -4166,7 +4126,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
user_control.create_dataset("user_control_times", data=np.array([1.0, 2.0, 3.0], dtype=np.float64))
node_data = {"label": "RoboTurk Real HDF5校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["roboturk_real_hdf5_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_roboturk_real_hdf5_validate"](
"run-1", "roboturk-real", root / "out", node_data, []
)
@ -4228,7 +4188,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["roboset_hdf5_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_roboset_hdf5_validate"](
"run-1", "roboset", root / "out", node_data, []
)
@ -4286,7 +4246,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
np.save(calib / "tcp.npy", np.ones((4, 4), dtype=np.float32))
node_data = {"label": "RH20T 场景结构校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["rh20t_scene_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_rh20t_scene_validate"](
"run-1", "rh20t", root / "out", node_data, []
)
@ -4360,7 +4320,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
}
artifacts = MODULE.BUILTIN_HANDLERS["robomind_hdf5_quality_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_robomind_hdf5_quality_validate"](
"run-1", "robomind", root / "out", node_data, []
)
@ -4413,7 +4373,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
mask.create_dataset("train", data=np.array([b"demo_1"]))
node_data = {"label": "HDF5 示教数据概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["hdf5_demonstration_summary"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_hdf5_demonstration_summary"](
"run-1", "hdf5", pathlib.Path(temp_dir) / "out", node_data, []
)
@ -4444,7 +4404,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
handle.create_dataset("action", data=np.ones((3, 14), dtype="float32"))
node_data = {"label": "ALOHA HDF5 示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["aloha_hdf5_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_aloha_hdf5_validate"](
"run-1", "aloha", pathlib.Path(temp_dir) / "out", node_data, []
)
@ -4494,7 +4454,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
mask.create_dataset("valid", data=np.array([b"demo_2"]))
node_data = {"label": "robomimic HDF5 示教校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["robomimic_hdf5_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_robomimic_hdf5_validate"](
"run-1", "robomimic", pathlib.Path(temp_dir) / "out", node_data, []
)
@ -4529,7 +4489,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
pickle.dump(["pick up the cup"], handle)
node_data = {"label": "RLBench 数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["rlbench_dataset_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_rlbench_dataset_validate"](
"run-1", "rlbench", root / "out", node_data, []
)
@ -4567,7 +4527,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "ManiSkill 轨迹校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["maniskill_trajectory_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_maniskill_trajectory_validate"](
"run-1", "maniskill", root / "out", node_data, []
)
@ -4604,7 +4564,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "CALVIN Episode 校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["calvin_episode_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_calvin_episode_validate"](
"run-1", "calvin", root / "out", node_data, []
)
@ -4638,7 +4598,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "RT-X动作空间Schema校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["rtx_action_schema_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_rtx_action_schema_validate"](
"run-1", "rtx-action", root / "out", node_data, []
)
@ -4678,7 +4638,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["embodiment_metadata_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_embodiment_metadata_validate"](
"run-1", "embodiment", root / "out", node_data, []
)
@ -4706,7 +4666,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "力扭矩传感器数据校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["force_torque_sensor_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_force_torque_sensor_validate"](
"run-1", "force", root / "out", node_data, []
)
@ -4737,7 +4697,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "数据集切分泄漏校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["dataset_split_leakage_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_split_leakage_validate"](
"run-1", "split-leakage", root / "out", node_data, []
)
@ -4782,7 +4742,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "媒体引用可读性校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["media_reference_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_media_reference_validate"](
"run-1", "media", root / "out", node_data, []
)
@ -4830,7 +4790,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["dataset_schema_contract_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_schema_contract_validate"](
"run-1", "schema", root / "out", node_data, []
)
@ -4885,7 +4845,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "LeRobot 数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["lerobot_dataset_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_lerobot_dataset_validate"](
"run-1", "lerobot-validate", pathlib.Path(temp_dir) / "out", node_data, []
)
@ -4962,7 +4922,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
}
artifacts = MODULE.BUILTIN_HANDLERS["lerobot_metadata_consistency_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_lerobot_metadata_consistency_validate"](
"run-1", "lerobot-meta", root / "out", node_data, []
)
@ -5035,7 +4995,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
}
artifacts = MODULE.BUILTIN_HANDLERS["lerobot_v3_episode_index_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_lerobot_v3_episode_index_validate"](
"run-1", "lerobot-v3-index", root / "out", node_data, []
)
@ -5111,7 +5071,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "LeRobot 视频对齐校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["lerobot_video_alignment_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_lerobot_video_alignment_validate"](
"run-1", "lerobot-video", root / "out", node_data, []
)
@ -5154,7 +5114,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
}
artifacts = MODULE.BUILTIN_HANDLERS["trajectory_integrity_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_trajectory_integrity_validate"](
"run-1", "trajectory", pathlib.Path(temp_dir) / "out", node_data, []
)
@ -5198,7 +5158,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
}
artifacts = MODULE.BUILTIN_HANDLERS["action_state_quality_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_action_state_quality_validate"](
"run-1", "action-state", root / "out", node_data, []
)
@ -5239,7 +5199,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "Episode 边界校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["episode_boundary_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_episode_boundary_validate"](
"run-1", "episode-boundary", root / "out", node_data, []
)
@ -5319,7 +5279,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["dataset_split_manifest"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_split_manifest"](
"run-1", "split", pathlib.Path(temp_dir) / "out", node_data, []
)
@ -5332,6 +5292,61 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
self.assertTrue(csv_path.exists())
self.assertEqual(artifacts[1]["name"], "dataset-split-manifest.csv")
def test_dataset_split_manifest_keeps_lerobot_episode_index_zero(self):
with tempfile.TemporaryDirectory() as temp_dir:
root = pathlib.Path(temp_dir) / "lerobot"
(root / "meta").mkdir(parents=True)
(root / "meta" / "episodes.jsonl").write_text(
"\n".join(json.dumps({"episode_index": index, "tasks": ["pick"], "length": 100 + index}) for index in range(3)),
encoding="utf-8",
)
node_data = {
"label": "训练切分清单生成",
"hyperparams": [
{"key": "SOURCE_PATH", "value": str(root)},
{"key": "TRAIN_RATIO", "value": "1"},
{"key": "VAL_RATIO", "value": "0"},
{"key": "TEST_RATIO", "value": "0"},
],
}
artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_split_manifest"](
"run-1", "split", pathlib.Path(temp_dir) / "out", node_data, []
)
payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["episodeCount"], 3)
self.assertEqual(sorted(item["episodeId"] for item in payload["items"]), ["0", "1", "2"])
def test_dataset_split_leakage_validate_reads_upstream_split_manifest(self):
with tempfile.TemporaryDirectory() as temp_dir:
root = pathlib.Path(temp_dir) / "lerobot"
(root / "meta").mkdir(parents=True)
(root / "meta" / "episodes.jsonl").write_text(
"\n".join(json.dumps({"episode_index": index, "tasks": ["pick"], "length": 100}) for index in range(12)),
encoding="utf-8",
)
split_node = {"label": "训练切分清单生成", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
split_artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_split_manifest"](
"run-1", "split", pathlib.Path(temp_dir) / "split", split_node, []
)
leakage_node = {"label": "数据集切分泄漏校验", "hyperparams": [{"key": "REQUIRED_SPLITS", "value": "train"}]}
# The split manifest records the episodes file as its sourcePath; the validator must
# read the manifest itself, not the unsplit episodes it was generated from.
artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_split_leakage_validate"](
"run-1", "leakage", pathlib.Path(temp_dir) / "leakage", leakage_node, split_artifacts
)
payload = MODULE.load_artifact_payload(artifacts[0])
split_payload = MODULE.load_artifact_payload(split_artifacts[0])
self.assertEqual(payload["episodeCount"], 12)
self.assertEqual(
payload["splitCounts"],
{name: count for name, count in split_payload["splitCounts"].items() if count},
)
self.assertNotIn("missing_split", [issue["code"] for issue in payload["issues"]])
def test_mcap_topic_summary_reads_real_mcap_messages(self):
try:
from mcap.writer import Writer # type: ignore
@ -5359,7 +5374,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
writer.finish()
node_data = {"label": "MCAP 主题概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["mcap_topic_summary"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_mcap_topic_summary"](
"run-1", "mcap", pathlib.Path(temp_dir) / "out", node_data, []
)
@ -5376,9 +5391,9 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
length_bytes = struct.pack("<Q", len(payload))
return (
length_bytes
+ struct.pack("<I", MODULE.tfrecord_structural_validate_operator._masked_crc32c(length_bytes))
+ struct.pack("<I", MODULE.load_operator_module("tfrecord_structural_validate")._masked_crc32c(length_bytes))
+ payload
+ struct.pack("<I", MODULE.tfrecord_structural_validate_operator._masked_crc32c(payload))
+ struct.pack("<I", MODULE.load_operator_module("tfrecord_structural_validate")._masked_crc32c(payload))
)
with tempfile.TemporaryDirectory() as temp_dir:
@ -5389,7 +5404,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "TFRecord 结构校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["tfrecord_structural_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_tfrecord_structural_validate"](
"run-1", "tfrecord", pathlib.Path(temp_dir) / "out", node_data, []
)
@ -5406,9 +5421,9 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
length_bytes = struct.pack("<Q", len(payload))
return (
length_bytes
+ struct.pack("<I", MODULE.bridgedata_tfds_manifest_validate_operator._masked_crc32c(length_bytes))
+ struct.pack("<I", MODULE.load_operator_module("bridgedata_tfds_manifest_validate")._masked_crc32c(length_bytes))
+ payload
+ struct.pack("<I", MODULE.bridgedata_tfds_manifest_validate_operator._masked_crc32c(payload))
+ struct.pack("<I", MODULE.load_operator_module("bridgedata_tfds_manifest_validate")._masked_crc32c(payload))
)
with tempfile.TemporaryDirectory() as temp_dir:
@ -5444,7 +5459,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
}
artifacts = MODULE.BUILTIN_HANDLERS["bridgedata_tfds_manifest_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_bridgedata_tfds_manifest_validate"](
"run-1", "bridge", root / "out", node_data, []
)
@ -5479,7 +5494,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "数据集来源许可审计", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["dataset_provenance_audit"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_dataset_provenance_audit"](
"run-1", "provenance", pathlib.Path(temp_dir) / "out", node_data, []
)
@ -5507,7 +5522,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
archive.addfile(info, io.BytesIO(payload))
node_data = {"label": "WebDataset 分片概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(shard_path)}]}
artifacts = MODULE.BUILTIN_HANDLERS["webdataset_shard_summary"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_webdataset_shard_summary"](
"run-1", "webdataset", root / "out", node_data, []
)
@ -5555,7 +5570,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(array_path / "0").write_bytes(b"chunk-bytes")
node_data = {"label": "Zarr 轨迹数组概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["zarr_trajectory_summary"]("run-1", "zarr", root / "out", node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_zarr_trajectory_summary"]("run-1", "zarr", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "zarr-trajectory-summary")
@ -5589,7 +5604,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
create_array(meta, "episode_ends", np.array([2, 5], dtype=np.int64), chunks=(2,))
node_data = {"label": "UMI Zarr数据集校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root.parent)}]}
artifacts = MODULE.BUILTIN_HANDLERS["umi_zarr_dataset_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_umi_zarr_dataset_validate"](
"run-1", "umi-zarr", root / "out", node_data, []
)
@ -5623,7 +5638,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "相机标定校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["camera_calibration_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_camera_calibration_validate"](
"run-1", "calibration", root / "out", node_data, []
)
@ -5653,7 +5668,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "机器人模型资产校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(package)}]}
artifacts = MODULE.BUILTIN_HANDLERS["robot_model_asset_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_robot_model_asset_validate"](
"run-1", "robot-model", package / "out", node_data, []
)
@ -5724,7 +5739,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["partnet_mobility_asset_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_partnet_mobility_asset_validate"](
"run-1", "partnet", root / "out", node_data, []
)
@ -5773,7 +5788,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "MJCF 执行器校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["mjcf_actuator_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_mjcf_actuator_validate"](
"run-1", "mjcf-actuator", root / "out", node_data, []
)
@ -5812,7 +5827,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(root / "transforms.jsonl").write_text("\n".join(json.dumps(row) for row in rows), encoding="utf-8")
node_data = {"label": "TF 坐标树校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["tf_transform_tree_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_tf_transform_tree_validate"](
"run-1", "tf-tree", root / "out", node_data, []
)
@ -5848,7 +5863,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(root / "joint_states.jsonl").write_text("\n".join(json.dumps(row) for row in rows), encoding="utf-8")
node_data = {"label": "ROS JointState 校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["ros_joint_state_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_ros_joint_state_validate"](
"run-1", "joint-state", root / "out", node_data, []
)
@ -5897,7 +5912,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}],
}
artifacts = MODULE.BUILTIN_HANDLERS["dexycb_dataset_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_dexycb_dataset_validate"](
"run-1", "dexycb", root / "out", node_data, []
)
@ -5996,7 +6011,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["bop_dataset_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_bop_dataset_validate"](
"run-1", "bop", root / "out", node_data, []
)
@ -6073,7 +6088,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["graspnet_dataset_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_graspnet_dataset_validate"](
"run-1", "graspnet", root / "out", node_data, []
)
@ -6149,7 +6164,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["ho3d_dataset_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_ho3d_dataset_validate"](
"run-1", "ho3d", root / "out", node_data, []
)
@ -6229,7 +6244,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["hand_object_pose_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_hand_object_pose_validate"](
"run-1", "hand-object", root / "out", node_data, []
)
@ -6245,7 +6260,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
self.assertEqual(payload["missingMaskCount"], 0)
def test_hand_removal_consumes_sam_mask_and_calls_propainter(self):
hand_removal_module = MODULE.load_operator_module("backend.operators.builtin.hand_removal.operator")
hand_removal_module = MODULE.load_operator_module("hand_removal")
health = {"status": "ok", "model": "ProPainter", "device": "cuda"}
result = {"status": "success", "outputVideoUrl": "/api/media/clean.mp4", "frameCount": 12}
calls: list[str] = []
@ -6286,7 +6301,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
{"name": "sam3-hand-mask.mp4", "type": "file", "path": str(mask_path), "portId": "in-mask"},
]
with mock.patch.object(hand_removal_module.request, "urlopen", side_effect=fake_urlopen):
artifacts = MODULE.BUILTIN_HANDLERS["hand_removal"]("run-1", "remove-hands", output_dir, node_data, inputs)
artifacts = MODULE.BUILTIN_HANDLERS["builtin_hand_removal"]("run-1", "remove-hands", output_dir, node_data, inputs)
names = {artifact["name"] for artifact in artifacts}
self.assertEqual(names, {"hand-removal-result.json", "hand-removed.mp4"})
@ -6298,7 +6313,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
self.assertIn("http://propainter.example/api/inpaint/video", calls)
def test_wilor_hand_pose_calls_service_and_downloads_outputs(self):
wilor_module = MODULE.load_operator_module("backend.operators.builtin.wilor_hand_pose.operator")
wilor_module = MODULE.load_operator_module("wilor_hand_pose")
health = {
"status": "ok",
"model": {
@ -6360,7 +6375,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
with mock.patch.object(wilor_module.request, "urlopen", side_effect=fake_urlopen):
artifacts = MODULE.BUILTIN_HANDLERS["wilor_hand_pose"]("run-1", "wilor", output_dir, node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_wilor_hand_pose"]("run-1", "wilor", output_dir, node_data, [])
names = {artifact["name"] for artifact in artifacts}
self.assertEqual(
@ -6378,7 +6393,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
self.assertIn("http://wilor.example/api/infer", calls)
def test_wilor_hand_pose_prefers_upstream_media_file_over_source_manifest(self):
wilor_module = MODULE.load_operator_module("backend.operators.builtin.wilor_hand_pose.operator")
wilor_module = MODULE.load_operator_module("wilor_hand_pose")
self.assertEqual(
wilor_module._first_media_ref_from_payload(
{"entries": [{"value": {"url": "http://wilor.example/examples/from-manifest.png"}}]}
@ -6452,7 +6467,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
{"name": "sample-hands.png", "type": "image", "path": str(image_path), "portId": "out-1"},
]
with mock.patch.object(wilor_module.request, "urlopen", side_effect=fake_urlopen):
artifacts = MODULE.BUILTIN_HANDLERS["wilor_hand_pose"]("run-1", "wilor", output_dir, node_data, inputs)
artifacts = MODULE.BUILTIN_HANDLERS["builtin_wilor_hand_pose"]("run-1", "wilor", output_dir, node_data, inputs)
payload = MODULE.load_artifact_payload(next(item for item in artifacts if item["name"] == "wilor-result.json"))
self.assertEqual(payload["status"], "success")
@ -6497,7 +6512,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "URDF 关节限位校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["joint_limit_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_joint_limit_validate"](
"run-1", "joint-limit", root / "out", node_data, []
)
@ -6544,7 +6559,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "点云数据概览", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["pointcloud_summary"]("run-1", "pointcloud", root / "out", node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_pointcloud_summary"]("run-1", "pointcloud", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "pointcloud-summary")
@ -6578,7 +6593,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["sensor_timestamp_sync_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_sensor_timestamp_sync_validate"](
"run-1", "timestamp-sync", root / "out", node_data, []
)
@ -6615,7 +6630,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
],
}
artifacts = MODULE.BUILTIN_HANDLERS["parquet_table_summary"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_parquet_table_summary"](
"run-1", "parquet", root / "out", node_data, []
)
@ -6655,7 +6670,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "COCO 标注校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["coco_annotation_validate"]("run-1", "coco", root / "out", node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_coco_annotation_validate"]("run-1", "coco", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "coco-annotation-validation")
@ -6675,7 +6690,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
(root / "data.yaml").write_text("names: [cube]\n", encoding="utf-8")
node_data = {"label": "YOLO 检测标注校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["yolo_detection_validate"]("run-1", "yolo", root / "out", node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_yolo_detection_validate"]("run-1", "yolo", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "yolo-detection-validation")
@ -6697,7 +6712,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
class_names = ["person", "bicycle", "car", *[f"class_{index}" for index in range(3, 80)]]
detections = list(
MODULE.video_target_clip_operator._iter_dnn_detections_from_output(
MODULE.load_operator_module("video_target_clip")._iter_dnn_detections_from_output(
output,
class_names,
0.2,
@ -6726,7 +6741,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
class_names = ["person", "bicycle", "car", "motorcycle", *[f"class_{index}" for index in range(4, 80)]]
detections = list(
MODULE.video_target_clip_operator._iter_dnn_detections_from_output(
MODULE.load_operator_module("video_target_clip")._iter_dnn_detections_from_output(
output,
class_names,
0.2,
@ -6768,7 +6783,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "RGB-D 帧对齐校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["rgbd_frame_pair_validate"]("run-1", "rgbd", root / "out", node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_rgbd_frame_pair_validate"]("run-1", "rgbd", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "rgbd-frame-pair-validation")
@ -6798,7 +6813,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
"hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}, {"key": "CLASS_IDS", "value": "0,1,2"}],
}
artifacts = MODULE.BUILTIN_HANDLERS["segmentation_mask_validate"]("run-1", "mask", root / "out", node_data, [])
artifacts = MODULE.BUILTIN_HANDLERS["builtin_segmentation_mask_validate"]("run-1", "mask", root / "out", node_data, [])
payload = MODULE.load_artifact_payload(artifacts[0])
self.assertEqual(payload["datasetType"], "segmentation-mask-validation")
@ -6819,7 +6834,7 @@ class EmbodiedDatasetOperatorTests(unittest.TestCase):
)
node_data = {"label": "语言指令校验", "hyperparams": [{"key": "SOURCE_PATH", "value": str(root)}]}
artifacts = MODULE.BUILTIN_HANDLERS["language_instruction_validate"](
artifacts = MODULE.BUILTIN_HANDLERS["builtin_language_instruction_validate"](
"run-1", "language", root / "out", node_data, []
)

View File

@ -1,26 +1,20 @@
# Operator Repositories
# Operator runtime helpers
This directory is the single local home for built-in operator repositories.
Built-in operator source and metadata have one source of truth under `operator-repos/builtin/<slug>/`.
Each operator uses `src/operator.py`, `operator.json`, and `repository.json` from that directory.
The per-operator copies formerly under `backend/operators/builtin/<slug>/` have been removed.
Each built-in operator has a directory under `backend/operators/builtin/<operator-slug>/`.
Executable operator code should live in that operator directory when a handler is migrated
out of the legacy `backend/operator-runner/main.py` runner. The runner remains the stable
container entrypoint and delegates to migrated operator modules.
The Python modules directly under `backend/operators/builtin/` are shared runtime libraries
(such as structured model and HoloBrain helpers), imported by canonical operator sources.
They are not alternative operator repositories or compatibility entrypoints.
Repository contract:
`backend/operator-runner/main.py` dispatches only explicit handler identifiers declared in
the current catalog. It does not infer handlers from labels or expand naming aliases.
- `operator.py` is the executable module for that operator.
- `operator.json` is the platform catalog/runtime metadata for that operator.
- `repository.json` is the local repository manifest for that operator directory. It records
repository identity, entrypoint, runtime dependencies, external acceptance requirements,
and the no-mock/no-simulation/no-hardcoded-output acceptance policy.
- Regenerate manifests with `python3 scripts/generate_operator_repository_manifests.py --write`
and verify drift with `python3 scripts/generate_operator_repository_manifests.py --check`.
Validate generated contracts with:
Acceptance requirements:
- Use real input files, JSON payloads, command execution, or storage clients in tests.
- Do not add mock-only, simulation-only, hard-coded, or shallow-only acceptance paths.
- Keep catalog metadata in `internal/api/builtin_operators_catalog.json` aligned with
the operator directory metadata.
- Keep public operator docs in `docs/operators/` aligned with runtime handlers.
```bash
python3 scripts/generate_operator_repositories.py --check
python3 scripts/generate_operator_repository_manifests.py --check
python3 scripts/generate_operator_images.py --check
```

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-act-policy-train",
"name": "ACT 策略训练",
"category": "AI",
"type": "builtin",
"runtimeHandler": "builtin_act_policy_train",
"runtimeSource": "backend/operators/builtin/act_policy_train/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,16 +0,0 @@
from __future__ import annotations
from typing import Any
from backend.operators.builtin.structured_model_operator import HelperMap, run_lerobot_act_training
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
return run_lerobot_act_training(run_id, node_id, output_dir, node_data, inputs, helpers)

View File

@ -1,79 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "AI",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-act-policy-train:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-act-policy-train@sha256:d24b5417b2eab1abf5bb07a1d66d38306ea5545226d3f2a3e34bb5aee184f4f2",
"metadata": "operator.json",
"name": "ACT 策略训练",
"operatorId": "operator-builtin-act-policy-train",
"operatorSlug": "act_policy_train",
"preferredSlug": "act_policy_train",
"pythonImport": "backend.operators.builtin.act_policy_train.operator:run",
"repositoryId": "builtin/act_policy_train",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": true,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_act_policy_train",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-act-policy-train",
"operatorSlug": "act_policy_train",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 1,
"recommendedGpuType": "NVIDIA A800 80GB",
"requiresGpu": true
},
"runtimeDependencies": [
"huggingface-lerobot-act",
"lerobot-dataset-or-local-root",
"gpu-a800"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"huggingface-lerobot-act",
"lerobot-dataset-or-local-root",
"gpu-a800"
],
"runtimeHandler": "builtin_act_policy_train",
"runtimeSource": "backend/operators/builtin/act_policy_train/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/act_policy_train",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-action-state-quality-validate",
"name": "动作状态数值质量校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_action_state_quality_validate",
"runtimeSource": "backend/operators/builtin/action_state_quality_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,360 +0,0 @@
from __future__ import annotations
import json
import math
import pathlib
from typing import Any, Callable
import pyarrow.parquet as pq
HelperMap = dict[str, Callable[..., Any]]
SUPPORTED_SUFFIXES = {".json", ".jsonl", ".parquet"}
DEFAULT_ACTION_FIELDS = ("action", "actions", "control", "command")
DEFAULT_STATE_FIELDS = (
"observation.state",
"state",
"states",
"observation.joint_positions",
"joint_positions",
"proprio",
)
def _positive_int(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, "") or "").strip()
if not raw:
return default
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _positive_float(params: dict[str, str], key: str, default: float) -> float:
raw = str(params.get(key, "") or "").strip()
if not raw:
return default
try:
value = float(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be numeric") from exc
if not math.isfinite(value) or value <= 0:
raise RuntimeError(f"{key} must be a positive finite number")
return value
def _field_list(raw: str, default: tuple[str, ...]) -> list[str]:
fields = [item.strip() for item in str(raw or "").split(",") if item.strip()]
return fields or list(default)
def _candidate_files(path: pathlib.Path) -> list[pathlib.Path]:
if path.is_file():
return [path] if path.suffix.lower() in SUPPORTED_SUFFIXES else []
data_root = path / "data"
if data_root.is_dir():
data_files = sorted(candidate for candidate in data_root.rglob("*.parquet") if candidate.is_file())
if data_files:
return data_files
preferred = [
path / "data" / "chunk-000" / "episode_000000.parquet",
path / "episodes.jsonl",
path / "trajectory.jsonl",
path / "data.jsonl",
]
files = [item for item in preferred if item.is_file() and item.suffix.lower() in SUPPORTED_SUFFIXES]
seen = {item.resolve() for item in files}
for candidate in sorted(path.rglob("*")):
if not candidate.is_file() or candidate.suffix.lower() not in SUPPORTED_SUFFIXES:
continue
resolved = candidate.resolve()
if resolved in seen:
continue
files.append(candidate)
seen.add(resolved)
return files
def _json_rows(payload: Any) -> list[dict[str, Any]]:
if isinstance(payload, dict):
for key in ("rows", "steps", "frames", "items"):
values = payload.get(key)
if isinstance(values, list):
return [item for item in values if isinstance(item, dict)]
for key in ("episodes", "trajectories"):
episodes = payload.get(key)
if isinstance(episodes, list):
return _episode_rows(episodes)
return [payload]
if isinstance(payload, list):
if all(isinstance(item, dict) and isinstance(item.get("steps"), list) for item in payload):
return _episode_rows(payload)
return [item for item in payload if isinstance(item, dict)]
return []
def _episode_rows(episodes: list[Any]) -> list[dict[str, Any]]:
rows: list[dict[str, Any]] = []
for fallback_index, episode in enumerate(episodes):
if not isinstance(episode, dict):
continue
episode_id = _first_present(episode, ("episode_index", "episode_id", "episodeId", "id"), fallback_index)
steps = episode.get("steps")
if not isinstance(steps, list):
continue
for step_index, step in enumerate(steps):
if not isinstance(step, dict):
continue
row = dict(step)
row.setdefault("episode_index", episode_id)
row.setdefault("frame_index", step_index)
rows.append(row)
return rows
def _load_rows(path: pathlib.Path, remaining: int) -> list[dict[str, Any]]:
suffix = path.suffix.lower()
if suffix == ".jsonl":
rows: list[dict[str, Any]] = []
with path.open("r", encoding="utf-8") as handle:
for line_number, line in enumerate(handle, start=1):
if len(rows) >= remaining:
break
stripped = line.strip()
if not stripped:
continue
try:
payload = json.loads(stripped)
except json.JSONDecodeError as exc:
raise RuntimeError(f"{path} line {line_number} is not valid JSON") from exc
rows.extend(_json_rows(payload))
return rows[:remaining]
if suffix == ".json":
try:
return _json_rows(json.loads(path.read_text(encoding="utf-8")))[:remaining]
except json.JSONDecodeError as exc:
raise RuntimeError(f"{path} is not valid JSON") from exc
if suffix == ".parquet":
parquet_file = pq.ParquetFile(path)
rows: list[dict[str, Any]] = []
for batch in parquet_file.iter_batches(batch_size=min(max(remaining, 1), 4096)):
rows.extend(item for item in batch.to_pylist() if isinstance(item, dict))
if len(rows) >= remaining:
break
return rows[:remaining]
return []
def _first_present(payload: dict[str, Any], fields: tuple[str, ...], fallback: Any = "") -> Any:
for field in fields:
value = payload.get(field)
if value is not None and str(value).strip():
return value
return fallback
def _get_value(payload: dict[str, Any], path: str) -> Any:
if path in payload:
return payload[path]
current: Any = payload
for part in path.split("."):
if isinstance(current, dict) and part in current:
current = current[part]
else:
return None
return current
def _flatten_numeric(value: Any) -> tuple[list[float], int]:
if value is None or value == "":
return [], 0
if isinstance(value, bool):
return [], 1
if isinstance(value, (int, float)):
return [float(value)], 0
if isinstance(value, (list, tuple)):
result: list[float] = []
non_numeric = 0
for item in value:
values, invalid_count = _flatten_numeric(item)
result.extend(values)
non_numeric += invalid_count
return result, non_numeric
return [], 1
def _first_vector(row: dict[str, Any], fields: list[str]) -> tuple[str, list[float], int]:
for field in fields:
values, non_numeric = _flatten_numeric(_get_value(row, field))
if values or non_numeric:
return field, values, non_numeric
return "", [], 0
def _vector_stats(vectors: list[list[float]], low_variance_epsilon: float) -> dict[str, Any]:
if not vectors:
return {"dimension": 0, "min": [], "max": [], "mean": [], "lowVarianceDimensions": []}
dimension = len(vectors[0])
mins = [float("inf")] * dimension
maxs = [float("-inf")] * dimension
sums = [0.0] * dimension
for vector in vectors:
for index, value in enumerate(vector[:dimension]):
mins[index] = min(mins[index], value)
maxs[index] = max(maxs[index], value)
sums[index] += value
count = max(len(vectors), 1)
low_variance = [index for index, (min_value, max_value) in enumerate(zip(mins, maxs)) if abs(max_value - min_value) <= low_variance_epsilon]
return {
"dimension": dimension,
"min": [round(value, 6) for value in mins],
"max": [round(value, 6) for value in maxs],
"mean": [round(value / count, 6) for value in sums],
"lowVarianceDimensions": low_variance,
}
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("动作状态数值质量校验需要 SOURCE_PATH 指向真实 JSON/JSONL/Parquet 数据")
max_rows = _positive_int(params, "MAX_ROWS", 10000)
max_files = _positive_int(params, "MAX_FILES", 50)
max_abs_value = _positive_float(params, "MAX_ABS_VALUE", 1_000_000.0)
low_variance_epsilon = _positive_float(params, "LOW_VARIANCE_EPSILON", 1e-9)
action_fields = _field_list(params.get("ACTION_FIELDS", ""), DEFAULT_ACTION_FIELDS)
state_fields = _field_list(params.get("STATE_FIELDS", ""), DEFAULT_STATE_FIELDS)
rows: list[dict[str, Any]] = []
parsed_files: list[str] = []
for file_path in _candidate_files(source_path)[:max_files]:
next_rows = _load_rows(file_path, max(1, max_rows - len(rows)))
if next_rows:
parsed_files.append(str(file_path))
rows.extend(next_rows)
if len(rows) >= max_rows:
break
if not rows:
raise RuntimeError(f"{source_path} does not contain readable action/state rows")
action_vectors: list[list[float]] = []
state_vectors: list[list[float]] = []
action_field_counts: dict[str, int] = {}
state_field_counts: dict[str, int] = {}
missing_action = 0
missing_state = 0
non_numeric: list[dict[str, Any]] = []
non_finite: list[dict[str, Any]] = []
out_of_range: list[dict[str, Any]] = []
action_dimension: int | None = None
state_dimension: int | None = None
action_dimension_issues: list[dict[str, Any]] = []
state_dimension_issues: list[dict[str, Any]] = []
for row_index, row in enumerate(rows):
action_field, action_values, action_non_numeric = _first_vector(row, action_fields)
state_field, state_values, state_non_numeric = _first_vector(row, state_fields)
if not action_field:
missing_action += 1
if not state_field:
missing_state += 1
if action_non_numeric:
non_numeric.append({"rowIndex": row_index, "field": action_field or "action", "count": action_non_numeric})
if state_non_numeric:
non_numeric.append({"rowIndex": row_index, "field": state_field or "state", "count": state_non_numeric})
for family, field, values in (("action", action_field, action_values), ("state", state_field, state_values)):
if not values:
continue
invalid_indexes = [index for index, value in enumerate(values) if not math.isfinite(value)]
if invalid_indexes:
non_finite.append({"rowIndex": row_index, "family": family, "field": field, "indexes": invalid_indexes[:50]})
continue
large_indexes = [index for index, value in enumerate(values) if abs(value) > max_abs_value]
if large_indexes:
out_of_range.append({"rowIndex": row_index, "family": family, "field": field, "indexes": large_indexes[:50]})
if family == "action":
action_field_counts[field] = action_field_counts.get(field, 0) + 1
if action_dimension is None:
action_dimension = len(values)
elif len(values) != action_dimension:
action_dimension_issues.append({"rowIndex": row_index, "expected": action_dimension, "actual": len(values)})
continue
action_vectors.append(values)
else:
state_field_counts[field] = state_field_counts.get(field, 0) + 1
if state_dimension is None:
state_dimension = len(values)
elif len(values) != state_dimension:
state_dimension_issues.append({"rowIndex": row_index, "expected": state_dimension, "actual": len(values)})
continue
state_vectors.append(values)
issues: list[dict[str, Any]] = []
if missing_action:
issues.append({"code": "missing_action_rows", "count": missing_action})
if missing_state:
issues.append({"code": "missing_state_rows", "count": missing_state})
if non_numeric:
issues.append({"code": "non_numeric_values", "count": len(non_numeric), "examples": non_numeric[:100]})
if non_finite:
issues.append({"code": "non_finite_values", "count": len(non_finite), "examples": non_finite[:100]})
if out_of_range:
issues.append({"code": "out_of_range_values", "count": len(out_of_range), "maxAbsValue": max_abs_value, "examples": out_of_range[:100]})
if action_dimension_issues:
issues.append({"code": "inconsistent_action_dimension", "count": len(action_dimension_issues), "examples": action_dimension_issues[:100]})
if state_dimension_issues:
issues.append({"code": "inconsistent_state_dimension", "count": len(state_dimension_issues), "examples": state_dimension_issues[:100]})
action_stats = _vector_stats(action_vectors, low_variance_epsilon)
state_stats = _vector_stats(state_vectors, low_variance_epsilon)
warnings: list[dict[str, Any]] = []
if action_stats["lowVarianceDimensions"]:
warnings.append({"code": "low_variance_action_dimensions", "indexes": action_stats["lowVarianceDimensions"][:100]})
if state_stats["lowVarianceDimensions"]:
warnings.append({"code": "low_variance_state_dimensions", "indexes": state_stats["lowVarianceDimensions"][:100]})
payload = {
"datasetType": "action-state-quality-validation",
"sourcePath": str(source_path),
"valid": not issues,
"issueCount": len(issues),
"warningCount": len(warnings),
"issues": issues,
"warnings": warnings,
"parsedFiles": parsed_files,
"rowCount": len(rows),
"actionRowCount": len(action_vectors),
"stateRowCount": len(state_vectors),
"missingActionCount": missing_action,
"missingStateCount": missing_state,
"actionFields": action_fields,
"stateFields": state_fields,
"actionFieldCounts": action_field_counts,
"stateFieldCounts": state_field_counts,
"actionDimension": action_dimension or 0,
"stateDimension": state_dimension or 0,
"actionStats": action_stats,
"stateStats": state_stats,
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"action-state-quality-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,77 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-action-state-quality-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-action-state-quality-validate@sha256:96055934c67458386848e774725ea4328cb0b1fe157e77a23e8586659e7b538d",
"metadata": "operator.json",
"name": "动作状态数值质量校验",
"operatorId": "operator-builtin-action-state-quality-validate",
"operatorSlug": "action_state_quality_validate",
"preferredSlug": "action_state_quality_validate",
"pythonImport": "backend.operators.builtin.action_state_quality_validate.operator:run",
"repositoryId": "builtin/action_state_quality_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_action_state_quality_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-action-state-quality-validate",
"operatorSlug": "action_state_quality_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"json-jsonl-parquet-files",
"pyarrow"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"json-jsonl-parquet-files",
"pyarrow"
],
"runtimeHandler": "builtin_action_state_quality_validate",
"runtimeSource": "backend/operators/builtin/action_state_quality_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/action_state_quality_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-agibot-world2026-validate",
"name": "AgiBotWorld2026 数据集校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_agibot_world2026_validate",
"runtimeSource": "backend/operators/builtin/agibot_world2026_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,523 +0,0 @@
from __future__ import annotations
import json
import pathlib
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
DEFAULT_CHUNK_SIZE = 1000
DEFAULT_MAX_PARQUET_FILES = 100
DEFAULT_REQUIRED_COLUMNS = ("episode_index", "frame_index", "timestamp", "action")
DEFAULT_DATA_TEMPLATES = (
"data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"data/chunk-{chunk_index:03d}/episode_{episode_index:06d}.parquet",
"data/episode_{episode_index:06d}.parquet",
)
DEFAULT_VIDEO_TEMPLATES = (
"videos/{video_key}/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.mp4",
"videos/{video_key}/episode_{episode_index:06d}.mp4",
)
DATA_PATH_KEYS = ("data_path", "dataPath", "file_path", "filePath", "parquet_path", "parquetPath", "path")
EPISODE_ID_KEYS = ("episode_index", "episodeIndex", "episode_id", "episodeId", "id")
LENGTH_KEYS = ("length", "num_frames", "frame_count", "episode_length")
def _require_pyarrow_parquet():
try:
import pyarrow.parquet as pq # type: ignore
except Exception as exc:
raise RuntimeError("AgiBotWorld2026 数据集校验需要 pyarrow 读取真实 Parquet 文件") from exc
return pq
def _positive_int(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, "") or "").strip()
if not raw:
return default
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _bool_param(helpers: HelperMap, params: dict[str, str], key: str, default: bool) -> bool:
return bool(helpers["parse_bool_param"](params, key, default))
def _csv_tokens(raw: str, default: tuple[str, ...]) -> list[str]:
values = [item.strip() for item in str(raw or "").split(",") if item.strip()]
return values or list(default)
def _load_json(path: pathlib.Path) -> dict[str, Any]:
if not path.is_file():
return {}
try:
payload = json.loads(path.read_text(encoding="utf-8"))
except json.JSONDecodeError as exc:
raise RuntimeError(f"{path} is not valid JSON") from exc
return payload if isinstance(payload, dict) else {}
def _load_jsonl(path: pathlib.Path) -> list[dict[str, Any]]:
rows: list[dict[str, Any]] = []
if not path.is_file():
return rows
with path.open("r", encoding="utf-8") as handle:
for line_number, line in enumerate(handle, start=1):
stripped = line.strip()
if not stripped:
continue
try:
payload = json.loads(stripped)
except json.JSONDecodeError as exc:
raise RuntimeError(f"{path} line {line_number} is not valid JSON") from exc
if isinstance(payload, dict):
rows.append(payload)
return rows
def _safe_int(value: Any, default: int = -1) -> int:
try:
return int(value)
except (TypeError, ValueError):
return default
def _first_int(row: dict[str, Any], keys: tuple[str, ...], default: int = -1) -> int:
for key in keys:
value = _safe_int(row.get(key), -1)
if value >= 0:
return value
return default
def _episode_index(row: dict[str, Any], fallback: int) -> int:
value = _first_int(row, EPISODE_ID_KEYS, -1)
return value if value >= 0 else fallback
def _episode_key(row: dict[str, Any], fallback: int) -> str:
return str(_episode_index(row, fallback))
def _episode_length(row: dict[str, Any]) -> int:
return _first_int(row, LENGTH_KEYS, -1)
def _relative(root: pathlib.Path, path: pathlib.Path) -> str:
try:
return path.relative_to(root).as_posix()
except ValueError:
return str(path)
def _find_dataset_root(source_path: pathlib.Path) -> pathlib.Path:
current = source_path if source_path.is_dir() else source_path.parent
for candidate in (current, *current.parents):
if (candidate / "meta" / "info.json").is_file() and (candidate / "data").exists():
return candidate
return current
def _episode_metadata_rows(meta_dir: pathlib.Path, pq: Any, max_files: int) -> tuple[list[dict[str, Any]], list[str]]:
rows: list[dict[str, Any]] = []
files: list[str] = []
jsonl_path = meta_dir / "episodes.jsonl"
if jsonl_path.is_file():
rows.extend({**row, "_metadataFile": jsonl_path.relative_to(meta_dir.parent).as_posix()} for row in _load_jsonl(jsonl_path))
files.append(jsonl_path.relative_to(meta_dir.parent).as_posix())
parquet_root = meta_dir / "episodes"
if parquet_root.is_dir():
for path in sorted(parquet_root.rglob("*.parquet"))[:max_files]:
table = pq.read_table(path)
relative = path.relative_to(meta_dir.parent).as_posix()
rows.extend({**row, "_metadataFile": relative} for row in table.to_pylist() if isinstance(row, dict))
files.append(relative)
return rows, files
def _task_rows(meta_dir: pathlib.Path, pq: Any, max_files: int) -> tuple[list[dict[str, Any]], list[str]]:
rows: list[dict[str, Any]] = []
files: list[str] = []
jsonl_path = meta_dir / "tasks.jsonl"
if jsonl_path.is_file():
rows.extend(_load_jsonl(jsonl_path))
files.append(jsonl_path.relative_to(meta_dir.parent).as_posix())
parquet_root = meta_dir / "tasks"
if parquet_root.is_dir():
for path in sorted(parquet_root.rglob("*.parquet"))[:max_files]:
table = pq.read_table(path)
rows.extend(row for row in table.to_pylist() if isinstance(row, dict))
files.append(path.relative_to(meta_dir.parent).as_posix())
return rows, files
def _data_parquet_paths(root: pathlib.Path, max_files: int) -> list[pathlib.Path]:
data_root = root / "data"
if not data_root.is_dir():
return []
return sorted(path for path in data_root.rglob("*.parquet") if path.is_file())[:max_files]
def _scan_data_file(path: pathlib.Path, root: pathlib.Path, pq: Any) -> dict[str, Any]:
parquet_file = pq.ParquetFile(path)
schema_names = list(parquet_file.schema_arrow.names)
row_count = int(parquet_file.metadata.num_rows)
episode_rows: dict[str, int] = {}
frame_ranges: dict[str, dict[str, int]] = {}
columns = [name for name in ("episode_index", "frame_index") if name in schema_names]
if "episode_index" in columns:
for batch in parquet_file.iter_batches(batch_size=4096, columns=columns):
payload = batch.to_pydict()
episode_values = payload.get("episode_index", [])
frame_values = payload.get("frame_index", [])
for index, episode_value in enumerate(episode_values):
episode = str(episode_value)
episode_rows[episode] = episode_rows.get(episode, 0) + 1
if frame_values:
frame_index = _safe_int(frame_values[index], -1)
if frame_index >= 0:
current = frame_ranges.get(episode)
if current is None:
frame_ranges[episode] = {"min": frame_index, "max": frame_index}
else:
current["min"] = min(current["min"], frame_index)
current["max"] = max(current["max"], frame_index)
return {
"path": _relative(root, path),
"rowCount": row_count,
"columns": schema_names,
"episodeRows": episode_rows,
"frameRanges": frame_ranges,
}
def _template_values(row: dict[str, Any], fallback: int, chunk_size: int, video_key: str = "") -> dict[str, Any]:
episode_index = _episode_index(row, fallback)
episode_chunk = _first_int(row, ("episode_chunk", "episodeChunk", "chunk_index", "chunkIndex"), -1)
if episode_chunk < 0:
episode_chunk = episode_index // chunk_size if episode_index >= 0 else 0
return {
"episode_index": episode_index,
"episode_id": episode_index,
"episode_chunk": episode_chunk,
"chunk_index": episode_chunk,
"video_key": video_key,
}
def _format_template(template: str, values: dict[str, Any]) -> str:
try:
return template.format(**values)
except (KeyError, ValueError):
return ""
def _templates(info: dict[str, Any], params: dict[str, str], param_key: str, info_keys: tuple[str, ...], defaults: tuple[str, ...]) -> list[str]:
explicit = str(params.get(param_key, "") or "").strip()
result: list[str] = [explicit] if explicit else []
for key in info_keys:
value = info.get(key)
if isinstance(value, str) and value.strip():
result.append(value.strip())
elif isinstance(value, dict):
result.extend(str(item).strip() for item in value.values() if isinstance(item, str) and item.strip())
result.extend(defaults)
deduped: list[str] = []
for template in result:
if template and template not in deduped:
deduped.append(template)
return deduped
def _explicit_path(row: dict[str, Any], keys: tuple[str, ...]) -> str:
for key in keys:
value = row.get(key)
if isinstance(value, str) and value.strip():
return value.strip()
return ""
def _resolve_existing(root: pathlib.Path, relative_or_absolute: str) -> pathlib.Path | None:
raw = str(relative_or_absolute or "").strip()
if not raw:
return None
candidate = pathlib.Path(raw)
if candidate.is_absolute():
return candidate if candidate.is_file() else None
resolved = root / raw
return resolved if resolved.is_file() else None
def _candidate_data_paths(root: pathlib.Path, info: dict[str, Any], params: dict[str, str], row: dict[str, Any], index: int, chunk_size: int) -> list[str]:
candidates: list[str] = []
explicit = _explicit_path(row, DATA_PATH_KEYS)
if explicit:
candidates.append(explicit)
values = _template_values(row, index, chunk_size)
for template in _templates(info, params, "DATA_PATH_TEMPLATE", ("data_path", "dataPath"), DEFAULT_DATA_TEMPLATES):
rendered = _format_template(template, values)
if rendered:
candidates.append(rendered)
result: list[str] = []
for candidate in candidates:
resolved = _resolve_existing(root, candidate)
if resolved is not None:
relative = _relative(root, resolved)
if relative not in result:
result.append(relative)
return result
def _feature_video_keys(info: dict[str, Any]) -> list[str]:
features = info.get("features")
keys: list[str] = []
if isinstance(features, dict):
for key, value in features.items():
if not isinstance(value, dict):
continue
dtype = str(value.get("dtype") or value.get("type") or "").lower()
if "video" in dtype or key.startswith("observation.images.") or key.startswith("observation.image."):
keys.append(str(key))
return keys
def _param_video_keys(params: dict[str, str], info: dict[str, Any]) -> list[str]:
values = _csv_tokens(params.get("VIDEO_KEYS", ""), tuple(_feature_video_keys(info)))
return list(dict.fromkeys(values))
def _explicit_video_paths(row: dict[str, Any]) -> list[str]:
for key in ("video_path", "videoPath", "video_paths", "videoPaths", "videos"):
value = row.get(key)
if isinstance(value, str) and value.strip():
return [value.strip()]
if isinstance(value, dict):
return [str(item).strip() for item in value.values() if isinstance(item, str) and str(item).strip()]
if isinstance(value, list):
return [str(item).strip() for item in value if isinstance(item, str) and str(item).strip()]
return []
def _candidate_video_paths(
root: pathlib.Path,
info: dict[str, Any],
params: dict[str, str],
row: dict[str, Any],
index: int,
chunk_size: int,
video_keys: list[str],
) -> list[str]:
candidates = _explicit_video_paths(row)
templates = _templates(info, params, "VIDEO_PATH_TEMPLATE", ("video_path", "videoPath"), DEFAULT_VIDEO_TEMPLATES)
for video_key in video_keys:
values = _template_values(row, index, chunk_size, video_key=video_key)
for template in templates:
rendered = _format_template(template, values)
if rendered:
candidates.append(rendered)
result: list[str] = []
for candidate in candidates:
resolved = _resolve_existing(root, candidate)
if resolved is not None:
relative = _relative(root, resolved)
if relative not in result:
result.append(relative)
return result
def _task_id_set(tasks: list[dict[str, Any]]) -> set[int]:
result: set[int] = set()
for row in tasks:
task_id = _first_int(row, ("task_index", "taskIndex", "task_id", "taskId", "id"), -1)
if task_id >= 0:
result.add(task_id)
return result
def _row_task_ids(row: dict[str, Any]) -> list[int]:
values: list[Any] = []
for key in ("tasks", "task_indices", "taskIndices", "task_index", "taskIndex", "task_id", "taskId"):
if key in row:
value = row[key]
if isinstance(value, list):
values.extend(value)
else:
values.append(value)
result = []
for value in values:
task_id = _safe_int(value, -1)
if task_id >= 0 and task_id not in result:
result.append(task_id)
return result
def _inferred_paths_for_episode(data_files: list[dict[str, Any]], episode_id: str) -> list[str]:
return [str(item["path"]) for item in data_files if int(item.get("episodeRows", {}).get(episode_id, 0)) > 0]
def _validate_episode(
row: dict[str, Any],
index: int,
root: pathlib.Path,
info: dict[str, Any],
params: dict[str, str],
data_files: list[dict[str, Any]],
data_files_by_path: dict[str, dict[str, Any]],
task_ids: set[int],
video_keys: list[str],
chunk_size: int,
required_columns: list[str],
check_videos: bool,
) -> dict[str, Any]:
episode_id = _episode_key(row, index)
length = _episode_length(row)
candidate_data_paths = _candidate_data_paths(root, info, params, row, index, chunk_size)
inferred_data_paths = _inferred_paths_for_episode(data_files, episode_id)
matched_data_paths = [path for path in candidate_data_paths if path in inferred_data_paths] or inferred_data_paths
data_rows = sum(int(data_files_by_path[path]["episodeRows"].get(episode_id, 0)) for path in inferred_data_paths)
video_paths = _candidate_video_paths(root, info, params, row, index, chunk_size, video_keys)
issues: list[dict[str, Any]] = []
if not inferred_data_paths:
issues.append({"code": "episode_missing_data_rows", "episodeId": episode_id})
if candidate_data_paths and not any(path in inferred_data_paths for path in candidate_data_paths):
issues.append({"code": "episode_candidate_data_path_does_not_contain_rows", "episodeId": episode_id, "candidatePaths": candidate_data_paths, "inferredPaths": inferred_data_paths})
if length >= 0 and data_rows and data_rows != length:
issues.append({"code": "episode_length_mismatch", "episodeId": episode_id, "metadataLength": length, "dataRows": data_rows})
for path in matched_data_paths:
columns = set(data_files_by_path[path].get("columns", []))
missing_columns = [column for column in required_columns if column not in columns]
if missing_columns:
issues.append({"code": "missing_required_data_columns", "episodeId": episode_id, "path": path, "columns": missing_columns})
if check_videos and video_keys and len(video_paths) < len(video_keys):
issues.append({"code": "missing_video_files", "episodeId": episode_id, "expectedVideoKeys": video_keys, "foundPaths": video_paths})
for task_id in _row_task_ids(row):
if task_ids and task_id not in task_ids:
issues.append({"code": "unknown_task_id", "episodeId": episode_id, "taskId": task_id})
frame_range = {}
if matched_data_paths:
frame_range = data_files_by_path[matched_data_paths[0]].get("frameRanges", {}).get(episode_id, {})
return {
"episodeId": episode_id,
"metadataFile": str(row.get("_metadataFile", "")),
"length": length,
"dataRows": data_rows,
"candidateDataPaths": candidate_data_paths,
"inferredDataPaths": inferred_data_paths,
"matchedDataPaths": matched_data_paths,
"videoPaths": video_paths,
"taskIds": _row_task_ids(row),
"frameRange": frame_range,
"valid": not issues,
"issues": issues,
}
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("AgiBotWorld2026 数据集校验需要 SOURCE_PATH 指向真实数据集目录")
root = _find_dataset_root(source_path)
meta_dir = root / "meta"
if not meta_dir.is_dir():
raise RuntimeError(f"{root} does not contain an AgiBotWorld2026 meta directory")
pq = _require_pyarrow_parquet()
max_files = _positive_int(params, "MAX_PARQUET_FILES", DEFAULT_MAX_PARQUET_FILES)
chunk_size = _positive_int(params, "CHUNK_SIZE", DEFAULT_CHUNK_SIZE)
check_videos = _bool_param(helpers, params, "CHECK_VIDEO_EXISTS", True)
required_columns = _csv_tokens(params.get("REQUIRED_COLUMNS", ""), DEFAULT_REQUIRED_COLUMNS)
info = _load_json(meta_dir / "info.json")
episodes, episode_files = _episode_metadata_rows(meta_dir, pq, max_files)
tasks, task_files = _task_rows(meta_dir, pq, max_files)
task_ids = _task_id_set(tasks)
video_keys = _param_video_keys(params, info)
data_paths = _data_parquet_paths(root, max_files)
data_files = [_scan_data_file(path, root, pq) for path in data_paths]
data_files_by_path = {str(item["path"]): item for item in data_files}
video_file_count = len([path for path in (root / "videos").rglob("*") if path.is_file()]) if (root / "videos").is_dir() else 0
episode_summaries = [
_validate_episode(
row,
index,
root,
info,
params,
data_files,
data_files_by_path,
task_ids,
video_keys,
chunk_size,
required_columns,
check_videos,
)
for index, row in enumerate(episodes)
]
issues: list[dict[str, Any]] = []
warnings: list[dict[str, Any]] = []
if not info:
issues.append({"code": "missing_info_json", "path": str(meta_dir / "info.json")})
if not episodes:
issues.append({"code": "missing_episode_metadata", "path": str(meta_dir / "episodes.jsonl")})
if not data_paths:
issues.append({"code": "missing_data_parquet", "path": str(root / "data")})
invalid_episodes = [item for item in episode_summaries if not item["valid"]]
if invalid_episodes:
issues.append({"code": "invalid_episode_mapping", "count": len(invalid_episodes), "examples": invalid_episodes[:100]})
if check_videos and video_keys and video_file_count == 0:
issues.append({"code": "missing_video_root_files", "path": str(root / "videos"), "videoKeys": video_keys})
if len(data_paths) >= max_files:
warnings.append({"code": "data_parquet_scan_limited", "maxParquetFiles": max_files})
payload = {
"datasetType": "agibot-world2026-validation",
"sourcePath": str(root),
"valid": not issues,
"issueCount": len(issues),
"warningCount": len(warnings),
"issues": issues,
"warnings": warnings,
"chunkSize": chunk_size,
"requiredColumns": required_columns,
"dataPathTemplates": _templates(info, params, "DATA_PATH_TEMPLATE", ("data_path", "dataPath"), DEFAULT_DATA_TEMPLATES),
"videoPathTemplates": _templates(info, params, "VIDEO_PATH_TEMPLATE", ("video_path", "videoPath"), DEFAULT_VIDEO_TEMPLATES),
"videoKeys": video_keys,
"checkVideoExists": check_videos,
"episodeMetadataCount": len(episodes),
"episodeMetadataFiles": episode_files,
"taskCount": len(tasks),
"taskFiles": task_files,
"dataParquetCount": len(data_paths),
"dataRowCount": sum(int(item["rowCount"]) for item in data_files),
"videoFileCount": video_file_count,
"validEpisodeCount": len(episode_summaries) - len(invalid_episodes),
"invalidEpisodeCount": len(invalid_episodes),
"dataFiles": data_files,
"episodes": episode_summaries[:1000],
"invalidEpisodes": invalid_episodes[:200],
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"agibot-world2026-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,79 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-agibot-world2026-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-agibot-world2026-validate@sha256:622499759d3ae4bb0bbcbd51069fb2525510f41d3a42a474e30b7d21d9df41b8",
"metadata": "operator.json",
"name": "AgiBotWorld2026 数据集校验",
"operatorId": "operator-builtin-agibot-world2026-validate",
"operatorSlug": "agibot_world2026_validate",
"preferredSlug": "agibot_world2026_validate",
"pythonImport": "backend.operators.builtin.agibot_world2026_validate.operator:run",
"repositoryId": "builtin/agibot_world2026_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_agibot_world2026_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-agibot-world2026-validate",
"operatorSlug": "agibot_world2026_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"agibotworld2026-meta-data-video-files",
"pyarrow",
"parquet-files"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"agibotworld2026-meta-data-video-files",
"pyarrow",
"parquet-files"
],
"runtimeHandler": "builtin_agibot_world2026_validate",
"runtimeSource": "backend/operators/builtin/agibot_world2026_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/agibot_world2026_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-aloha-hdf5-validate",
"name": "ALOHA HDF5 示教校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_aloha_hdf5_validate",
"runtimeSource": "backend/operators/builtin/aloha_hdf5_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,230 +0,0 @@
from __future__ import annotations
import pathlib
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
def _require_h5py():
try:
import h5py # type: ignore
except Exception as exc: # pragma: no cover - runtime dependency check
raise RuntimeError("ALOHA HDF5 校验需要 h5py 运行时依赖") from exc
return h5py
def _int_param(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, str(default)) or str(default)).strip()
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _bool_param(params: dict[str, str], key: str, default: bool) -> bool:
raw = str(params.get(key, str(default)).strip().lower())
if raw in {"1", "true", "yes", "y", "on"}:
return True
if raw in {"0", "false", "no", "n", "off"}:
return False
return default
def _find_hdf5_files(source_path: pathlib.Path, max_files: int) -> list[pathlib.Path]:
if source_path.is_file():
return [source_path] if source_path.suffix.lower() in {".hdf5", ".h5"} else []
preferred = [
source_path / "episode_0.hdf5",
source_path / "episode_000000.hdf5",
source_path / "demo.hdf5",
]
files = [item for item in preferred if item.is_file()]
files.extend(
item
for item in sorted(source_path.rglob("*"))
if item.is_file() and item.suffix.lower() in {".hdf5", ".h5"} and item not in files
)
return files[:max_files]
def _get_node(root: Any, path: str) -> Any | None:
current = root
for part in path.strip("/").split("/"):
if not part:
continue
if not hasattr(current, "keys") or part not in current:
return None
current = current[part]
return current
def _shape(node: Any | None) -> list[int]:
if node is None or not hasattr(node, "shape"):
return []
return [int(item) for item in node.shape]
def _jsonable(value: Any) -> Any:
if isinstance(value, bytes):
return value.decode("utf-8", errors="replace")
if isinstance(value, (str, int, float, bool)) or value is None:
return value
if hasattr(value, "item"):
try:
return _jsonable(value.item())
except Exception:
pass
if isinstance(value, (list, tuple)):
return [_jsonable(item) for item in value]
return str(value)
def _attrs_payload(node: Any) -> dict[str, Any]:
return {str(key): _jsonable(value) for key, value in node.attrs.items()}
def _summarize_file(path: pathlib.Path, params: dict[str, str], require_qvel: bool) -> dict[str, Any]:
h5py = _require_h5py()
action_path = str(params.get("ACTION_PATH", "/action") or "/action")
qpos_path = str(params.get("QPOS_PATH", "/observations/qpos") or "/observations/qpos")
qvel_path = str(params.get("QVEL_PATH", "/observations/qvel") or "/observations/qvel")
image_group_path = str(params.get("IMAGE_GROUP_PATH", "/observations/images") or "/observations/images")
with h5py.File(path, "r") as handle:
action = _get_node(handle, action_path)
qpos = _get_node(handle, qpos_path)
qvel = _get_node(handle, qvel_path)
image_group = _get_node(handle, image_group_path)
action_shape = _shape(action)
qpos_shape = _shape(qpos)
qvel_shape = _shape(qvel)
action_frames = int(action_shape[0]) if action_shape else 0
qpos_frames = int(qpos_shape[0]) if qpos_shape else 0
frame_candidates = [value for value in (action_frames, qpos_frames) if value > 0]
frame_count = frame_candidates[0] if frame_candidates else 0
cameras: list[dict[str, Any]] = []
if image_group is not None and hasattr(image_group, "keys"):
for camera_name in sorted(image_group.keys()):
camera_dataset = image_group[camera_name]
camera_shape = _shape(camera_dataset)
cameras.append(
{
"name": str(camera_name),
"shape": camera_shape,
"frameCount": int(camera_shape[0]) if camera_shape else 0,
"dtype": str(getattr(camera_dataset, "dtype", "")),
}
)
issues: list[dict[str, Any]] = []
if not action_shape:
issues.append({"code": "missing_action_dataset", "path": action_path})
if not qpos_shape:
issues.append({"code": "missing_qpos_dataset", "path": qpos_path})
if require_qvel and not qvel_shape:
issues.append({"code": "missing_qvel_dataset", "path": qvel_path})
if not cameras:
issues.append({"code": "missing_camera_images", "path": image_group_path})
expected_frames = frame_count
if expected_frames <= 0:
issues.append({"code": "missing_frame_dimension"})
for name, shape_value, actual_count in (
("action", action_shape, action_frames),
("qpos", qpos_shape, qpos_frames),
("qvel", qvel_shape, int(qvel_shape[0]) if qvel_shape else 0),
):
if not shape_value or (name == "qvel" and not require_qvel):
continue
if expected_frames > 0 and actual_count != expected_frames:
issues.append(
{
"code": "frame_count_mismatch",
"dataset": name,
"expected": expected_frames,
"actual": actual_count,
}
)
for camera in cameras:
if expected_frames > 0 and int(camera["frameCount"]) != expected_frames:
issues.append(
{
"code": "camera_frame_count_mismatch",
"camera": camera["name"],
"expected": expected_frames,
"actual": camera["frameCount"],
}
)
return {
"path": str(path),
"fileSizeBytes": path.stat().st_size,
"attrs": _attrs_payload(handle),
"valid": not issues,
"issueCount": len(issues),
"issues": issues,
"frameCount": expected_frames,
"actionShape": action_shape,
"qposShape": qpos_shape,
"qvelShape": qvel_shape,
"actionDimension": int(action_shape[1]) if len(action_shape) > 1 else 0,
"qposDimension": int(qpos_shape[1]) if len(qpos_shape) > 1 else 0,
"qvelDimension": int(qvel_shape[1]) if len(qvel_shape) > 1 else 0,
"cameraCount": len(cameras),
"cameraNames": [item["name"] for item in cameras],
"cameras": cameras,
}
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("ALOHA HDF5 校验需要 SOURCE_PATH 指向真实 .hdf5/.h5 文件或目录")
max_files = _int_param(params, "MAX_FILES", 20)
require_qvel = _bool_param(params, "REQUIRE_QVEL", False)
files = _find_hdf5_files(source_path, max_files)
if not files:
raise RuntimeError(f"{source_path} does not contain .hdf5/.h5 ALOHA demonstration files")
file_summaries = [_summarize_file(path, params, require_qvel) for path in files]
issues = [
{"file": item["path"], **issue}
for item in file_summaries
for issue in item.get("issues", [])
]
camera_names = sorted({name for item in file_summaries for name in item.get("cameraNames", [])})
payload = {
"datasetType": "aloha-hdf5-validation",
"sourcePath": str(source_path),
"valid": not issues,
"issueCount": len(issues),
"issues": issues[:200],
"fileCount": len(file_summaries),
"totalFrames": sum(int(item.get("frameCount", 0)) for item in file_summaries),
"cameraCount": len(camera_names),
"cameraNames": camera_names,
"actionDimensions": sorted({int(item.get("actionDimension", 0)) for item in file_summaries if item.get("actionDimension")}),
"qposDimensions": sorted({int(item.get("qposDimension", 0)) for item in file_summaries if item.get("qposDimension")}),
"files": file_summaries,
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"aloha-hdf5-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,79 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-aloha-hdf5-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-aloha-hdf5-validate@sha256:e90db43b9bf900fec24f36546724121bab2a329f9ab7b48f579e84a53eb045a8",
"metadata": "operator.json",
"name": "ALOHA HDF5 示教校验",
"operatorId": "operator-builtin-aloha-hdf5-validate",
"operatorSlug": "aloha_hdf5_validate",
"preferredSlug": "aloha_hdf5_validate",
"pythonImport": "backend.operators.builtin.aloha_hdf5_validate.operator:run",
"repositoryId": "builtin/aloha_hdf5_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_aloha_hdf5_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-aloha-hdf5-validate",
"operatorSlug": "aloha_hdf5_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"aloha-act-hdf5-files",
"h5py",
"numpy"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"aloha-act-hdf5-files",
"h5py",
"numpy"
],
"runtimeHandler": "builtin_aloha_hdf5_validate",
"runtimeSource": "backend/operators/builtin/aloha_hdf5_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/aloha_hdf5_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-audit-sample",
"name": "抽检采样",
"category": "QA",
"type": "builtin",
"runtimeHandler": "builtin_audit_sampling",
"runtimeSource": "backend/operators/builtin/audit_sample/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,68 +0,0 @@
from __future__ import annotations
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
payload = helpers["first_payload_with_keys"](inputs, "packageCount", "items")
if payload is None:
raise RuntimeError("抽检采样需要上游成品数据输入")
rules = helpers["normalize_sampling_rules"](helpers["parse_json_param"](params, "RULES_JSON", [], list))
sampled_items = []
summaries = []
for rule in rules:
rule_id = rule["id"]
field_path = rule["field"]
operator = rule["operator"]
value = rule.get("value")
percent = rule["samplePercent"]
matched = []
sampled = []
for item in payload.get("items", []):
if not isinstance(item, dict):
continue
if not helpers["compare_values"](helpers["get_field_value"](item, field_path), operator, value):
continue
matched.append(item)
package_name = str(item.get("packageName", "")).strip() or str(item.get("clipId", "")).strip()
if helpers["stable_sample_hit"](f"{rule_id}:{package_name}", percent):
sampled.append(item)
sampled_items.append({**item, "sampleRuleId": rule_id})
summaries.append(
{
"id": rule_id,
"field": field_path,
"operator": operator,
"value": value,
"samplePercent": percent,
"matchedCount": len(matched),
"sampledCount": len(sampled),
}
)
manifest = {
"datasetType": "x-platform-audit-samples",
"rules": summaries,
"sampledCount": len(sampled_items),
"items": sampled_items,
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"audit-samples.json",
manifest,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,75 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "QA",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-audit-sample:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-audit-sample@sha256:2a89baaae19e6c2c33980f41921020043888dc48db23cbc69c7de6f4670c9fc2",
"metadata": "operator.json",
"name": "抽检采样",
"operatorId": "operator-builtin-audit-sample",
"operatorSlug": "audit_sample",
"preferredSlug": "audit_sample",
"pythonImport": "backend.operators.builtin.audit_sample.operator:run",
"repositoryId": "builtin/audit_sample",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_audit_sampling",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-audit-sample",
"operatorSlug": "audit_sample",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"json-artifacts"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"json-artifacts"
],
"runtimeHandler": "builtin_audit_sampling",
"runtimeSource": "backend/operators/builtin/audit_sample/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/audit_sample",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-bop-dataset-validate",
"name": "BOP 6D姿态数据集校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_bop_dataset_validate",
"runtimeSource": "backend/operators/builtin/bop_dataset_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,500 +0,0 @@
from __future__ import annotations
import json
import math
import pathlib
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
SPLIT_PREFIXES = ("train", "val", "test", "onboarding_static", "onboarding_dynamic")
IMAGE_SUFFIXES = (".png", ".jpg", ".jpeg", ".tif", ".tiff")
def _positive_int(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, str(default)) or str(default)).strip()
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _bool_param(helpers: HelperMap, params: dict[str, str], key: str, default: bool) -> bool:
return bool(helpers["parse_bool_param"](params, key, default))
def _relative(path: pathlib.Path | None, root: pathlib.Path) -> str:
if path is None:
return ""
try:
return path.relative_to(root).as_posix()
except ValueError:
return str(path)
def _load_json(path: pathlib.Path) -> Any:
try:
return json.loads(path.read_text(encoding="utf-8"))
except json.JSONDecodeError as exc:
raise RuntimeError(f"{path} is not valid JSON") from exc
def _json_file(scene_dir: pathlib.Path, prefix: str) -> pathlib.Path | None:
exact = scene_dir / f"{prefix}.json"
if exact.is_file():
return exact
if prefix == "scene_gt":
candidates = [
path
for path in sorted(scene_dir.glob("scene_gt_*.json"))
if not path.name.startswith("scene_gt_info") and not path.name.startswith("scene_gt_coco")
]
else:
candidates = sorted(scene_dir.glob(f"{prefix}_*.json"))
return candidates[0] if candidates else None
def _is_scene_dir(path: pathlib.Path) -> bool:
return path.is_dir() and (_json_file(path, "scene_camera") is not None or _json_file(path, "scene_gt") is not None)
def _find_scene_dirs(source_path: pathlib.Path, max_scenes: int) -> list[pathlib.Path]:
if source_path.is_file():
return [source_path.parent] if _is_scene_dir(source_path.parent) else []
if _is_scene_dir(source_path):
return [source_path]
scenes: list[pathlib.Path] = []
seen: set[pathlib.Path] = set()
for candidate in sorted(source_path.rglob("*")):
if len(scenes) >= max_scenes:
break
if not _is_scene_dir(candidate):
continue
resolved = candidate.resolve()
if resolved in seen:
continue
scenes.append(candidate)
seen.add(resolved)
return scenes
def _has_split_dir(path: pathlib.Path) -> bool:
if not path.is_dir():
return False
return any(child.is_dir() and child.name.startswith(SPLIT_PREFIXES) for child in path.iterdir())
def _has_models_dir(path: pathlib.Path) -> bool:
if not path.is_dir():
return False
return any(child.is_dir() and child.name.startswith("models") for child in path.iterdir())
def _dataset_root(source_path: pathlib.Path, scene_dirs: list[pathlib.Path]) -> pathlib.Path:
base = source_path if source_path.is_dir() else source_path.parent
for candidate in [base, *base.parents]:
if _has_split_dir(candidate) or _has_models_dir(candidate) or (candidate / "camera.json").is_file():
return candidate
if scene_dirs and len(scene_dirs[0].parents) >= 2:
return scene_dirs[0].parent.parent
return base
def _scene_split(scene_dir: pathlib.Path, root: pathlib.Path) -> str:
try:
rel_parts = scene_dir.relative_to(root).parts
except ValueError:
rel_parts = scene_dir.parts
return rel_parts[0] if len(rel_parts) >= 2 else ""
def _scene_id(scene_dir: pathlib.Path) -> str:
return scene_dir.name
def _sorted_image_ids(*payloads: Any, limit: int) -> list[str]:
ids: set[str] = set()
for payload in payloads:
if isinstance(payload, dict):
ids.update(str(key) for key in payload.keys())
def sort_key(value: str) -> tuple[int, int | str]:
try:
return (0, int(value))
except ValueError:
return (1, value)
return sorted(ids, key=sort_key)[:limit]
def _frame_stem(image_id: str) -> str:
try:
return f"{int(image_id):06d}"
except ValueError:
return image_id
def _first_file(scene_dir: pathlib.Path, prefixes: tuple[str, ...], stem: str) -> pathlib.Path | None:
candidate_dirs = [
child
for child in sorted(scene_dir.iterdir()) if child.is_dir() and any(child.name == prefix or child.name.startswith(f"{prefix}_") for prefix in prefixes)
]
for directory in candidate_dirs:
for suffix in IMAGE_SUFFIXES:
candidate = directory / f"{stem}{suffix}"
if candidate.is_file():
return candidate
return None
def _mask_file(scene_dir: pathlib.Path, prefix: str, image_id: str, annotation_index: int) -> pathlib.Path | None:
stem = f"{_frame_stem(image_id)}_{annotation_index:06d}"
return _first_file(scene_dir, (prefix,), stem)
def _is_finite_number(value: Any) -> bool:
return isinstance(value, (int, float)) and not isinstance(value, bool) and math.isfinite(float(value))
def _numeric_vector(value: Any, length: int) -> bool:
return isinstance(value, list) and len(value) == length and all(_is_finite_number(item) for item in value)
def _valid_bbox(value: Any) -> bool:
if not _numeric_vector(value, 4):
return False
return float(value[2]) >= 0 and float(value[3]) >= 0
def _image_camera_issues(payload: Any) -> list[dict[str, Any]]:
issues: list[dict[str, Any]] = []
if not isinstance(payload, dict):
return [{"code": "camera_entry_not_dict"}]
if not _numeric_vector(payload.get("cam_K"), 9):
issues.append({"code": "cam_k_invalid"})
if "depth_scale" in payload and (not _is_finite_number(payload.get("depth_scale")) or float(payload["depth_scale"]) <= 0):
issues.append({"code": "depth_scale_invalid"})
if "cam_R_w2c" in payload and not _numeric_vector(payload.get("cam_R_w2c"), 9):
issues.append({"code": "cam_r_w2c_invalid"})
if "cam_t_w2c" in payload and not _numeric_vector(payload.get("cam_t_w2c"), 3):
issues.append({"code": "cam_t_w2c_invalid"})
return issues
def _annotation_issues(payload: Any, *, require_object_pose: bool) -> list[dict[str, Any]]:
issues: list[dict[str, Any]] = []
if not isinstance(payload, dict):
return [{"code": "annotation_not_dict"}]
obj_id = payload.get("obj_id")
if not isinstance(obj_id, int) or isinstance(obj_id, bool) or obj_id <= 0:
issues.append({"code": "obj_id_invalid", "value": obj_id})
if require_object_pose:
if not _numeric_vector(payload.get("cam_R_m2c"), 9):
issues.append({"code": "cam_r_m2c_invalid"})
if not _numeric_vector(payload.get("cam_t_m2c"), 3):
issues.append({"code": "cam_t_m2c_invalid"})
if "obj_bb" in payload and not _valid_bbox(payload.get("obj_bb")):
issues.append({"code": "obj_bb_invalid"})
return issues
def _gt_info_issues(payload: Any) -> list[dict[str, Any]]:
issues: list[dict[str, Any]] = []
if not isinstance(payload, dict):
return [{"code": "gt_info_entry_not_dict"}]
for key in ("bbox_obj", "bbox_visib"):
if key in payload and not _valid_bbox(payload.get(key)):
issues.append({"code": f"{key}_invalid"})
for key in ("px_count_all", "px_count_valid", "px_count_visib"):
if key in payload and (not isinstance(payload.get(key), int) or isinstance(payload.get(key), bool) or payload[key] < 0):
issues.append({"code": f"{key}_invalid"})
if "visib_fract" in payload and (
not _is_finite_number(payload.get("visib_fract")) or float(payload["visib_fract"]) < 0 or float(payload["visib_fract"]) > 1
):
issues.append({"code": "visib_fract_invalid"})
return issues
def _scene_file_load(scene_dir: pathlib.Path, root: pathlib.Path, prefix: str, required: bool) -> tuple[pathlib.Path | None, Any, list[dict[str, Any]]]:
path = _json_file(scene_dir, prefix)
if path is None:
return None, {}, ([{"code": f"missing_{prefix}", "path": _relative(scene_dir / f"{prefix}.json", root)}] if required else [])
try:
payload = _load_json(path)
except RuntimeError as exc:
return path, {}, [{"code": f"{prefix}_json_invalid", "path": _relative(path, root), "message": str(exc)}]
if not isinstance(payload, dict):
return path, {}, [{"code": f"{prefix}_not_dict", "path": _relative(path, root)}]
return path, payload, []
def _validate_scene(
scene_dir: pathlib.Path,
root: pathlib.Path,
*,
max_images_per_scene: int,
check_image_files: bool,
check_depth_files: bool,
check_mask_files: bool,
require_scene_gt: bool,
require_scene_gt_info: bool,
require_object_pose: bool,
) -> dict[str, Any]:
scene_issues: list[dict[str, Any]] = []
camera_path, scene_camera, issues = _scene_file_load(scene_dir, root, "scene_camera", True)
scene_issues.extend(issues)
gt_path, scene_gt, issues = _scene_file_load(scene_dir, root, "scene_gt", require_scene_gt)
scene_issues.extend(issues)
gt_info_path, scene_gt_info, issues = _scene_file_load(scene_dir, root, "scene_gt_info", require_scene_gt_info)
scene_issues.extend(issues)
image_ids = _sorted_image_ids(scene_camera, scene_gt, scene_gt_info, limit=max_images_per_scene)
image_summaries: list[dict[str, Any]] = []
object_counts: dict[str, int] = {}
valid_image_count = 0
annotation_count = 0
image_asset_counts = {"rgbOrGray": 0, "depth": 0, "mask": 0, "maskVisib": 0}
for image_id in image_ids:
image_issues: list[dict[str, Any]] = []
camera_entry = scene_camera.get(image_id) if isinstance(scene_camera, dict) else None
if camera_entry is None:
image_issues.append({"code": "missing_scene_camera_entry", "imageId": image_id})
else:
image_issues.extend(_image_camera_issues(camera_entry))
annotations = scene_gt.get(image_id, []) if isinstance(scene_gt, dict) else []
if annotations is None:
annotations = []
if not isinstance(annotations, list):
image_issues.append({"code": "scene_gt_image_entry_not_list", "imageId": image_id})
annotations = []
gt_infos = scene_gt_info.get(image_id, []) if isinstance(scene_gt_info, dict) else []
if gt_infos is None:
gt_infos = []
if gt_infos and not isinstance(gt_infos, list):
image_issues.append({"code": "scene_gt_info_image_entry_not_list", "imageId": image_id})
gt_infos = []
if require_scene_gt_info and len(gt_infos) != len(annotations):
image_issues.append({"code": "scene_gt_info_count_mismatch", "imageId": image_id, "gtCount": len(annotations), "infoCount": len(gt_infos)})
frame_stem = _frame_stem(image_id)
rgb_path = _first_file(scene_dir, ("rgb", "gray"), frame_stem)
depth_path = _first_file(scene_dir, ("depth",), frame_stem)
if rgb_path is not None:
image_asset_counts["rgbOrGray"] += 1
elif check_image_files:
image_issues.append({"code": "missing_rgb_or_gray_file", "imageId": image_id, "path": f"rgb/{frame_stem}.png"})
if depth_path is not None:
image_asset_counts["depth"] += 1
elif check_depth_files:
image_issues.append({"code": "missing_depth_file", "imageId": image_id, "path": f"depth/{frame_stem}.png"})
for index, annotation in enumerate(annotations):
annotation_count += 1
image_issues.extend({**issue, "annotationIndex": index} for issue in _annotation_issues(annotation, require_object_pose=require_object_pose))
if isinstance(annotation, dict) and isinstance(annotation.get("obj_id"), int) and not isinstance(annotation.get("obj_id"), bool):
obj_id = str(annotation["obj_id"])
object_counts[obj_id] = object_counts.get(obj_id, 0) + 1
if check_mask_files:
mask_path = _mask_file(scene_dir, "mask", image_id, index)
mask_visib_path = _mask_file(scene_dir, "mask_visib", image_id, index)
if mask_path is not None:
image_asset_counts["mask"] += 1
else:
image_issues.append({"code": "missing_mask_file", "imageId": image_id, "annotationIndex": index})
if mask_visib_path is not None:
image_asset_counts["maskVisib"] += 1
else:
image_issues.append({"code": "missing_mask_visib_file", "imageId": image_id, "annotationIndex": index})
if index < len(gt_infos):
image_issues.extend({**issue, "annotationIndex": index} for issue in _gt_info_issues(gt_infos[index]))
if not image_issues:
valid_image_count += 1
image_summaries.append(
{
"imageId": image_id,
"frameStem": frame_stem,
"rgbOrGrayPath": _relative(rgb_path, root),
"depthPath": _relative(depth_path, root),
"annotationCount": len(annotations),
"valid": not image_issues,
"issueCount": len(image_issues),
"issues": image_issues,
}
)
valid = not scene_issues and all(item["valid"] for item in image_summaries)
return {
"split": _scene_split(scene_dir, root),
"sceneId": _scene_id(scene_dir),
"scenePath": _relative(scene_dir, root),
"sceneCameraPath": _relative(camera_path, root),
"sceneGtPath": _relative(gt_path, root),
"sceneGtInfoPath": _relative(gt_info_path, root),
"valid": valid,
"issueCount": len(scene_issues) + sum(int(item["issueCount"]) for item in image_summaries),
"issues": scene_issues,
"imageCount": len(image_ids),
"validImageCount": valid_image_count,
"annotationCount": annotation_count,
"objectCounts": object_counts,
"imageAssetCounts": image_asset_counts,
"images": image_summaries,
}
def _model_dirs(root: pathlib.Path) -> list[pathlib.Path]:
if not root.is_dir():
return []
return [path for path in sorted(root.iterdir()) if path.is_dir() and path.name.startswith("models")]
def _validate_models(root: pathlib.Path, required: bool, require_model_files: bool) -> tuple[list[dict[str, Any]], dict[str, Any]]:
issues: list[dict[str, Any]] = []
dirs = _model_dirs(root)
if required and not dirs:
issues.append({"code": "missing_models_dir", "path": "models"})
object_ids: set[str] = set()
model_files = 0
model_info_files = 0
for directory in dirs:
info_path = directory / "models_info.json"
if not info_path.is_file():
issues.append({"code": "missing_models_info", "path": _relative(info_path, root)})
continue
model_info_files += 1
try:
payload = _load_json(info_path)
except RuntimeError as exc:
issues.append({"code": "models_info_json_invalid", "path": _relative(info_path, root), "message": str(exc)})
continue
if not isinstance(payload, dict):
issues.append({"code": "models_info_not_dict", "path": _relative(info_path, root)})
continue
for obj_id, info in payload.items():
object_ids.add(str(obj_id))
if not isinstance(info, dict):
issues.append({"code": "model_info_entry_not_dict", "objectId": str(obj_id)})
continue
if "diameter" in info and (not _is_finite_number(info.get("diameter")) or float(info["diameter"]) <= 0):
issues.append({"code": "model_diameter_invalid", "objectId": str(obj_id)})
try:
model_path = directory / f"obj_{int(obj_id):06d}.ply"
except ValueError:
issues.append({"code": "model_object_id_not_integer", "objectId": str(obj_id)})
continue
if model_path.is_file():
model_files += 1
elif require_model_files:
issues.append({"code": "missing_model_ply", "objectId": str(obj_id), "path": _relative(model_path, root)})
return issues, {
"modelDirCount": len(dirs),
"modelInfoFileCount": model_info_files,
"modelFileCount": model_files,
"modelObjectCount": len(object_ids),
"modelObjectIds": sorted(object_ids, key=lambda value: (0, int(value)) if value.isdigit() else (1, value))[:200],
}
def _merge_counts(scenes: list[dict[str, Any]], key: str) -> dict[str, int]:
result: dict[str, int] = {}
for scene in scenes:
value = str(scene.get(key) or "")
if value:
result[value] = result.get(value, 0) + 1
return result
def _merge_object_counts(scenes: list[dict[str, Any]]) -> dict[str, int]:
result: dict[str, int] = {}
for scene in scenes:
for obj_id, count in (scene.get("objectCounts") or {}).items():
result[str(obj_id)] = result.get(str(obj_id), 0) + int(count)
return result
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("BOP 6D姿态数据集校验需要 SOURCE_PATH 指向真实 BOP 数据根目录、split/scene 目录或 scene_*.json 文件")
max_scenes = _positive_int(params, "MAX_SCENES", 20)
max_images_per_scene = _positive_int(params, "MAX_IMAGES_PER_SCENE", 200)
check_image_files = _bool_param(helpers, params, "CHECK_IMAGE_FILES", True)
check_depth_files = _bool_param(helpers, params, "CHECK_DEPTH_FILES", False)
check_mask_files = _bool_param(helpers, params, "CHECK_MASK_FILES", False)
require_scene_gt = _bool_param(helpers, params, "REQUIRE_SCENE_GT", True)
require_scene_gt_info = _bool_param(helpers, params, "REQUIRE_SCENE_GT_INFO", False)
require_models_info = _bool_param(helpers, params, "REQUIRE_MODELS_INFO", True)
require_model_files = _bool_param(helpers, params, "REQUIRE_MODEL_FILES", False)
require_object_pose = _bool_param(helpers, params, "REQUIRE_OBJECT_POSE", True)
scene_dirs = _find_scene_dirs(source_path, max_scenes)
if not scene_dirs:
raise RuntimeError(f"{source_path} does not contain BOP scene_camera*.json or scene_gt*.json scene directories")
root = _dataset_root(source_path, scene_dirs)
model_issues, models = _validate_models(root, require_models_info, require_model_files)
scenes = [
_validate_scene(
scene_dir,
root,
max_images_per_scene=max_images_per_scene,
check_image_files=check_image_files,
check_depth_files=check_depth_files,
check_mask_files=check_mask_files,
require_scene_gt=require_scene_gt,
require_scene_gt_info=require_scene_gt_info,
require_object_pose=require_object_pose,
)
for scene_dir in scene_dirs
]
scene_issues = [
{"code": "invalid_scene", "scenePath": scene["scenePath"], "issues": scene["issues"], "images": [image for image in scene["images"] if not image["valid"]]}
for scene in scenes
if not scene.get("valid")
]
issues = [*model_issues, *scene_issues]
payload = {
"datasetType": "bop-dataset-validation",
"sourcePath": str(source_path),
"datasetRoot": str(root),
"valid": not issues,
"issueCount": len(issues),
"issues": issues,
"sceneCount": len(scenes),
"validSceneCount": sum(1 for scene in scenes if scene.get("valid")),
"invalidSceneCount": sum(1 for scene in scenes if not scene.get("valid")),
"imageCount": sum(int(scene.get("imageCount") or 0) for scene in scenes),
"validImageCount": sum(int(scene.get("validImageCount") or 0) for scene in scenes),
"annotationCount": sum(int(scene.get("annotationCount") or 0) for scene in scenes),
"splitCounts": _merge_counts(scenes, "split"),
"objectCounts": _merge_object_counts(scenes),
"assets": {
"hasCameraJson": (root / "camera.json").is_file(),
**models,
},
"scenes": scenes,
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"bop-dataset-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,81 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bop-dataset-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bop-dataset-validate@sha256:6b99f50e0777e02df933fb196666f6bace7c251fcdfedf1630844525905d5c1b",
"metadata": "operator.json",
"name": "BOP 6D姿态数据集校验",
"operatorId": "operator-builtin-bop-dataset-validate",
"operatorSlug": "bop_dataset_validate",
"preferredSlug": "bop_dataset_validate",
"pythonImport": "backend.operators.builtin.bop_dataset_validate.operator:run",
"repositoryId": "builtin/bop_dataset_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_bop_dataset_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-bop-dataset-validate",
"operatorSlug": "bop_dataset_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"bop-scenewise-dataset-files",
"json-files",
"rgb-depth-mask-image-files",
"ply-model-files"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"bop-scenewise-dataset-files",
"json-files",
"rgb-depth-mask-image-files",
"ply-model-files"
],
"runtimeHandler": "builtin_bop_dataset_validate",
"runtimeSource": "backend/operators/builtin/bop_dataset_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/bop_dataset_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-bos-incremental-scan",
"name": "BOS 增量扫描",
"category": "IO",
"type": "builtin",
"runtimeHandler": "builtin_source",
"runtimeSource": "backend/operators/builtin/bos_incremental_scan/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,36 +0,0 @@
from __future__ import annotations
from typing import Any, Callable
from backend.operators.builtin.real_source import operator as real_source_operator
HelperMap = dict[str, Callable[..., Any]]
def with_forced_hyperparams(node_data: dict[str, Any]) -> dict[str, Any]:
updated = {**node_data}
hyperparams = [
item
for item in list(node_data.get("hyperparams", []) or [])
if str(item.get("key", "")).strip() not in {"DATA_SOURCE", "SCAN_MODE"}
]
hyperparams.extend(
[
{"key": "DATA_SOURCE", "value": "BOS"},
{"key": "SCAN_MODE", "value": "INCREMENTAL"},
]
)
updated["hyperparams"] = hyperparams
return updated
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
return real_source_operator.run(run_id, node_id, output_dir, with_forced_hyperparams(node_data), inputs, helpers)

View File

@ -1,77 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "IO",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bos-incremental-scan:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bos-incremental-scan@sha256:75a5c7d013b115d12c21c8ca2b64bce418802cbb9eed118c1be6074f043ae1fd",
"metadata": "operator.json",
"name": "BOS 增量扫描",
"operatorId": "operator-builtin-bos-incremental-scan",
"operatorSlug": "bos_incremental_scan",
"preferredSlug": "bos_incremental_scan",
"pythonImport": "backend.operators.builtin.bos_incremental_scan.operator:run",
"repositoryId": "builtin/bos_incremental_scan",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_source",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-bos-incremental-scan",
"operatorSlug": "bos_incremental_scan",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"baidu-bos"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"baidu-bos"
],
"runtimeHandler": "builtin_source",
"runtimeSource": "backend/operators/builtin/bos_incremental_scan/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/bos_incremental_scan",
"strictPocAcceptanceExternals": [
"bos"
],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-bridgedata-tfds-manifest-validate",
"name": "BridgeData TFDS-RLDS清单校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_bridgedata_tfds_manifest_validate",
"runtimeSource": "backend/operators/builtin/bridgedata_tfds_manifest_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,293 +0,0 @@
from __future__ import annotations
import json
import pathlib
import struct
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
DEFAULT_MAX_RECORDS = 200_000
DEFAULT_MAX_FILES = 100
MASK_DELTA = 0xA282EAD8
CRC32C_POLY = 0x82F63B78
TFRECORD_SUFFIXES = {".tfrecord", ".tfrecords", ".tfrec"}
def _crc32c_table() -> list[int]:
table: list[int] = []
for index in range(256):
crc = index
for _ in range(8):
if crc & 1:
crc = (crc >> 1) ^ CRC32C_POLY
else:
crc >>= 1
table.append(crc & 0xFFFFFFFF)
return table
CRC32C_TABLE = _crc32c_table()
def _crc32c(data: bytes) -> int:
checksum = 0xFFFFFFFF
for item in data:
checksum = CRC32C_TABLE[(checksum ^ item) & 0xFF] ^ (checksum >> 8)
return (~checksum) & 0xFFFFFFFF
def _masked_crc32c(data: bytes) -> int:
value = _crc32c(data)
return (((value >> 15) | ((value << 17) & 0xFFFFFFFF)) + MASK_DELTA) & 0xFFFFFFFF
def _positive_int(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, "") or "").strip()
if not raw:
return default
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _field_tokens(raw: str, default: tuple[str, ...]) -> list[str]:
tokens = [item.strip().lower() for item in str(raw or "").split(",") if item.strip()]
return tokens or list(default)
def _load_json(path: pathlib.Path) -> Any:
with path.open("r", encoding="utf-8") as handle:
return json.load(handle)
def _optional_json(path: pathlib.Path) -> dict[str, Any]:
if not path.is_file():
return {}
payload = _load_json(path)
return payload if isinstance(payload, dict) else {}
def _find_tfrecord_files(path: pathlib.Path, max_files: int) -> list[pathlib.Path]:
if path.is_file():
return [path] if path.suffix.lower() in TFRECORD_SUFFIXES else []
return sorted(candidate for candidate in path.rglob("*") if candidate.is_file() and candidate.suffix.lower() in TFRECORD_SUFFIXES)[:max_files]
def _relative(root: pathlib.Path, path: pathlib.Path) -> str:
try:
return path.relative_to(root).as_posix()
except ValueError:
return str(path)
def _flatten_keys(value: Any, prefix: str = "") -> set[str]:
keys: set[str] = set()
if isinstance(value, dict):
for key, item in value.items():
path = f"{prefix}.{key}" if prefix else str(key)
keys.add(path)
keys.update(_flatten_keys(item, path))
elif isinstance(value, list):
for index, item in enumerate(value[:20]):
path = f"{prefix}[{index}]" if prefix else f"[{index}]"
keys.update(_flatten_keys(item, path))
return keys
def _normalized(value: str) -> str:
return value.lower().replace("/", ".").replace("_", ".").replace("-", ".")
def _has_token(feature_keys: set[str], tokens: list[str]) -> bool:
normalized_keys = [_normalized(key) for key in feature_keys]
for token in tokens:
normalized_token = _normalized(token)
if any(normalized_token in key for key in normalized_keys):
return True
return False
def _decode_preview(data: bytes) -> dict[str, Any]:
stripped = data.strip()
if not stripped:
return {"encoding": "empty", "preview": ""}
try:
parsed = json.loads(stripped.decode("utf-8"))
except Exception:
return {"encoding": "bytes", "preview": stripped[:160].decode("utf-8", errors="replace"), "sizeBytes": len(data)}
return {"encoding": "json", "preview": parsed}
def _scan_tfrecord(path: pathlib.Path, root: pathlib.Path, max_records: int, preview_records: int) -> dict[str, Any]:
issues: list[dict[str, Any]] = []
records: list[dict[str, Any]] = []
count = 0
total_payload_bytes = 0
offset = 0
with path.open("rb") as handle:
while count < max_records:
header = handle.read(12)
if not header:
break
if len(header) != 12:
issues.append({"code": "truncated_length_header", "offset": offset, "bytes": len(header)})
break
length = struct.unpack("<Q", header[:8])[0]
stored_length_crc = struct.unpack("<I", header[8:12])[0]
expected_length_crc = _masked_crc32c(header[:8])
if stored_length_crc != expected_length_crc:
issues.append({"code": "length_crc_mismatch", "offset": offset, "stored": stored_length_crc, "expected": expected_length_crc})
payload = handle.read(length)
if len(payload) != length:
issues.append({"code": "truncated_payload", "offset": offset + 12, "expected": length, "actual": len(payload)})
break
data_crc = handle.read(4)
if len(data_crc) != 4:
issues.append({"code": "truncated_payload_crc", "offset": offset + 12 + length, "bytes": len(data_crc)})
break
stored_data_crc = struct.unpack("<I", data_crc)[0]
expected_data_crc = _masked_crc32c(payload)
if stored_data_crc != expected_data_crc:
issues.append({"code": "payload_crc_mismatch", "offset": offset, "stored": stored_data_crc, "expected": expected_data_crc})
if len(records) < preview_records:
records.append({"index": count, "offset": offset, "length": length, **_decode_preview(payload)})
total_payload_bytes += int(length)
count += 1
offset += 12 + int(length) + 4
split = "unknown"
lower = _relative(root, path).lower()
for candidate in ("train", "validation", "val", "test"):
if candidate in lower:
split = "validation" if candidate == "val" else candidate
break
return {
"path": _relative(root, path),
"split": split,
"fileSizeBytes": path.stat().st_size,
"recordCount": count,
"totalPayloadBytes": total_payload_bytes,
"valid": not issues,
"issues": issues,
"records": records,
}
def _split_summary(dataset_info: dict[str, Any]) -> dict[str, int]:
splits = dataset_info.get("splits")
result: dict[str, int] = {}
if isinstance(splits, dict):
for key, value in splits.items():
if isinstance(value, dict):
count = value.get("numExamples") or value.get("num_examples") or value.get("shardLengths")
if isinstance(count, list):
result[str(key)] = sum(int(item) for item in count if isinstance(item, (int, float)))
elif isinstance(count, (int, float)):
result[str(key)] = int(count)
else:
result[str(key)] = 0
elif isinstance(value, (int, float)):
result[str(key)] = int(value)
elif isinstance(splits, list):
for item in splits:
if not isinstance(item, dict):
continue
name = str(item.get("name") or item.get("split") or "").strip()
if not name:
continue
count = item.get("numExamples") or item.get("num_examples")
result[name] = int(count) if isinstance(count, (int, float)) else 0
return result
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("BridgeData TFDS-RLDS 清单校验需要 SOURCE_PATH 指向真实 TFDS/RLDS 目录或 TFRecord 文件")
root = source_path if source_path.is_dir() else source_path.parent
max_files = _positive_int(params, "MAX_FILES", DEFAULT_MAX_FILES)
max_records = _positive_int(params, "MAX_RECORDS", DEFAULT_MAX_RECORDS)
preview_records = _positive_int(params, "PREVIEW_RECORDS", 3)
image_tokens = _field_tokens(params.get("IMAGE_FIELD_TOKENS", ""), ("image", "observation.image", "observation.images"))
action_tokens = _field_tokens(params.get("ACTION_FIELD_TOKENS", ""), ("action",))
language_tokens = _field_tokens(params.get("LANGUAGE_FIELD_TOKENS", ""), ("language_instruction", "natural_language_instruction", "instruction"))
dataset_info = _optional_json(root / "dataset_info.json")
features = _optional_json(root / "features.json")
feature_source: dict[str, Any] = {}
if isinstance(dataset_info.get("features"), dict):
feature_source["dataset_info.features"] = dataset_info["features"]
if features:
feature_source["features.json"] = features
if isinstance(dataset_info.get("schema"), dict):
feature_source["dataset_info.schema"] = dataset_info["schema"]
feature_keys = _flatten_keys(feature_source)
files = _find_tfrecord_files(source_path, max_files)
file_summaries = [_scan_tfrecord(path, root, max_records, preview_records) for path in files]
split_counts: dict[str, int] = {}
for item in file_summaries:
split_counts[item["split"]] = split_counts.get(item["split"], 0) + int(item["recordCount"])
issues: list[dict[str, Any]] = []
warnings: list[dict[str, Any]] = []
if not dataset_info:
warnings.append({"code": "missing_dataset_info_json"})
if not feature_keys:
issues.append({"code": "missing_feature_metadata", "paths": ["dataset_info.json", "features.json"]})
if not files:
issues.append({"code": "missing_tfrecord_shards", "path": str(source_path)})
if file_summaries and sum(int(item["recordCount"]) for item in file_summaries) == 0:
issues.append({"code": "empty_tfrecord_shards"})
if not _has_token(feature_keys, image_tokens):
issues.append({"code": "missing_image_feature", "tokens": image_tokens})
if not _has_token(feature_keys, action_tokens):
issues.append({"code": "missing_action_feature", "tokens": action_tokens})
if not _has_token(feature_keys, language_tokens):
issues.append({"code": "missing_language_feature", "tokens": language_tokens})
corrupt_files = [item for item in file_summaries if not item["valid"]]
if corrupt_files:
issues.append({"code": "invalid_tfrecord_crc_or_framing", "count": len(corrupt_files), "examples": corrupt_files[:20]})
payload = {
"datasetType": "bridgedata-tfds-rlds-manifest-validation",
"sourcePath": str(source_path),
"valid": not issues,
"issueCount": len(issues),
"warningCount": len(warnings),
"issues": issues,
"warnings": warnings,
"datasetInfoPresent": bool(dataset_info),
"featureMetadataPresent": bool(feature_keys),
"featureKeys": sorted(feature_keys)[:500],
"declaredSplits": _split_summary(dataset_info),
"fileCount": len(files),
"recordCount": sum(int(item["recordCount"]) for item in file_summaries),
"splitRecordCounts": split_counts,
"files": file_summaries,
"requiredFeatureTokens": {
"image": image_tokens,
"action": action_tokens,
"language": language_tokens,
},
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"bridgedata-tfds-rlds-manifest-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,79 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bridgedata-tfds-manifest-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-bridgedata-tfds-manifest-validate@sha256:18c89efc04d3ca65154c07851231c16953900016178d6183041850e6e7f7e2a0",
"metadata": "operator.json",
"name": "BridgeData TFDS-RLDS清单校验",
"operatorId": "operator-builtin-bridgedata-tfds-manifest-validate",
"operatorSlug": "bridgedata_tfds_manifest_validate",
"preferredSlug": "bridgedata_tfds_manifest_validate",
"pythonImport": "backend.operators.builtin.bridgedata_tfds_manifest_validate.operator:run",
"repositoryId": "builtin/bridgedata_tfds_manifest_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_bridgedata_tfds_manifest_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-bridgedata-tfds-manifest-validate",
"operatorSlug": "bridgedata_tfds_manifest_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"bridgedata-tfds-rlds-directory",
"tfrecord-files",
"crc32c-structural-validation"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"bridgedata-tfds-rlds-directory",
"tfrecord-files",
"crc32c-structural-validation"
],
"runtimeHandler": "builtin_bridgedata_tfds_manifest_validate",
"runtimeSource": "backend/operators/builtin/bridgedata_tfds_manifest_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/bridgedata_tfds_manifest_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-calvin-episode-validate",
"name": "CALVIN Episode 校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_calvin_episode_validate",
"runtimeSource": "backend/operators/builtin/calvin_episode_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,180 +0,0 @@
from __future__ import annotations
import pathlib
from typing import Any, Callable
import numpy as np
HelperMap = dict[str, Callable[..., Any]]
DEFAULT_REQUIRED_ARRAYS = ("actions", "rel_actions", "robot_obs", "scene_obs", "rgb_static", "rgb_gripper")
def _int_param(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, str(default)) or str(default)).strip()
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _field_list(raw: str, default: tuple[str, ...]) -> list[str]:
values = [item.strip() for item in str(raw or "").split(",") if item.strip()]
return values or list(default)
def _find_episode_files(source_path: pathlib.Path, max_files: int) -> list[pathlib.Path]:
if source_path.is_file() and source_path.suffix.lower() == ".npz":
return [source_path]
if not source_path.is_dir():
return []
preferred = sorted(source_path.glob("episode_*.npz"))
files = preferred or sorted(source_path.rglob("episode_*.npz"))
if not files:
files = sorted(source_path.rglob("*.npz"))
return [path for path in files if path.is_file()][:max_files]
def _find_language_files(source_path: pathlib.Path) -> list[pathlib.Path]:
if source_path.is_file():
source_path = source_path.parent
if not source_path.is_dir():
return []
candidates = [
source_path / "lang_annotations" / "auto_lang_ann.npy",
source_path / "lang_annotations" / "auto_lang_ann.json",
source_path / "language_annotations.npy",
]
result = [path for path in candidates if path.is_file()]
result.extend(path for path in sorted(source_path.rglob("*lang*ann*.npy")) if path.is_file() and path not in result)
return result
def _relative(path: pathlib.Path, root: pathlib.Path) -> str:
try:
return path.relative_to(root).as_posix()
except ValueError:
return str(path)
def _array_shape(arrays: np.lib.npyio.NpzFile, key: str) -> list[int]:
value = arrays[key]
return [int(item) for item in value.shape]
def _is_finite_numeric(array: np.ndarray) -> bool:
if not np.issubdtype(array.dtype, np.number):
return True
return bool(np.isfinite(array).all())
def _validate_episode(path: pathlib.Path, root: pathlib.Path, required_arrays: list[str]) -> dict[str, Any]:
issues: list[dict[str, Any]] = []
shapes: dict[str, list[int]] = {}
dtypes: dict[str, str] = {}
with np.load(path, allow_pickle=False) as arrays:
keys = sorted(arrays.files)
for key in required_arrays:
if key not in arrays.files:
issues.append({"code": "missing_required_array", "array": key})
continue
shapes[key] = _array_shape(arrays, key)
dtypes[key] = str(arrays[key].dtype)
if not _is_finite_numeric(arrays[key]):
issues.append({"code": "non_finite_array_values", "array": key})
for image_key in ("rgb_static", "rgb_gripper"):
if image_key in arrays.files:
shape = _array_shape(arrays, image_key)
if len(shape) not in {3, 4}:
issues.append({"code": "invalid_rgb_array_shape", "array": image_key, "shape": shape})
for action_key in ("actions", "rel_actions"):
if action_key in arrays.files:
shape = _array_shape(arrays, action_key)
if not shape:
issues.append({"code": "invalid_action_array_shape", "array": action_key, "shape": shape})
return {
"path": _relative(path, root),
"valid": not issues,
"issueCount": len(issues),
"issues": issues,
"arrayKeys": keys,
"shapes": shapes,
"dtypes": dtypes,
}
def _language_summary(paths: list[pathlib.Path]) -> dict[str, Any]:
if not paths:
return {"languageFileCount": 0, "annotationCount": 0, "files": []}
files: list[dict[str, Any]] = []
annotation_count = 0
for path in paths:
count = 0
if path.suffix.lower() == ".npy":
try:
payload = np.load(path, allow_pickle=True).item()
if isinstance(payload, dict):
language = payload.get("language")
if isinstance(language, dict):
ann = language.get("ann")
if isinstance(ann, (list, tuple, np.ndarray)):
count = len(ann)
except Exception:
count = 0
annotation_count += count
files.append({"path": str(path), "annotationCount": count})
return {"languageFileCount": len(paths), "annotationCount": annotation_count, "files": files}
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("CALVIN Episode 校验需要 SOURCE_PATH 指向真实 CALVIN .npz episode 目录")
max_files = _int_param(params, "MAX_FILES", 500)
required_arrays = _field_list(params.get("REQUIRED_ARRAYS", ""), DEFAULT_REQUIRED_ARRAYS)
episode_files = _find_episode_files(source_path, max_files)
if not episode_files:
raise RuntimeError(f"{source_path} does not contain CALVIN episode .npz files")
root = source_path if source_path.is_dir() else source_path.parent
episodes = [_validate_episode(path, root, required_arrays) for path in episode_files]
invalid = [item for item in episodes if not item["valid"]]
language = _language_summary(_find_language_files(root))
issues: list[dict[str, Any]] = []
if invalid:
issues.append({"code": "invalid_calvin_episodes", "count": len(invalid), "examples": invalid[:50]})
payload = {
"datasetType": "calvin-episode-validation",
"sourcePath": str(source_path),
"valid": not issues,
"issueCount": len(issues),
"issues": issues,
"requiredArrays": required_arrays,
"episodeCount": len(episodes),
"validEpisodeCount": len(episodes) - len(invalid),
"invalidEpisodeCount": len(invalid),
"languageAnnotationCount": int(language["annotationCount"]),
"languageFileCount": int(language["languageFileCount"]),
"languageFiles": language["files"],
"episodes": episodes,
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"calvin-episode-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,79 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-calvin-episode-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-calvin-episode-validate@sha256:bc90a289bb258dc0f74fd1a33d2baa5ca53182e78eed23c42106205325ae9a48",
"metadata": "operator.json",
"name": "CALVIN Episode 校验",
"operatorId": "operator-builtin-calvin-episode-validate",
"operatorSlug": "calvin_episode_validate",
"preferredSlug": "calvin_episode_validate",
"pythonImport": "backend.operators.builtin.calvin_episode_validate.operator:run",
"repositoryId": "builtin/calvin_episode_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_calvin_episode_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-calvin-episode-validate",
"operatorSlug": "calvin_episode_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"calvin-episode-npz-files",
"numpy",
"language-annotation-files"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"calvin-episode-npz-files",
"numpy",
"language-annotation-files"
],
"runtimeHandler": "builtin_calvin_episode_validate",
"runtimeSource": "backend/operators/builtin/calvin_episode_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/calvin_episode_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-camera-calibration-validate",
"name": "相机标定校验",
"category": "ROBOTICS",
"type": "builtin",
"runtimeHandler": "builtin_camera_calibration_validate",
"runtimeSource": "backend/operators/builtin/camera_calibration_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,188 +0,0 @@
from __future__ import annotations
import json
import math
import pathlib
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
CALIBRATION_NAMES = (
"camera_info.json",
"camera_info.yaml",
"calibration.json",
"calibration.yaml",
"intrinsics.json",
"intrinsics.yaml",
)
def _load_yaml_or_json(path: pathlib.Path) -> dict[str, Any]:
if path.suffix.lower() == ".json":
try:
payload = json.loads(path.read_text(encoding="utf-8"))
except json.JSONDecodeError as exc:
raise RuntimeError(f"{path} is not valid JSON") from exc
else:
try:
import yaml # type: ignore
except Exception as exc: # pragma: no cover - runtime dependency check
raise RuntimeError("相机标定校验需要 PyYAML 以读取 YAML 标定文件") from exc
payload = yaml.safe_load(path.read_text(encoding="utf-8"))
if not isinstance(payload, dict):
raise RuntimeError(f"{path} must contain an object")
return payload
def _find_calibration_files(source_path: pathlib.Path) -> list[pathlib.Path]:
if source_path.is_file():
return [source_path]
files: list[pathlib.Path] = []
for name in CALIBRATION_NAMES:
candidate = source_path / name
if candidate.is_file():
files.append(candidate)
if files:
return files
return sorted(
candidate
for candidate in source_path.rglob("*")
if candidate.is_file()
and candidate.suffix.lower() in {".json", ".yaml", ".yml"}
and any(token in candidate.name.lower() for token in ("camera", "calib", "intrinsic"))
)
def _as_number_list(value: Any) -> list[float]:
if isinstance(value, dict) and "data" in value:
value = value["data"]
if isinstance(value, (int, float)):
return [float(value)]
if isinstance(value, list):
numbers: list[float] = []
for item in value:
if isinstance(item, list):
numbers.extend(_as_number_list(item))
elif isinstance(item, (int, float)):
numbers.append(float(item))
return numbers
return []
def _matrix(payload: dict[str, Any], keys: tuple[str, ...], expected: int) -> list[float]:
for key in keys:
value = payload.get(key)
numbers = _as_number_list(value)
if numbers:
return numbers
if "camera_matrix" in payload:
numbers = _as_number_list(payload["camera_matrix"])
if numbers:
return numbers
return []
def _positive_int(payload: dict[str, Any], *keys: str) -> int:
for key in keys:
value = payload.get(key)
if isinstance(value, int):
return value
if isinstance(value, float) and value.is_integer():
return int(value)
if isinstance(value, str) and value.isdigit():
return int(value)
return 0
def _finite(values: list[float]) -> bool:
return all(math.isfinite(value) for value in values)
def _validate_file(root: pathlib.Path, path: pathlib.Path) -> dict[str, Any]:
payload = _load_yaml_or_json(path)
intrinsics = _matrix(payload, ("K", "k", "intrinsic", "intrinsics", "cameraMatrix"), 9)
projection = _matrix(payload, ("P", "p", "projection", "projection_matrix"), 12)
rectification = _matrix(payload, ("R", "r", "rectification", "rectification_matrix"), 9)
distortion = _matrix(payload, ("D", "d", "distortion", "distortion_coefficients"), 0)
extrinsic = _matrix(payload, ("T_camera_robot", "T_base_camera", "extrinsic", "extrinsics", "transform"), 16)
width = _positive_int(payload, "width", "image_width", "imageWidth")
height = _positive_int(payload, "height", "image_height", "imageHeight")
issues: list[dict[str, Any]] = []
if len(intrinsics) != 9:
issues.append({"code": "missing_or_invalid_intrinsics", "expectedLength": 9, "actualLength": len(intrinsics)})
elif not _finite(intrinsics) or intrinsics[0] <= 0 or intrinsics[4] <= 0:
issues.append({"code": "invalid_focal_length"})
if projection and len(projection) != 12:
issues.append({"code": "invalid_projection_matrix", "expectedLength": 12, "actualLength": len(projection)})
if rectification and len(rectification) != 9:
issues.append({"code": "invalid_rectification_matrix", "expectedLength": 9, "actualLength": len(rectification)})
if extrinsic and len(extrinsic) != 16:
issues.append({"code": "invalid_extrinsic_matrix", "expectedLength": 16, "actualLength": len(extrinsic)})
if distortion and not _finite(distortion):
issues.append({"code": "invalid_distortion_values"})
if width <= 0 or height <= 0:
issues.append({"code": "missing_or_invalid_image_size", "width": width, "height": height})
return {
"path": str(path.relative_to(root) if path.is_relative_to(root) else path),
"valid": len(issues) == 0,
"issues": issues,
"width": width,
"height": height,
"intrinsics": intrinsics,
"distortionLength": len(distortion),
"hasProjection": bool(projection),
"hasRectification": bool(rectification),
"hasExtrinsic": bool(extrinsic),
}
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("相机标定校验需要 SOURCE_PATH 或上游 artifact 指向真实 JSON/YAML 标定文件")
max_files = int(str(params.get("MAX_FILES", "50") or "50"))
if max_files <= 0:
raise RuntimeError("MAX_FILES must be > 0")
files = _find_calibration_files(source_path)[:max_files]
if not files:
raise RuntimeError(f"{source_path} does not contain camera calibration files")
root = source_path if source_path.is_dir() else source_path.parent
cameras = [_validate_file(root, path) for path in files]
invalid = [camera for camera in cameras if not camera["valid"]]
issue_counts: dict[str, int] = {}
for camera in invalid:
for issue in camera["issues"]:
code = str(issue.get("code", "unknown"))
issue_counts[code] = issue_counts.get(code, 0) + 1
payload = {
"datasetType": "camera-calibration-validation",
"sourcePath": str(source_path),
"valid": len(invalid) == 0,
"issueCount": sum(issue_counts.values()),
"issueCounts": dict(sorted(issue_counts.items())),
"cameraCount": len(cameras),
"invalidCameraCount": len(invalid),
"cameras": cameras,
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"camera-calibration-validation.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,79 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "ROBOTICS",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-camera-calibration-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-camera-calibration-validate@sha256:b43c83210cdd287d8234ff4e137586b1e5d671945ef72308246e9cceb8d7cae7",
"metadata": "operator.json",
"name": "相机标定校验",
"operatorId": "operator-builtin-camera-calibration-validate",
"operatorSlug": "camera_calibration_validate",
"preferredSlug": "camera_calibration_validate",
"pythonImport": "backend.operators.builtin.camera_calibration_validate.operator:run",
"repositoryId": "builtin/camera_calibration_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_camera_calibration_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-camera-calibration-validate",
"operatorSlug": "camera_calibration_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"camera-calibration-files",
"json-files",
"optional-yaml-files"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"camera-calibration-files",
"json-files",
"optional-yaml-files"
],
"runtimeHandler": "builtin_camera_calibration_validate",
"runtimeSource": "backend/operators/builtin/camera_calibration_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/camera_calibration_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-coco-annotation-validate",
"name": "COCO 标注校验",
"category": "DATASET",
"type": "builtin",
"runtimeHandler": "builtin_coco_annotation_validate",
"runtimeSource": "backend/operators/builtin/coco_annotation_validate/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,170 +0,0 @@
from __future__ import annotations
import json
import pathlib
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
IMAGE_SUFFIXES = {".jpg", ".jpeg", ".png", ".bmp", ".webp"}
def _int_param(params: dict[str, str], key: str, default: int) -> int:
raw = str(params.get(key, str(default)) or str(default)).strip()
try:
value = int(raw)
except ValueError as exc:
raise RuntimeError(f"{key} must be an integer") from exc
if value <= 0:
raise RuntimeError(f"{key} must be > 0")
return value
def _find_annotation_file(source_path: pathlib.Path) -> pathlib.Path | None:
if source_path.is_file() and source_path.suffix.lower() == ".json":
return source_path
preferred = sorted((source_path / "annotations").glob("*.json")) if source_path.is_dir() else []
if preferred:
return preferred[0]
candidates = sorted(source_path.rglob("*.json")) if source_path.is_dir() else []
return candidates[0] if candidates else None
def _image_roots(source_path: pathlib.Path, annotation_path: pathlib.Path, params: dict[str, str]) -> list[pathlib.Path]:
roots: list[pathlib.Path] = []
image_root = str(params.get("IMAGE_ROOT", "") or "").strip()
if image_root:
roots.append(pathlib.Path(image_root).expanduser())
base = source_path if source_path.is_dir() else source_path.parent
roots.extend([base / "images", annotation_path.parent.parent / "images", annotation_path.parent, base])
unique: list[pathlib.Path] = []
seen: set[str] = set()
for root in roots:
key = str(root.resolve()) if root.exists() else str(root)
if key not in seen:
seen.add(key)
unique.append(root)
return unique
def _resolve_image(file_name: str, roots: list[pathlib.Path]) -> pathlib.Path | None:
value = str(file_name or "").strip()
if not value:
return None
candidate = pathlib.Path(value)
if candidate.is_absolute() and candidate.exists():
return candidate
for root in roots:
resolved = root / value
if resolved.exists():
return resolved
return None
def _bbox_issue(annotation: dict[str, Any], image: dict[str, Any]) -> str:
bbox = annotation.get("bbox")
if not isinstance(bbox, list) or len(bbox) != 4:
return "invalid_bbox_shape"
try:
x, y, width, height = (float(item) for item in bbox)
except (TypeError, ValueError):
return "invalid_bbox_number"
if width <= 0 or height <= 0:
return "non_positive_bbox"
image_width = float(image.get("width") or 0)
image_height = float(image.get("height") or 0)
if image_width > 0 and image_height > 0:
if x < 0 or y < 0 or x + width > image_width + 1e-6 or y + height > image_height + 1e-6:
return "bbox_outside_image"
return ""
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("COCO 标注校验需要 SOURCE_PATH 指向 annotations JSON 或数据集目录")
max_issues = _int_param(params, "MAX_ISSUES", 100)
annotation_path = _find_annotation_file(source_path)
if annotation_path is None:
raise RuntimeError(f"{source_path} does not contain COCO annotation json")
payload = json.loads(annotation_path.read_text(encoding="utf-8"))
if not isinstance(payload, dict):
raise RuntimeError(f"{annotation_path} is not a COCO object")
images = payload.get("images", [])
annotations = payload.get("annotations", [])
categories = payload.get("categories", [])
if not isinstance(images, list) or not isinstance(annotations, list) or not isinstance(categories, list):
raise RuntimeError("COCO payload must contain images, annotations, and categories arrays")
image_by_id = {item.get("id"): item for item in images if isinstance(item, dict)}
category_by_id = {item.get("id"): item for item in categories if isinstance(item, dict)}
roots = _image_roots(source_path, annotation_path, params)
existing_images = 0
missing_images: list[dict[str, Any]] = []
for image in image_by_id.values():
resolved = _resolve_image(str(image.get("file_name", "")), roots)
if resolved is None:
missing_images.append({"id": image.get("id"), "fileName": image.get("file_name", "")})
else:
existing_images += 1
annotation_issues: list[dict[str, Any]] = []
class_counts: dict[str, int] = {}
segmentation_count = 0
for annotation in annotations:
if not isinstance(annotation, dict):
annotation_issues.append({"code": "invalid_annotation_object"})
continue
image = image_by_id.get(annotation.get("image_id"))
category = category_by_id.get(annotation.get("category_id"))
if image is None:
annotation_issues.append({"code": "unknown_image_id", "annotationId": annotation.get("id")})
continue
if category is None:
annotation_issues.append({"code": "unknown_category_id", "annotationId": annotation.get("id")})
bbox_code = _bbox_issue(annotation, image)
if bbox_code:
annotation_issues.append({"code": bbox_code, "annotationId": annotation.get("id"), "imageId": image.get("id")})
category_name = str((category or {}).get("name") or annotation.get("category_id"))
class_counts[category_name] = class_counts.get(category_name, 0) + 1
if annotation.get("segmentation"):
segmentation_count += 1
issues = []
if missing_images:
issues.append({"code": "missing_image_files", "count": len(missing_images), "examples": missing_images[:max_issues]})
if annotation_issues:
issues.append({"code": "invalid_annotations", "count": len(annotation_issues), "examples": annotation_issues[:max_issues]})
result = {
"datasetType": "coco-annotation-validation",
"sourcePath": str(source_path),
"annotationPath": str(annotation_path),
"valid": not issues,
"issueCount": len(issues),
"issues": issues,
"imageCount": len(image_by_id),
"existingImageCount": existing_images,
"missingImageCount": len(missing_images),
"annotationCount": len(annotations),
"categoryCount": len(category_by_id),
"segmentationAnnotationCount": segmentation_count,
"classCounts": class_counts,
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"coco-annotation-validation.json",
result,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,77 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "DATASET",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-coco-annotation-validate:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-coco-annotation-validate@sha256:538e5ffdc881f6f93ae55b84c216b57954bbf662a1d1a34588ed4981eb8ab57d",
"metadata": "operator.json",
"name": "COCO 标注校验",
"operatorId": "operator-builtin-coco-annotation-validate",
"operatorSlug": "coco_annotation_validate",
"preferredSlug": "coco_annotation_validate",
"pythonImport": "backend.operators.builtin.coco_annotation_validate.operator:run",
"repositoryId": "builtin/coco_annotation_validate",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_coco_annotation_validate",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-coco-annotation-validate",
"operatorSlug": "coco_annotation_validate",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"coco-json",
"image-files"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"coco-json",
"image-files"
],
"runtimeHandler": "builtin_coco_annotation_validate",
"runtimeSource": "backend/operators/builtin/coco_annotation_validate/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/coco_annotation_validate",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-conditional-route",
"name": "条件分流",
"category": "LOGIC",
"type": "builtin",
"runtimeHandler": "builtin_condition_router",
"runtimeSource": "backend/operators/builtin/conditional_route/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,55 +0,0 @@
from __future__ import annotations
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
field_path = params.get("FIELD_PATH", "").strip()
operator = helpers["normalize_comparison_operator"](params.get("OPERATOR", "eq"))
expected = helpers["parse_json_param"](params, "EXPECTED_JSON", params.get("EXPECTED", ""))
rows = helpers["collect_items"](helpers["payloads_from_inputs"](inputs))
matched = [
row
for row in rows
if helpers["compare_values"](helpers["get_field_value"](row, field_path), operator, expected)
]
unmatched = [
row
for row in rows
if not helpers["compare_values"](helpers["get_field_value"](row, field_path), operator, expected)
]
outputs = node_data.get("outputs", []) or [
{"id": "matched", "name": "matched", "type": "json"},
{"id": "unmatched", "name": "unmatched", "type": "json"},
]
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
f"{str(outputs[0].get('name', 'matched')).strip() or 'matched'}.json",
{"fieldPath": field_path, "operator": operator, "expected": expected, "items": matched, "count": len(matched)},
str(outputs[0].get("type", "json")),
output=outputs[0],
),
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
f"{str(outputs[1].get('name', 'unmatched')).strip() or 'unmatched'}.json",
{"fieldPath": field_path, "operator": operator, "expected": expected, "items": unmatched, "count": len(unmatched)},
str(outputs[1].get("type", "json")),
output=outputs[1],
),
]

View File

@ -1,75 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "LOGIC",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-conditional-route:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-conditional-route@sha256:0de386aacb81c0658bac316e50689d3fa56bc7403865ce3237262e1dda0ff5a4",
"metadata": "operator.json",
"name": "条件分流",
"operatorId": "operator-builtin-conditional-route",
"operatorSlug": "conditional_route",
"preferredSlug": "conditional_route",
"pythonImport": "backend.operators.builtin.conditional_route.operator:run",
"repositoryId": "builtin/conditional_route",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_condition_router",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-conditional-route",
"operatorSlug": "conditional_route",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"json-artifacts"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"json-artifacts"
],
"runtimeHandler": "builtin_condition_router",
"runtimeSource": "backend/operators/builtin/conditional_route/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/conditional_route",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-csv-to-json",
"name": "CSV 转 JSON",
"category": "DATA",
"type": "builtin",
"runtimeHandler": "builtin_csv_to_json",
"runtimeSource": "backend/operators/builtin/csv_to_json/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,61 +0,0 @@
from __future__ import annotations
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
tabular_suffixes = helpers["TABULAR_FILE_SUFFIXES"]
payload: dict[str, Any]
if source_path is not None and source_path.suffix.lower() in tabular_suffixes:
delimiter = tabular_suffixes[source_path.suffix.lower()]
columns, rows = helpers["load_tabular_rows"](source_path, delimiter)
payload = {
"sourcePath": str(source_path),
"columns": columns,
"items": rows,
"rowCount": len(rows),
}
else:
for artifact in inputs:
preview = helpers["artifact_preview_payload"](artifact) or {}
if preview.get("kind") == "table":
payload = {
"sourcePath": str(artifact.get("path", "")),
"columns": preview.get("columns", []),
"items": preview.get("rows", []),
"rowCount": preview.get("rowCount", len(preview.get("rows", []))),
"previewTruncated": preview.get("truncated", False),
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"table.json",
payload,
output=helpers["output_binding"](node_data),
)
]
raise RuntimeError("CSV 转 JSON 需要 SOURCE_PATH 或上游 artifact 指向真实 csv/tsv 文件")
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"table.json",
payload,
output=helpers["output_binding"](node_data),
)
]

View File

@ -1,75 +0,0 @@
{
"acceptance": {
"hardcodedOutputAccepted": false,
"mockOnlyAccepted": false,
"pocFullAcceptanceScript": "scripts/poc-operator-full-acceptance.sh",
"requiresPersistentWorkspaceEvidence": true,
"requiresRealInputs": true,
"shallowOnlyAccepted": false,
"simulationOnlyAccepted": false
},
"category": "DATA",
"containerArgs": [],
"containerCommand": [
"python",
"/app/backend/operator-runner/main.py"
],
"containerEntrypoint": "backend/operator-runner/main.py",
"entrypoint": "operator.py",
"image": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-csv-to-json:builtin",
"imageId": "ccr-29eug8s3-pub.cnc.bj.baidubce.com/dataflow-poc/droboticflow-operator-csv-to-json@sha256:9137bbc331c43d783ac20b3316c606612d96c1e725c95bfdac02f6de6d163c7f",
"metadata": "operator.json",
"name": "CSV 转 JSON",
"operatorId": "operator-builtin-csv-to-json",
"operatorSlug": "csv_to_json",
"preferredSlug": "csv_to_json",
"pythonImport": "backend.operators.builtin.csv_to_json.operator:run",
"repositoryId": "builtin/csv_to_json",
"runtimeContract": {
"acceptance": {
"requiresArtifactChecksum": true,
"requiresFixtureChecksum": true,
"requiresGpuEvidence": false,
"requiresRealFixture": true,
"requiresWorkflowTransfer": true
},
"artifacts": {
"requiresChecksum": true,
"requiresLineage": true,
"requiresManifest": true
},
"entrypoint": "/app/backend/operator-runner/main.py",
"handler": "builtin_csv_to_json",
"imagePolicy": {
"allowsSharedBaseLayer": true,
"forbidsSharedOperatorRunnerFinalImage": true,
"independentFinalImage": true
},
"operatorId": "operator-builtin-csv-to-json",
"operatorSlug": "csv_to_json",
"parameters": {
"commandWrapperAllowed": false,
"controlledScriptAllowed": false,
"source": "hyperparams",
"structured": true
},
"resources": {
"minGpuCount": 0,
"recommendedGpuType": "",
"requiresGpu": false
},
"runtimeDependencies": [
"csv-files"
],
"schemaVersion": "droboticflow.operator.runtime/v1"
},
"runtimeDependencies": [
"csv-files"
],
"runtimeHandler": "builtin_csv_to_json",
"runtimeSource": "backend/operators/builtin/csv_to_json/operator.py",
"schemaVersion": "droboticflow.operator.repository/v1",
"sourceRoot": "backend/operators/builtin/csv_to_json",
"strictPocAcceptanceExternals": [],
"type": "builtin"
}

View File

@ -1,16 +0,0 @@
{
"id": "operator-builtin-dataset-provenance-audit",
"name": "数据集来源许可审计",
"category": "DATASET",
"type": "builtin",
"runtimeHandler": "builtin_dataset_provenance_audit",
"runtimeSource": "backend/operators/builtin/dataset_provenance_audit/operator.py",
"migrationStatus": "migrated",
"acceptance": {
"requiresRealInputs": true,
"mockOnlyAccepted": false,
"simulationOnlyAccepted": false,
"hardcodedOutputAccepted": false,
"shallowOnlyAccepted": false
}
}

View File

@ -1,163 +0,0 @@
from __future__ import annotations
import json
import pathlib
from typing import Any, Callable
HelperMap = dict[str, Callable[..., Any]]
KNOWN_LICENSE_FILES = ("LICENSE", "LICENSE.md", "LICENSE.txt", "COPYING", "COPYING.md")
KNOWN_CARD_FILES = ("README.md", "README.MD", "dataset_card.md", "DatasetCard.md")
KNOWN_CITATION_FILES = ("CITATION.cff", "CITATION", "CITATION.md", "citation.bib")
PROVENANCE_FILES = ("provenance.json", "sources.json", "dataset_info.json", "metadata.json")
def _require_yaml():
try:
import yaml # type: ignore
except Exception as exc:
raise RuntimeError("数据集来源许可审计需要 PyYAML 运行时依赖以解析 Dataset Card YAML front matter") from exc
return yaml
def _read_text(path: pathlib.Path, limit: int = 24_000) -> str:
return path.read_text(encoding="utf-8", errors="replace")[:limit]
def _find_first(root: pathlib.Path, names: tuple[str, ...]) -> pathlib.Path | None:
for name in names:
candidate = root / name
if candidate.is_file():
return candidate
for candidate in root.rglob("*"):
if candidate.is_file() and candidate.name in names:
return candidate
return None
def _parse_front_matter(path: pathlib.Path, yaml_module: Any) -> dict[str, Any]:
if not path.exists():
return {}
text = _read_text(path)
lines = text.splitlines()
if not lines or lines[0].strip() != "---":
return {}
for index in range(1, len(lines)):
if lines[index].strip() == "---":
raw = "\n".join(lines[1:index])
parsed = yaml_module.safe_load(raw) or {}
return parsed if isinstance(parsed, dict) else {}
return {}
def _load_json_file(path: pathlib.Path) -> dict[str, Any]:
if not path.exists():
return {}
try:
parsed = json.loads(_read_text(path))
except json.JSONDecodeError:
return {"unreadable": True}
return parsed if isinstance(parsed, dict) else {"value": parsed}
def _string_list(value: Any) -> list[str]:
if isinstance(value, str) and value.strip():
return [value.strip()]
if isinstance(value, list):
return [str(item).strip() for item in value if str(item).strip()]
return []
def _extract_metadata_licenses(card: dict[str, Any], provenance: dict[str, Any]) -> list[str]:
values: list[str] = []
for source in (card, provenance):
for key in ("license", "licenses"):
values.extend(_string_list(source.get(key)))
return sorted(set(values))
def _extract_sources(card: dict[str, Any], provenance: dict[str, Any]) -> list[str]:
values: list[str] = []
for source in (card, provenance):
for key in ("source", "sources", "homepage", "repository", "repo", "paper", "arxiv", "dataset_url"):
values.extend(_string_list(source.get(key)))
return sorted(set(values))
def _file_entry(root: pathlib.Path, path: pathlib.Path | None) -> dict[str, Any] | None:
if path is None:
return None
return {
"path": path.relative_to(root).as_posix(),
"sizeBytes": path.stat().st_size,
}
def run(
run_id: str,
node_id: str,
output_dir: Any,
node_data: dict[str, Any],
inputs: list[dict[str, Any]],
helpers: HelperMap,
) -> list[dict[str, Any]]:
params = helpers["hyperparams"](node_data)
source_path = helpers["resolve_source_path"](params, inputs)
if source_path is None:
raise RuntimeError("数据集来源许可审计需要 SOURCE_PATH 或上游 artifact 指向真实数据集目录")
root = source_path if source_path.is_dir() else source_path.parent
yaml_module = _require_yaml()
card_path = _find_first(root, KNOWN_CARD_FILES)
license_path = _find_first(root, KNOWN_LICENSE_FILES)
citation_path = _find_first(root, KNOWN_CITATION_FILES)
provenance_path = _find_first(root, PROVENANCE_FILES)
card_metadata = _parse_front_matter(card_path, yaml_module) if card_path else {}
provenance = _load_json_file(provenance_path) if provenance_path else {}
licenses = _extract_metadata_licenses(card_metadata, provenance)
sources = _extract_sources(card_metadata, provenance)
issues: list[dict[str, Any]] = []
warnings: list[dict[str, Any]] = []
if card_path is None:
issues.append({"code": "missing_dataset_card", "expected": list(KNOWN_CARD_FILES)})
if license_path is None and not licenses:
issues.append({"code": "missing_license", "expected": list(KNOWN_LICENSE_FILES), "metadataKeys": ["license", "licenses"]})
if citation_path is None:
warnings.append({"code": "missing_citation", "expected": list(KNOWN_CITATION_FILES)})
if not sources:
warnings.append({"code": "missing_source_reference", "metadataKeys": ["source", "sources", "homepage", "repository", "paper"]})
if card_path is not None and not card_metadata:
warnings.append({"code": "missing_or_unparseable_card_front_matter", "path": card_path.relative_to(root).as_posix()})
payload = {
"datasetType": "dataset-provenance-audit",
"sourcePath": str(root),
"valid": len(issues) == 0,
"issueCount": len(issues),
"warningCount": len(warnings),
"issues": issues,
"warnings": warnings,
"licenses": licenses,
"sources": sources,
"card": _file_entry(root, card_path),
"licenseFile": _file_entry(root, license_path),
"citationFile": _file_entry(root, citation_path),
"provenanceFile": _file_entry(root, provenance_path),
"cardMetadata": card_metadata,
"provenance": provenance,
"licensePreview": _read_text(license_path, 2000) if license_path else "",
}
return [
helpers["write_json_artifact"](
run_id,
node_id,
output_dir,
"dataset-provenance-audit.json",
payload,
output=helpers["output_binding"](node_data),
)
]

Some files were not shown because too many files have changed in this diff Show More