🧪 Verify November feedback fixes through baseline gates
This commit is contained in:
parent
1ae5d37e60
commit
327759afe3
58
.scratch/review-pool-search/nov5-fixes.md
Normal file
58
.scratch/review-pool-search/nov5-fixes.md
Normal file
@ -0,0 +1,58 @@
|
||||
# 旧任务 V4 交付及 11 月 5 日反馈核验
|
||||
|
||||
Base: 6d8b011c67ecadfb9354cd1871d20c21b58d1f87;在现有 codex/review-pool-search 上继续,不改其他工作树。
|
||||
|
||||
授权范围:本地修改、验证、提交,生产只读诊断;未推送、未建 PR、未部署,未改客户记录或 BOS 文件。飞书仅阅读。
|
||||
|
||||
## 相比现网的新改动
|
||||
|
||||
重新核对结果:当前工作树包含最新 origin/dev 与线上源码 e4969acc;本地已有三个尚未发布提交:
|
||||
|
||||
- adc63af8:审核/验收按当前任务池独立请求,取消过期请求;批量关联搜索元数据,减少大载荷读取。已审核搜索不再被可领取池超时连带清空;**广范围搜索未完成性能验收**。
|
||||
- c942a8ce:修正工作树 hooks、验证入口与浏览器工具运行问题。
|
||||
- 6d8b011c:V4 历史包本地预览转换、可恢复批处理及查询索引实验记录。索引无端到端收益,已按原授权删除,没有保留生产索引。
|
||||
- 本批:旧任务 V4 打包快照与发布格式防护;鼠标进入批注时暂停并固定位置;舍弃切片批注目标;字幕上下位置偏好;Go 已知失败用官方基线门禁核对。
|
||||
|
||||
## 证据来源及日期
|
||||
|
||||
[数据平台测试](https://pcno45pc3jv8.feishu.cn/wiki/TImwwnFqyiIuC3kgIDHcIlHDnTc),读取修订 7543,11 月 5 日表格两条问题的解决栏均为空。
|
||||
|
||||
[平台调优群](https://applink.feishu.cn/client/chat/open?openChatId=oc_ff3c7f66ecfd607ffebd120f0113dbca)。CLI 时间为 America/Los_Angeles;北京时间 11 月 5 日主要反馈显示为本地 11 月 4 日。下面保留来源位置,不把当地 11 月 5 日晚的新反馈混称为北京时间同一天。群内“我看看/可以加设置”不算修复证据。
|
||||
|
||||
## 问题及处理状态
|
||||
|
||||
| 问题 | 核验与处理 | 状态 |
|
||||
| ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ---------------------------------------------- |
|
||||
| 马迪:保存时间点意见后位置跳动(测试文档 11/5) | 下载原演示,画面是秒级位置变化;不能直接认定为源视频时间偏移。确认鼠标入口没有暂停/捕获当前帧,而 F 入口会暂停。补齐鼠标入口;既有编辑不追随播放头。旧钩子真实播放回归在暂停断言失败。 | 本地修复,三种播放器回归通过 |
|
||||
| 马迪:舍弃切片无法批注(测试文档 11/5) | 服务端允许切片意见,拒绝舍弃片段的动作/时间点意见。验收未把舍弃状态传入工作台,前端仍提供被拒绝的目标。传递状态并回退到切片目标,不修改服务端业务规则。 | 本地修复,三种播放器保存回归通过 |
|
||||
| [切片倍速重置](https://applink.feishu.cn/client/chat/open?openChatId=oc_ff3c7f66ecfd607ffebd120f0113dbca&position=452)、[快捷键切片后无法播放](https://applink.feishu.cn/client/chat/open?openChatId=oc_ff3c7f66ecfd607ffebd120f0113dbca&position=453) | 已在现网 e4969acc 修复,本批扩大原有验收真实播放器回归,防止回归。 | 现网已有修复;本批 45 次切片回归通过 |
|
||||
| [当前意见卡显示“无”](https://applink.feishu.cn/client/chat/open?openChatId=oc_ff3c7f66ecfd607ffebd120f0113dbca&position=451) | 原截图当前为来源 1 / 切片 3,列表那条意见属于切片 2、01:37.152;不是同一个当前目标。不能据该截图证明批注丢失;保留当前目标卡与全部意见列表的不同范围。 | 原截图不构成同目标丢失证据;不宣称修复未知场景 |
|
||||
| [审核搜题超时](https://applink.feishu.cn/client/chat/open?openChatId=oc_ff3c7f66ecfd607ffebd120f0113dbca&position=454) | 本地已有当前池请求隔离修复。此前与本轮生产只读实际 Store 对照:广范围 all / available 仍各 8001ms 超时,验收示例 5638ms、1 条。按来源聚集查询的实验也未达标,已撤回;不扩超时、不删候选、不保留无效索引。 | **未解决广范围慢查询** |
|
||||
| [字幕遮挡手部](https://applink.feishu.cn/client/chat/open?openChatId=oc_ff3c7f66ecfd607ffebd120f0113dbca&position=456)(客户端当地 11/5 晚) | 加“字幕位置”上方/下方选择,保留隐藏字幕;保存本机偏好,切片、刷新后保持。仅移动展示层,不改视频、标注或快捷键。 | 本地修复,正常/只读/错误视觉核验通过 |
|
||||
| [2x / 4x 视频卡顿](https://applink.feishu.cn/client/chat/open?openChatId=oc_ff3c7f66ecfd607ffebd120f0113dbca&position=440) | 用户提供的办公网报告:平台健康 107–148ms;同一 BOS 视频 Range 请求约 15s 超时,实收仅 0.02 / 0.22Mbps,另一次连接失败。这证明该次 BOS 到客户端传输异常,不能单靠通用测速判定播放链路正常;不足以判定 BOS 服务端或哪段网络的唯一责任。当前缺少新同条件链路复测,不改播放器掩盖传输故障。 | **未确认消除**;一般测速不等于视频链路测速 |
|
||||
|
||||
## V4 根因与修复范围
|
||||
|
||||
V4 工作流实际已于 11 月 2 日建立并启用,镜像和参数正确。库存 35 个包均来自旧工作流的源任务;源父 Run 在切换前创建,11 月 6 日新产生的打包子 Run 仍用旧节点。这是“旧任务后续打包未纳入新格式要求”,不是 V4 开关未上线。
|
||||
|
||||
按用户最新“不得再新生成旧包”的要求,替代原 10 月 22 日在途任务继续旧协议的约定:
|
||||
|
||||
1. 在同组织、项目、版本家族中选择唯一已发布且可见的 V4 配置,人工放行时冻结兼容打包节点、五项参数和摘要镜像;保留原任务及工作流归属。
|
||||
2. 执行、成功作业重启恢复和重试使用冻结节点。重试保留已验收基线及原始输入,更新交付分区关联;不重新进入人工关卡。
|
||||
3. 在任何目标写入前拒绝新的旧格式;V4 客户目录只能包含 part.json。审核历史是独立内部产物。
|
||||
4. 已完整交付旧包仍可逐成员校验后**只读**恢复状态;缺失、冲突或未完成旧包不续传,不原地转换。
|
||||
5. 缺少冻结原始选择、字典、分类或 PTS 的历史任务会明确失败,必须恢复可信证据后重发;不会用当前字典或猜测帧率补齐。已排队但没有新运行快照的旧子任务会被最终格式防护拦截,需要重新生成候选,不会自动改写已运行作业。
|
||||
|
||||
历史转换仍为 18/35 个已校验本地预览,另 17 个因证据缺口阻塞(10 个缺冻结切片字典、6 个缺固定 JSON、1 个全舍弃旧记录缺来源/字典)。6 个全舍弃预览存在历史标定版本证明限制,不能当成正式可发布。没有把预览上传或替换线上包。
|
||||
|
||||
## 验证
|
||||
|
||||
忽略目录 local-data/nov5-triage 保存脱敏诊断、旧版失败与候选验证;完整飞书文档捕获含账号表,不进入提交或对话输出。
|
||||
|
||||
- 旧行为复现:legacy-v4-baseline-red.log(旧格式成功新发、旧任务未收审计);note-baseline-red.log(鼠标意见入口不暂停);discard-baseline-red.log(舍弃状态仍提供时间点档)。
|
||||
- V4:v4-cutover-tests.log,隔离 MemoryStore / 假对象存储;新发防护、完整旧包零写入恢复、损坏/归属/多余成员、跨组织/项目/家族、固定镜像、重试祖先与分区恢复。
|
||||
- 最终任务门禁:local-data/test-results/verify-1794160542009742000/report.json,15 项全部通过,unmapped 为空,运行期间输入未改变。包括类型、格式、工具回归、前端相关回归、官方 Go 基线、V4 打包、三种验收播放器、返修边界、质检/验收草稿、决定竞态与只读权限。
|
||||
- 额外全量前端:frontend-baseline-gate-final.log,13 个失败均在既有 14 项基线内,无新增。首次沙箱运行的两个 EPERM 端口监听失败保留原始记录;允许本机测试服务后重跑通过,未改失败基线。
|
||||
- V4 Python 门禁 37 passed / 4 opt-in skipped;随后生成真实合成双目物化修订(real-materialization.log),补跑四项实际 V4 消费测试(real-v4-consumption.log)均通过,未把跳过直接算通过。
|
||||
- 真实验收截图与报告:local-data/test-results/acceptance-playback-rate/。native、movi、movi-fractional 各 15 次切片;鼠标写意见暂停真实媒体并固定保存位置;舍弃切片意见读回;字幕上下选择及刷新保持;加载失败、只读编辑锁均通过。已实际查看正常、只读及错误画面。
|
||||
- 最终候选未部署、未生产写验收、未容量验收;广范围搜索和 BOS 链路卡顿仍未完成。
|
||||
@ -2,12 +2,43 @@
|
||||
"version": 1,
|
||||
"scopes": [
|
||||
{
|
||||
"name": "delivery-v4-preview",
|
||||
"name": "legacy-v4-release",
|
||||
"paths": [
|
||||
"^scripts/delivery_v4_preview\\.py$",
|
||||
"^tests/backend/test_delivery_v4_preview\\.py$"
|
||||
"^internal/domain/types\\.go$",
|
||||
"^internal/worker/(legacy_delivery_.*|capture_delivery|capture_cutover_test|delivery_audit|executor|human_release|original_source_recheck|runtime)\\.go$"
|
||||
],
|
||||
"frontend": [],
|
||||
"go": {
|
||||
"./internal/worker": [
|
||||
"^Test(LegacyCapture|CaptureCutover|CaptureDelivery|V4|Original|DispatchHumanRelease|HumanRelease|ReleasePartition|SourceIndexPackage|RecoverSucceeded|Retry|Runtime)"
|
||||
]
|
||||
},
|
||||
"task": [
|
||||
{
|
||||
"argv": ["npm", "run", "test:go:gate"],
|
||||
"tests": true
|
||||
},
|
||||
{
|
||||
"argv": [
|
||||
"python3",
|
||||
"-m",
|
||||
"pytest",
|
||||
"tests/backend/test_delivery_v4_package.py",
|
||||
"tests/backend/test_delivery_v4_real_materialization.py",
|
||||
"tests/backend/test_legacy_package_compatibility.py",
|
||||
"-q"
|
||||
],
|
||||
"tests": true
|
||||
}
|
||||
],
|
||||
"warnings": [
|
||||
"V4 格式防护与旧任务运行快照只用隔离存储验证;缺少历史冻结事实的生产任务仍须单独恢复,不以旧格式回退。"
|
||||
]
|
||||
},
|
||||
{
|
||||
"name": "delivery-v4-preview",
|
||||
"paths": ["^scripts/delivery_v4_preview\\.py$", "^tests/backend/test_delivery_v4_preview\\.py$"],
|
||||
"frontend": [],
|
||||
"go": {},
|
||||
"task": [
|
||||
{
|
||||
@ -24,9 +55,7 @@
|
||||
"tests": true
|
||||
}
|
||||
],
|
||||
"warnings": [
|
||||
"仅验证本地 V4 转换预览;完整内部审计、真实视频切片与正式发布另行验收。"
|
||||
]
|
||||
"warnings": ["仅验证本地 V4 转换预览;完整内部审计、真实视频切片与正式发布另行验收。"]
|
||||
},
|
||||
{
|
||||
"name": "verification-tooling",
|
||||
@ -52,77 +81,56 @@
|
||||
"^tests/browser/(review-drafts|dashboard-presentation-replica|run-editing-regression)\\.mjs$",
|
||||
"^scripts/test-dashboard-presentation\\.mjs$"
|
||||
],
|
||||
"frontend": [
|
||||
"tests/frontend/browser-executable.test.mjs"
|
||||
],
|
||||
"frontend": ["tests/frontend/browser-executable.test.mjs"],
|
||||
"go": {},
|
||||
"task": [
|
||||
{
|
||||
"argv": [
|
||||
"npm",
|
||||
"run",
|
||||
"test:browser:editing"
|
||||
],
|
||||
"argv": ["npm", "run", "test:browser:editing"],
|
||||
"tests": true
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"name": "production-boot-harness",
|
||||
"paths": [
|
||||
"^tests/browser/run-production-boot\\.mjs$"
|
||||
],
|
||||
"frontend": [
|
||||
"tests/frontend/browser-executable.test.mjs"
|
||||
],
|
||||
"paths": ["^tests/browser/run-production-boot\\.mjs$"],
|
||||
"frontend": ["tests/frontend/browser-executable.test.mjs"],
|
||||
"go": {},
|
||||
"task": [
|
||||
{
|
||||
"argv": [
|
||||
"npm",
|
||||
"run",
|
||||
"build:web"
|
||||
]
|
||||
"argv": ["npm", "run", "build:web"]
|
||||
},
|
||||
{
|
||||
"argv": [
|
||||
"npm",
|
||||
"run",
|
||||
"test:production:boot"
|
||||
],
|
||||
"requires": [
|
||||
[
|
||||
"npm",
|
||||
"run",
|
||||
"build:web"
|
||||
]
|
||||
],
|
||||
"argv": ["npm", "run", "test:production:boot"],
|
||||
"requires": [["npm", "run", "build:web"]],
|
||||
"tests": true
|
||||
}
|
||||
]
|
||||
},
|
||||
{
|
||||
"name": "acceptance-playback-rate",
|
||||
"name": "acceptance-playback-and-feedback",
|
||||
"paths": [
|
||||
"^src/components/FinalAcceptanceWorkspace\\.tsx$",
|
||||
"^tests/browser/acceptance-playback-rate\\.mjs$",
|
||||
"^tests/browser/fixtures/acceptance-playback-rate\\.tsx$"
|
||||
"^tests/browser/fixtures/acceptance-playback-rate\\.tsx$",
|
||||
"^src/components/(ReviewCaptions|review-viewing)\\.tsx?$",
|
||||
"^src/hooks/useReviewDraft\\.ts$",
|
||||
"^src/lib/(review-caption-preferences\\.js|review-navigation\\.js|review-opinions\\.ts)$",
|
||||
"^src/styles/review-captions\\.css$"
|
||||
],
|
||||
"frontend": [
|
||||
"tests/frontend/review-target-interaction.test.mjs",
|
||||
"tests/frontend/review-caption-preferences.test.mjs",
|
||||
"tests/frontend/review-captions.test.mjs"
|
||||
],
|
||||
"frontend": [],
|
||||
"go": {},
|
||||
"task": [
|
||||
{
|
||||
"argv": [
|
||||
"node",
|
||||
"tests/browser/acceptance-playback-rate.mjs"
|
||||
],
|
||||
"argv": ["node", "tests/browser/acceptance-playback-rate.mjs"],
|
||||
"env": {},
|
||||
"tests": true
|
||||
}
|
||||
],
|
||||
"warnings": [
|
||||
"倍速浏览器回归默认自建临时本地测试服务与合成媒体;不连接生产。"
|
||||
]
|
||||
"warnings": ["浏览器使用真实验收组件、三种播放器模式与隔离合成媒体/批注 API;不连接生产。"]
|
||||
},
|
||||
{
|
||||
"name": "review-navigation",
|
||||
@ -131,13 +139,9 @@
|
||||
"^internal/api/review_(continuation|trace)",
|
||||
"^tests/browser/review-trace\\.mjs$"
|
||||
],
|
||||
"frontend": [
|
||||
"tests/frontend/annotation-project-loading.test.mjs"
|
||||
],
|
||||
"frontend": ["tests/frontend/annotation-project-loading.test.mjs"],
|
||||
"go": {
|
||||
"./internal/api": [
|
||||
"^TestReviewContinuation"
|
||||
]
|
||||
"./internal/api": ["^TestReviewContinuation"]
|
||||
},
|
||||
"task": [
|
||||
{
|
||||
@ -177,9 +181,7 @@
|
||||
"^TestWorkBufferRetains",
|
||||
"^TestRandomClaim"
|
||||
],
|
||||
"./internal/store": [
|
||||
"^TestSourceAdmissionMemoryClaimFence$"
|
||||
]
|
||||
"./internal/store": ["^TestSourceAdmissionMemoryClaimFence$"]
|
||||
},
|
||||
"task": [
|
||||
{
|
||||
@ -215,9 +217,7 @@
|
||||
"tests": true
|
||||
}
|
||||
],
|
||||
"warnings": [
|
||||
"涉及准入/轮询:核对真实规模下查询次数、扫描量、超时与并发;局部回归不等于容量通过。"
|
||||
]
|
||||
"warnings": ["涉及准入/轮询:核对真实规模下查询次数、扫描量、超时与并发;局部回归不等于容量通过。"]
|
||||
},
|
||||
{
|
||||
"name": "pool-search",
|
||||
@ -233,10 +233,7 @@
|
||||
"tests/frontend/review-pool-search.test.mjs"
|
||||
],
|
||||
"go": {
|
||||
"./internal/api": [
|
||||
"^TestHumanPoolSearch",
|
||||
"^TestHumanPoolQCProjectScope"
|
||||
]
|
||||
"./internal/api": ["^TestHumanPoolSearch", "^TestHumanPoolQCProjectScope"]
|
||||
},
|
||||
"task": [
|
||||
{
|
||||
@ -312,7 +309,8 @@
|
||||
"^src/(pages/AnnotationOperations\\.tsx|components/CaptureAnnotationWorkbench\\.tsx)$",
|
||||
"^src/.*([Rr]eview[Dd]raft|review-draft|[Rr]eview[Dd]ecision|review-decision)",
|
||||
"^internal/api/review_(draft|decision|confirmation)",
|
||||
"^tests/browser/review-(draft|decision|authoring)"
|
||||
"^tests/browser/review-(draft|decision|authoring)",
|
||||
"^tests/browser/review-draft-persistence\\.mjs$"
|
||||
],
|
||||
"frontend": [
|
||||
"tests/frontend/review-decision-controller.test.mjs",
|
||||
@ -323,27 +321,15 @@
|
||||
"go": {},
|
||||
"task": [
|
||||
{
|
||||
"argv": [
|
||||
"npm",
|
||||
"run",
|
||||
"test:browser:review-drafts"
|
||||
],
|
||||
"argv": ["npm", "run", "test:browser:review-drafts"],
|
||||
"tests": true
|
||||
},
|
||||
{
|
||||
"argv": [
|
||||
"npm",
|
||||
"run",
|
||||
"test:browser:review-decisions"
|
||||
],
|
||||
"argv": ["npm", "run", "test:browser:review-decisions"],
|
||||
"tests": true
|
||||
},
|
||||
{
|
||||
"argv": [
|
||||
"npm",
|
||||
"run",
|
||||
"test:browser:review-permissions"
|
||||
],
|
||||
"argv": ["npm", "run", "test:browser:review-permissions"],
|
||||
"tests": true
|
||||
}
|
||||
]
|
||||
@ -366,24 +352,15 @@
|
||||
"tests/frontend/production-quality-dates.test.mjs"
|
||||
],
|
||||
"go": {
|
||||
"./internal/api": [
|
||||
"^TestProductionDashboardScopeIsolationAndFullCorpus$"
|
||||
]
|
||||
"./internal/api": ["^TestProductionDashboardScopeIsolationAndFullCorpus$"]
|
||||
},
|
||||
"task": [
|
||||
{
|
||||
"argv": [
|
||||
"npm",
|
||||
"run",
|
||||
"test:browser:dashboard"
|
||||
],
|
||||
"argv": ["npm", "run", "test:browser:dashboard"],
|
||||
"tests": true
|
||||
},
|
||||
{
|
||||
"argv": [
|
||||
"python3",
|
||||
"scripts/test_dashboard_stability.py"
|
||||
]
|
||||
"argv": ["python3", "scripts/test_dashboard_stability.py"]
|
||||
},
|
||||
{
|
||||
"argv": [
|
||||
@ -401,30 +378,20 @@
|
||||
"tests": true
|
||||
}
|
||||
],
|
||||
"warnings": [
|
||||
"统计/查询改动须额外记录同数据规模的性能对照;完整 120 人容量另行验收。"
|
||||
]
|
||||
"warnings": ["统计/查询改动须额外记录同数据规模的性能对照;完整 120 人容量另行验收。"]
|
||||
},
|
||||
{
|
||||
"name": "production-statistics-model",
|
||||
"paths": [
|
||||
"^internal/productionstats/model\\.go$"
|
||||
],
|
||||
"paths": ["^internal/productionstats/model\\.go$"],
|
||||
"frontend": [],
|
||||
"go": {},
|
||||
"task": [
|
||||
{
|
||||
"argv": [
|
||||
"npm",
|
||||
"run",
|
||||
"test:go:gate"
|
||||
],
|
||||
"argv": ["npm", "run", "test:go:gate"],
|
||||
"tests": false
|
||||
}
|
||||
],
|
||||
"warnings": [
|
||||
"共享生产统计事实结构改动:使用既有 Go 基线门禁比较历史失败,不扩大失败基线。"
|
||||
]
|
||||
"warnings": ["共享生产统计事实结构改动:使用既有 Go 基线门禁比较历史失败,不扩大失败基线。"]
|
||||
}
|
||||
]
|
||||
}
|
||||
|
||||
@ -147,7 +147,11 @@ def plan_checks(root, files, policy, mode, base, tooling_package=False):
|
||||
selected_names = sorted(name for name in names if any(re.search(p, name) for p in patterns)
|
||||
and not re.search(r'Browser|Mongo|Capacity|Soak|Load|Local|Benchmark|Preview', name))
|
||||
if selected_names:
|
||||
quick.append(command(['go', 'test', pkg, '-run', '|'.join('^' + name + '$' for name in selected_names), '-timeout=2m', '-v'], tests=True))
|
||||
known_go = json.loads((root/'tests/known-failures.json').read_text()).get('go', [])
|
||||
if any(pkg.removeprefix('./') + ' :: ' + name in known_go for name in selected_names):
|
||||
quick.append(command(['npm', 'run', 'test:go:gate'], tests=True))
|
||||
else:
|
||||
quick.append(command(['go', 'test', pkg, '-run', '|'.join('^' + name + '$' for name in selected_names), '-timeout=2m', '-v'], tests=True))
|
||||
integration = [command(['npm', 'run', x]) for x in
|
||||
['lint:web', 'format:check', 'test:frontend:gate', 'test:go:gate', 'build:web', 'test:production:boot']]
|
||||
def unique(commands):
|
||||
|
||||
@ -101,6 +101,11 @@ class VerificationTest(unittest.TestCase):
|
||||
self.assertTrue(any(c['argv'] == ['npm', 'run', 'test:frontend:gate'] for c in plan['commands']))
|
||||
self.assertFalse(any(c['argv'][:2] == ['node', '--test'] for c in plan['commands']))
|
||||
|
||||
def test_known_go_failure_uses_official_gate_and_does_not_repeat_raw_suite(self):
|
||||
plan = self.plan(['internal/worker/runtime.go'], 'task')
|
||||
self.assertEqual(sum(c['argv'] == ['npm', 'run', 'test:go:gate'] for c in plan['commands']), 1)
|
||||
self.assertFalse(any(c['argv'][:2] == ['go', 'test'] and './internal/worker' in c['argv'] for c in plan['commands']))
|
||||
|
||||
def test_changed_frontend_test_is_always_included(self):
|
||||
f = 'tests/frontend/annotation-buffer-summary.test.mjs'
|
||||
plan = self.plan([f])
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user