* feat(agent-edit): multi-session conversation history for the AI editor
The "Edit with AI" panel kept only one thread per stage in localStorage, and
"New conversation" deleted it, so previous conversations were unrecoverable.
Add a per-stage session list backed by IndexedDB (Dexie v12 `agentEditSessions`):
- "New conversation" now archives the current session and starts a fresh one
instead of deleting it; a history popover in the panel header lists past
sessions (auto-titled from the first user message) to switch back to or delete.
- One-time migration of the existing single-thread localStorage entry.
- The active session id is remembered per stage so a refresh restores it,
including a just-cleared empty session (clean slate survives reload).
- saveSession preserves the original createdAt and tombstones deleted ids so an
in-flight save can't resurrect a deleted session; switching stages drops the
previous thread synchronously so it can't leak into the new stage.
- Sessions are pruned to a soft cap per stage and removed when a course is
deleted.
- i18n for all 8 locales; unit tests for title derivation and the store.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* fix(types): drop redundant Window.SpeechRecognition augmentation conflicting with @assistant-ui/core
@assistant-ui/core's speech adapter declares Window.SpeechRecognition and
webkitSpeechRecognition globally as SpeechRecognitionConstructor. Three files
(prompt-input, use-audio-recorder, use-browser-asr) re-declared them as `any`,
which conflicts (TS2717) once that adapter's types are pulled into the program,
and the constructed instance then lacks the event handlers the code sets
(TS2339/2551). Rely on the global declaration and cast the instance to the local
rich shape. Takes `tsc --noEmit` back to zero.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* chore(packages): publish the @openmaic/* SDK family to npm (#778)
Prepares the @openmaic/{dsl,renderer,importer} family for its first npm
publish, and moves the SDK packages onto the @openmaic scope.
Why the scope move: the @maic org name is unavailable on npm (an unscoped
`maic` package already holds the name), so @maic/* is not claimable. @openmaic
matches the project name, the scope is free, and the repo already ships an
@openmaic/docs package — so the SDK family now lines up with that convention.
- rename @maic/{dsl,renderer,importer} -> @openmaic/* across packages, the
workspace glob, the package dir, and all import sites; lockfile regenerated
- renderer: add publishConfig (public, registry.npmjs.org) — was missing, so
a scoped publish would default to the wrong registry / restricted access
- importer: add a files allowlist (dist, README, LICENSE) and drop the
fragile .npmignore blacklist that shipped src; add an exports map so ESM
consumers resolve dist/index.js instead of falling back to the .cjs main
- all three: add a prepublishOnly build (+ test/typecheck) guard so a publish
can never ship a stale or empty dist
- add a tag-triggered publish workflow with npm provenance, pinned by name to
the three @openmaic packages so the vendored forks (mathml2omml, pptxgenjs)
are never published
Refs #778, #720 (Phase 1).
* fix(packages): address cross-review on the @openmaic publish prep
Cross-review (Claude /code-review + codex) on this PR surfaced:
- renderer's advertised CJS entry was broken: it keeps @openmaic/dsl external
and imports a runtime enum from it, but dsl is ESM-only (no `require`
condition), so `require('@openmaic/renderer')` would throw
ERR_PACKAGE_PATH_NOT_EXPORTED. Make renderer ESM-only: drop the `.cjs`
rollup output, `main` now points at the ESM build, and the `require`
conditions are removed from `exports`. (importer is unaffected — it bundles
dsl, so its CJS build still works.)
- prepublishOnly re-ran the test suite during `pnpm -r publish`, so a flaky
test after dsl had already published gave a non-atomic partial release.
Reduce prepublishOnly to a build-only guard (never ship stale/empty dist)
and move the real test/typecheck gate into the workflow, before any publish.
- document that an @openmaic/* tag publishes the whole family via `pnpm -r`
(pnpm skips already-published versions); the tag is a release marker, not a
per-package gate.
Verified: dsl + renderer + importer build; renderer emits ESM only (0 .cjs),
all exports entries resolve; `npm pack` ships dist + README + LICENSE with no
src leak; frozen-lockfile passes.
Refs #778.
* style: reflow @openmaic/dsl type imports past print-width after rename
The @maic -> @openmaic rename lengthened two single-line type imports past
prettier's 100-col width; prettier --check flagged them. Pure formatting.
Refs #778.
* docs(importer): mark @openmaic/importer browser-only (cr-loop accepted limitation)
codex cross-review flagged that the published @openmaic/importer throws
`XMLHttpRequest is not a constructor` when loaded in a pure Node process —
its rollup build is browser-targeted (`nodeResolve({browser:true})` + a
browser pdf.js build). The app only consumes it client-side ('use client'),
so this is by design. Document it as an accepted limitation: prominent
browser-only note in the README and a `browser` field in the manifest.
Refs #778.
Promote the editor-agent line to main: read-then-act editor agent (read_scene_content, regenerate_scene, regenerate_scene_actions, edit_interactive_html), a routable maic-agent model stage, the agent sidebar UI, interactive-scene runtime-error capture, and the timeline/script editor. Cross-reviewed and smoke-verified; see #777.
Deleting a slide in Pro/Edit mode removed it from `scenes` but left its
entry in the persisted `outlines` plan. On the next classroom mount the
resume-generation pass treats the now-missing `order` as a pending
outline and regenerates the slide, appending it as the last page.
Rather than prune outlines by `order` (which is rebalanced by Pro-mode
insert/duplicate/reorder, so it is not a stable key and would mis-target
or break delete-undo), gate resume on a persisted `generationComplete`
flag:
- The flag is recorded (alongside outlines, in the stageOutlines record)
when generation finishes — both generateRemaining completion paths, the
retry-to-completion path (markGenerationCompleteIfDone), and the
already-materialized-at-mount path — and restored on load. It is written
only after a verified scene flush, so it never outruns the deck's scenes.
- A finished deck is frozen for editing: loadFromStorage no longer derives
pending placeholders from orphaned outlines, the classroom resume effect
skips generateRemaining, media resume is filtered to materialized
outlines, and isCourseComplete honours the flag — so a deleted slide
neither regenerates nor leaves a phantom pending page.
- Decks generated before the flag existed self-heal on load (every outline
has a scene ⇒ inferred complete). deleteScene additionally records
completion when deleting from a deck that is complete right now, so the
"Course complete" end page and resume-suppression survive even when the
flag was never persisted (e.g. edited without a reload).
`outlines` are never pruned, so order-rebalancing and delete-undo are
unaffected. Genuinely interrupted generations (not complete) still resume.
Fixes#768
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
#707 left lib/types/slides.ts as a thin `export * from '@maic/dsl'` shim so the
~100 existing `@/lib/types/slides` import sites kept working unchanged. Point
them at `@maic/dsl` directly and delete the shim, so the app consumes the
package contract with no indirection and the legacy module path is gone.
Pure module-specifier migration — every symbol imported from
`@/lib/types/slides` was already a re-export of the same `@maic/dsl` symbol, so
behavior is identical. Also redirects the two `lib/types` relative importers
(`./slides`), the e2e fixture's relative import, and the dynamic
`import('../types/slides').Slide` type alias in stage-storage; merges the now
same-module import pair in slide-edit-elements.
Verified: tsc --noEmit clean, eslint clean, vitest 804/804, next build OK,
e2e (Playwright) 19/19.
Part of #720 (Phase 1).
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
* feat(generation): opt-in parallel scene-content generation
Scene generation was strictly serial — content -> actions -> TTS, one
outline at a time — so an N-scene classroom paid N x (content + actions
+ TTS) of wall-clock latency, which dominates the post-outline wait.
Add an opt-in hybrid two-phase path (#572):
- Phase 1 fetches scene *content* concurrently (bounded). Content is the
only per-scene step independent of cross-scene state, so it is safe to
parallelise; a content failure marks just that outline and does not
pause the batch.
- Phase 2 keeps the existing in-order actions + TTS loop, so
previousSpeeches threading, ordered addScene, the abort/epoch guards,
and the pause-on-failure UX are all unchanged.
Gated by a server-side PARALLEL_SCENE_CONCURRENCY (default 0 = off,
clamped to 10), surfaced to the client through the existing
/api/server-providers response. With it unset the content map is null
and the loop is byte-for-byte the original serial path, so out-of-box
behaviour is unchanged.
The bounded worker pool is extracted to lib/utils/concurrency.ts
(mapWithConcurrency, with an early-stop hook for abort/epoch) and
unit-tested; getParallelSceneConcurrency env parsing/clamping is tested
too.
Closes#572
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* refactor(generation): pipeline content fetches instead of a barrier
Address @wyuc's review on #660. The previous version awaited the whole
bounded content pool before Phase 2, so for N > C scenes the user saw the
first scene, then a stall on a single page for the entire content phase,
then a burst — perceived as worse than serial despite the wall-clock win
(the gap scales with ceil((N-1)/C)).
Pipeline instead: lazyBoundedMap starts the content fetches (<= C in
flight) and returns one promise per outline immediately; the serial loop
awaits them in order, so each resolves as soon as its own content is ready
(usually already done, hidden behind the previous scene's actions/TTS). The
first scene now paints after content(1)+actions(1)+TTS(1) — same as serial
— with the full concurrency benefit and no stall.
Also from the review:
- a content fetch can no longer take its siblings down: an unexpected throw
is caught and returned as a failure result, routed through the same
mark-failed path as the serial loop (symmetric);
- drop the cosmetic Phase-1 setCurrentGeneratingOrder — the loop already
sets it per outline;
- note the intentional belt-and-suspenders clamp;
- concurrency.test.ts asserts <= limit (not == limit), and gains
lazyBoundedMap tests including the no-barrier property.
mapWithConcurrency is kept as a thin await-all wrapper over lazyBoundedMap.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: ly-wang19 <ly-wang19@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: wyuc <wang-yc24@mails.tsinghua.edu.cn>
* feat(tts): voxcpm voice-design types + deterministic voice id helpers (#670)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* feat(tts): emit + persist per-agent voiceDesign descriptor (#670)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* feat(tts): voxcpm voice registration backend client (#670)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* feat(tts): voxcpm-voice ensure/register endpoint (#670)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* feat(tts): client auto-voice registration + reference-clip cache (#670)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* feat(tts): reference registered voice id in vLLM-Omni speech (#670)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* feat(tts): thread voiceDesign + backend through tts call sites (#670)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(tts): match vLLM-Omni voice registration contract (#670)
Live e2e against the real backend revealed the assumed multipart contract was
wrong: POST /v1/audio/voices needs name + consent + audio_sample (not
voice_id/file), and there is no per-name GET (405) — existence must list
/v1/audio/voices and check membership.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* refactor(tts): make auto-voice register-once pattern provider-neutral (#670)
The descriptor + register-once/reference-by-id pattern is not VoxCPM-specific.
De-couple it into a provider-neutral seam so other registration-capable
providers (ElevenLabs/MiniMax/Doubao voice cloning, …) can plug in:
- lib/audio/voice-design.ts: VoiceDesign + buildVoiceDesignPrompt /
normalizeVoiceDesign / getDeterministicVoiceId (neutral 'auto-<hash>' id,
namespaced by providerId).
- lib/audio/voice-registration.ts: VoiceRegistrationAdapter interface +
providerId->adapter registry + supportsVoiceRegistration.
- lib/audio/voice-registration-client.ts: neutral ensureRegisteredVoice() +
IndexedDB clip cache.
- app/api/generate/voice (replaces .../voxcpm-voice): dispatches by providerId.
- voxcpm-registration.ts becomes the VoxCPM adapter (sole registered provider).
- AgentConfig.voiceDesign + DB cache table renamed neutral.
Behavior-preserving; VoxCPM-specific bits (inline (prompt)text, backend kinds,
capability gate) stay in the voxcpm modules. Full suite green (674).
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(tts): build the voice clip Blob from an inline Uint8Array (#670)
A factored-out helper returning Uint8Array widened to Uint8Array<ArrayBufferLike>,
which next build (stricter than bare tsc) rejects as a BlobPart. Inline the
buffer like the rest of the repo does.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* feat(tts): managed TTS providers resolve model server-side (#670)
A server-managed TTS provider's model was still client-driven, but the
managed-provider settings UI hides the model field — so a backend whose model
id isn't the client default (e.g. VoxCPM/vLLM-Omni serving the full model path)
always 500'd. resolveTTSModel() makes the model authoritative from server
config (${PREFIX}_MODELS, first entry) for managed providers, like key/baseUrl;
unmanaged/unconfigured providers keep the client model unchanged. Used by the
tts and voice routes.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(tts): single agent-voice resolver + stable teacher narration voice (#670)
Route all TTS voice resolution (narration, discussion, preview) through one
resolveAgentVoiceOptions(agent, ...) that reads the agent profile and registers
+ references the voice by id. Eagerly warm up generated agents' voices on save.
Critically fixes the teacher narration drifting (male/female jumps): the registry
is always seeded with DEFAULT_AGENTS, so the old narration lookup
find(role==='teacher') returned the default teacher (no voiceDesign) instead of
the generated one — so narration never registered a voice and fell back to the
inline prompt. pickNarratorAgent() now prefers the teacher carrying a voiceDesign.
Also: drop language from the deterministic voice id (descriptor already encodes
it) so narration (directive) and discussion (locale) resolve the same id; log
the effective registeredVoiceId. Regression tests for pickNarratorAgent.
Verified e2e: agent-profiles -> 1 voice registration -> 16 narration TTS all
referencing the same registeredVoiceId; voice present on the backend.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* feat(tts): fall back to persona as the voice seed for agents without a voiceDesign (#670)
Preset/default agents carry no LLM voiceDesign. Rather than add a static field,
derive the bootstrap descriptor from the agent's persona when voiceDesign is
absent, so they still register one stable reference voice (stable-but-generic;
persona is not a vocal spec). Generated agents keep their LLM voiceDesign.
Also hardens replay: stage snapshots drop voiceDesign but keep persona.
Unit-tested: resolveAgentVoiceOptions uses real voiceDesign when present, persona
otherwise.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(tts): match Auto Voice by its localized label in the agent voice picker (#670)
The picker filtered on voice.name ('Auto Voice'), but Auto Voice is shown via
its localized label (自动音色). Searching '自动' returned '没有匹配音色'. Match
the localized label for the Auto Voice option so it's findable in any language.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(tts): address code-review round 1 (#670)
- strip parentheses in the voice-design prompt so a paren in the descriptor/
persona can't corrupt the (prompt)text bootstrap delimiter
- gate POST /api/generate/voice on isServerTTSProviderDisabled (#665): a
force-disabled provider was off for the tts route but not this sibling
- check voiceExists before re-registering a client-cached clip, so a cached
voice that's still live isn't needlessly re-uploaded every session
- dedup concurrent ensureRegisteredVoice calls via an in-flight promise map
(eager warm-up + first utterance no longer double bootstrap/register)
- warm up only the narrator (teacher), not every generated agent, to avoid
synthesizing voices at save time for agents that may never speak
- collapse the duplicated vLLM-Omni speech payload into one object
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* chore(tts): prettier formatting (#670)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(tts): key auto-voice memo by (voiceId, backend) so a base-URL change re-registers (#670)
Addresses review (cosarah): registeredThisSession/inFlight were keyed by voiceId
alone, so switching the VoxCPM base URL mid-session made ensureRegisteredVoice
short-circuit and return an id registered only on the old backend — TTS then sent
that stale registeredVoiceId and skipped the inline fallback, failing with
voice-not-found on the new backend. Memo key now includes the base URL; the
IndexedDB clip cache stays keyed by voiceId (the reference clip is
backend-independent and reused to re-register elsewhere). Regression test added.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(tts): include API key in the auto-voice memo key (#670)
Addresses review (cosarah, round 2): memoKeyFor was keyed by (voiceId, baseUrl)
but not the API key. Registration/existence checks and speech calls are
auth-scoped, so switching account/key on the same base URL could reuse a
registeredVoiceId from the old credentials and skip re-validation. Memo key now
includes the API key (in-memory only, never persisted/logged). Regression test
covers the key-switch case.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: 杨慎 <117187635+cosarah@users.noreply.github.com>
In the IndexedDB playback branch, the object URL created via
URL.createObjectURL is revoked only inside the 'ended' listener. When
audio.play() rejects (autoplay policy, decode error, interrupted load)
that listener never fires, so the blob URL — and its backing audio blob —
leaked for the lifetime of the document. During lecture playback play() is
called once per speech action, so repeated failures (e.g. autoplay blocked
before the first user gesture, or rapid stop/skip) accumulate.
Revoke the URL when play() rejects, then re-throw. Adds a regression test.
Co-authored-by: ly-wang19 <ly-wang19@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: wyuc <wang-yc24@mails.tsinghua.edu.cn>
* refactor(quiz): extract grading helpers into lib/quiz/grading
* feat(classroom): add summarizeScenes aggregation helper
* feat(i18n): add classroomComplete translations
* feat(classroom): add ClassroomCompletePage component
* feat(stage): render ClassroomCompletePage when course finishes
* feat(stage): show 'Course complete' slot in sidebar
* chore: apply prettier formatting
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* feat(classroom): richer completion visuals — confetti, gold trophy, stats cards
- Replace lucide Trophy with custom gradient SVG (3x larger, base + stem + star)
- Add one-shot confetti burst (55 particles, 7-color palette, no new dep)
- Add looping sparkles + pulsing halo around trophy
- Redesign stats from thin icon row into metric cards with count-up numbers
- Upgrade quiz block to gradient card with animated gold progress ring
- Add gradient ribbon badge above title, bg-clip gradient title
- Sidebar thumbnail: amber gradient + sparkles + larger filled trophy
- Respect prefers-reduced-motion (skips confetti/sparkles/count-up)
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* fix(stage): show course-complete title in header; tone down sidebar thumbnail
- Header top-left was showing loading fallback on pending slot; now renders
t('stage.courseComplete') when isCourseComplete && isPendingScene
- Sidebar thumbnail was too saturated next to neutral slide thumbnails; back
to soft amber-50 base with a subtle radial glow, smaller muted sparkles,
and colored amber-500 trophy (no more filled white on gradient)
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* fix(classroom): persist submitted quiz answers for completion page
Previously handleSubmit cleared the quizDraft cache, leaving nothing for
the completion page to read — score always showed 0/N. Now submit also
writes to a separate quizAnswers:<sceneId> key that is not cleared by
the normal in-progress draft lifecycle.
- quiz-view: on submit, mirror answers into quizAnswers:<sceneId>
- quiz-view: on retry, remove that persistent key too
- classroom-complete: read quizAnswers first; fall back to quizDraft so
an unsubmitted attempt still shows partial progress rather than 0
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* feat(quiz): persist submitted quiz state across unmounts
Before: remounting a quiz scene after submit restarted it from 'not_started'
because the draft cache was cleared at submit time. Reopening meant redoing
everything.
Now on mount, read quizAnswers:<sceneId> + quizResults:<sceneId> and restore:
- Both present → jump to 'reviewing' with graded answers and feedback
- Only answers (mid-grading unmount) → 'answering' with answers pre-filled
- Neither → fall through to existing draft-restore path
Results are persisted when the grading useEffect transitions to 'reviewing',
and both keys are cleared together by handleRetry.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* fix(home): prevent horizontal shift when recent classrooms expand
Expanding recent classrooms could grow the page past the viewport height,
making a vertical scrollbar appear. Because the scrollbar takes layout
width, the centered header and trigger row jumped horizontally. Reserve
the scrollbar gutter on <html> so the gutter is always present and layout
stays stable across expand/collapse.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* fix(home): force always-visible scrollbar to eliminate expand/collapse shift
scrollbar-gutter: stable alone wasn't enough (browser/config dependent).
Adding overflow-y: scroll on html forces the vertical scrollbar to always
occupy layout width, so expanding recent classrooms past the viewport
no longer shifts the centered trigger row.
Trade-off: home page now always shows a scrollbar track, even when
content fits viewport. Acceptable cost for stable layout.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* refactor(quiz): extract persistence module + sweep localStorage on delete
Addresses code review on #484:
1. New lib/quiz/persistence.ts centralizes the three per-scene localStorage
keys (draft / answers / results) behind readSubmittedState,
readAnswersForSummary, writeSubmittedAnswers, writeSubmittedResults,
clearSubmitted, clearAllForScene. quiz-view and classroom-complete now
both consume this module instead of hand-rolling localStorage calls,
removing the schema-coupling between the two components.
2. deleteStageData now collects scene ids before deletion and sweeps the
matching quiz persistence keys, fixing the storage leak when a
classroom is deleted.
3. ClassroomCompletePage gets role=status / aria-live=polite /
aria-label for screen readers to announce the completion moment.
4. Tests: 11 new unit tests covering the persistence module
(read/write/clear roundtrips, draft fallback, corrupt-JSON
tolerance, scene-isolation).
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* fix(classroom): address review on PR #484 (a11y, motion, coupling)
Addresses cosarah's review:
1. prefers-reduced-motion now fully honored — wrap ClassroomCompletePage
in MotionConfig with reducedMotion='always' when the OS preference is
on. This neutralizes the previously-uncovered animations (trophy
float repeat:Infinity, halo pulse repeat:Infinity, page/cards/trophy
entrance fade+scale+spring).
2. Move role='status' off the noisy outer wrapper; replace with a single
sr-only span carrying the title text so screen readers get one clean
announcement instead of every count-up tick. Outer is now a plain
<section aria-label=...>.
3. Wrap ClassroomCompletePageConnected in a motion.div inside
AnimatePresence so leaving the pending slot fades instead of snapping
(matches the loading-overlay branch).
4. quiz-view's draft cache key now uses the draftKey() helper exported
from lib/quiz/persistence so the prefix has one source of truth (no
silent desync if the schema evolves).
5. isCourseComplete now requires scenes.length === outlines.length, so
a partial generation with failed outlines doesn't falsely trigger.
6. aria-hidden on decorative motion wrappers (Confetti, Sparkles,
trophy entrance) for cleaner SR experience.
7. Comment on summarizeScenes useMemo explaining the mount-fresh
assumption.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* chore: prettier-format review-fix changes
CI's format check (pnpm check) failed because the previous commit's
changes weren't run through prettier locally before push.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: 杨慎 <117187635+cosarah@users.noreply.github.com>
* feat(stage): add optional Stage.interactiveMode flag
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* feat(db): add optional interactiveMode column on StageRecord
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* feat(stage-storage): pass interactiveMode through save/list
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* feat(generation): persist interactiveMode when creating a classroom
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* i18n: add classroom.deepInteractive across all locales
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* feat(home): show Deep Interactive badge on classroom cards
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* feat(home): move Deep Interactive badge into thumbnail corner
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* refactor(home): slim Deep Interactive badge to icon-only chip
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* fix(home): use Tooltip component for Deep Interactive badge
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* refactor(home): move Deep Interactive badge to bottom-left corner
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* fix(home): tighten Deep Interactive tooltip placement
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* fix(home): close gap between Deep Interactive tooltip and badge
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* fix(home): edge-align Deep Interactive tooltip without overlap
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* refactor: address code review
- Reuse toolbar.interactiveModeLabel instead of adding a duplicate
classroom.deepInteractive i18n key (was identical to the existing
label in zh-CN and semantically the same in the other 4 locales).
- Drop the v0.2.0 version tag from comments (will go stale at release).
- Document on ManifestStage that omitting interactiveMode is intentional
— imports can't faithfully reproduce the original generation branch.
- Add a brief comment on the Tooltip's negative sideOffset explaining
why the standard positive offset does not visually close the gap here.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* feat: add CODE element type and wb_draw_code/wb_edit_code action types
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* feat: implement wb_draw_code and wb_edit_code in ActionEngine
* feat: add BaseCodeElement with Shiki syntax highlighting and animations
* feat: register CodeElement in renderer and add inline action tags
* feat: add wb_draw_code and wb_edit_code to agent action schemas
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* feat: add code element context to director prompt
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* feat: add code element guidelines and context to prompt builder
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* feat: add i18n keys for code element
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
* fix: prevent whiteboard zoom from intercepting code element scroll
* chore: remove unused code element i18n keys
The code.untitled and code.lines keys were added but never referenced
by the BaseCodeElement component. Remove to reduce i18n maintenance
burden and merge conflict surface.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
* feat: inline language inference in outline generation
Replace manual language selection with automatic inference from user
requirement text. The outline generator now produces a languageDirective
that propagates through the entire generation pipeline.
Key changes:
- Rewrite Language Inference section in outline prompt with decision
rules for foreign language learning, cross-language PDF, proxy
requests, and terminology handling
- Reorder pipeline: outlines before agents, so agent profiles can
use the inferred languageDirective
- Pass languageDirective through scene content/actions generation
- Add SSE streaming of languageDirective from outline generation
- Remove manual language selection UI
Eval test suite:
- 50 test cases covering 9 scenario types: single-language, language
learning, immersive, explicit instruction, code-switching, minimal
input, user profiles, cross-language PDF, locale mismatch
- LLM-as-judge evaluation with configurable inference/judge models
- 50/50 pass rate with gemini-3-flash-preview + gpt-4o judge
- Excluded from CI (requires LLM API keys)
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* chore: remove useless attributes in test case
* feat: pass languageDirective to PBL, remove hardcoded zh-CN/en-US
- Remove pblConfig.language field, use languageDirective from outline
inference instead
- Delete all Chinese prompt duplicates in pbl-system-prompt.ts,
agent-templates.ts; keep English templates with languageDirective
injection
- Remove zh-CN/en-US branches in generate-pbl.ts (initial prompt,
post-process context, welcome message)
- Pipe languageDirective through scene-generator → generatePBLContent
→ IssueboardMCP → agent templates
- Remove i18n template wrapping from PBL welcome messages in
pbl-renderer.tsx and use-pbl-chat.ts; use LLM-generated content
directly to avoid language mismatch when UI locale ≠ course language
- Update pblConfig schema in outline prompt (remove language field)
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* refactor: clean up legacy language fields, pass languageDirective through buildSceneFromOutline
- Add languageDirective param to buildSceneFromOutline, combining with
outline.languageNote via buildLanguageText
- Remove dead types: AudienceProfile, StylePreferences, LegacyUserRequirements,
SceneOutline.language
- Remove Stage.language and all its propagation (storage, stageInfo, prompt-builder fallback)
- Remove GenerateClassroomInput.language and job store inputSummary.language
- Remove unused pdfLanguageSample from outline SSE route
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* fix: persist languageDirective to IndexedDB, fix TTS preview and dead refs
- Add languageDirective to StageRecord and stage-storage write path
- Add DB v9 migration: convert legacy language locale codes to directives
- Use voice.language for TTS preview text instead of dead localStorage key
- Omit empty ## Language section in PBL agent prompts
- Use JSON.parse for extractLanguageDirective unescape (\uXXXX support)
- Remove dead i18n keys: toolbar.languageHint, pbl.chat.welcomeMessage
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* fix: preserve preset agent selection when switching classrooms
When switching from an auto-agent classroom to a preset classroom,
the stale generated agent IDs remained in selectedAgentIds because
the load path skipped setSelectedAgentIds when no generated agents
were found. Add a dedicated presetSelectedAgentIds field to persist
the user's preset preference separately from the runtime selection,
so auto classrooms never corrupt the user's saved preset choice.
Closes#239
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* style: format settings.ts with prettier
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* refactor: persist agent IDs in stage instead of global settings
Replace the global presetSelectedAgentIds approach with per-stage
agent storage. Each classroom now saves its selected agent IDs into
stage.agentIds at creation time, and restores them when the classroom
is loaded. This makes agent selection a per-classroom property rather
than a global setting that can be corrupted by auto classrooms.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* ci: retrigger CodeQL analysis
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* feat(generate): server-side media & TTS generation in classroom pipeline
When `enableImageGeneration`, `enableVideoGeneration`, or `enableTTS` flags
are passed to /api/generate-classroom, the server now actually generates
media files and TTS audio, persists them to disk, and replaces placeholders
in the classroom JSON with serving URLs.
- Add media serving API route (GET /api/classroom-media/[id]/[...path])
- Add server-side media generation utility (image, video, TTS)
- Wire generation phases into classroom pipeline with progress steps
- Update AudioPlayer to support URL-based playback (server-generated TTS)
- Add audioUrl field to SpeechAction type
- Extend /api/health with capabilities detection
- Pass through feature flags in generate-classroom route
- Update skill docs for optional feature configuration
Closes#49
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* style: fix prettier formatting
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* feat(generate): add agentMode support for server-side classroom generation
Allow callers to choose between built-in default agents ('default') or
LLM-generated custom agent profiles ('generate') via a new agentMode
field on GenerateClassroomInput. The resolved agents are injected into
outline, scene content, and scene action prompts via teacherContext.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* fix(media): harden download, parallelize media gen, fix TTS concatenation
- Add timeout (2min) and max size (100MB) guard to downloadToBuffer
- Run image and video generation in parallel via Promise.all
- Only split TTS text for MP3 (frame-based); skip for WAV/OGG/AAC
whose container headers break on naive byte concatenation
- Remove unnecessary type assertion for speechAction.audioUrl
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* style: fix prettier formatting
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* fix(media): harden media serving and TTS generation
- Add realpath check to prevent symlink-based path traversal in media route
- Stream files via createReadStream instead of readFile to avoid OOM on large videos
- Truncate TTS text for non-concatenable formats (WAV/OGG/AAC) when exceeding provider limit
- Add 'researching' step to distinguish web search from outline generation progress
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* fix(tts): split long speech actions instead of concatenating audio bytes
Adopt the same strategy as client-side: split a long speech action into
multiple shorter actions before TTS generation, so each sub-action gets
its own audio file. This avoids the broken byte-concatenation approach
that corrupted non-MP3 formats (WAV/OGG/AAC container headers).
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* refactor(tts): extract shared TTS splitting logic into lib/audio/tts-utils
Both client-side (use-scene-generator) and server-side (classroom-media-generation)
had duplicated TTS_MAX_TEXT_LENGTH, text splitting, and action splitting logic.
Extract into a shared module to keep them in sync.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* chore: remove unused TTS_MAX_TEXT_LENGTH import
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: wyuc <wang-yc24@mails.tsinghua.edu.cn>
* feat: add whiteboard history and auto-save (closes#32)
- New whiteboard-history.tsx: browseable history panel UI
- New whiteboard-history.ts: Zustand store with snapshot stack,
fingerprint-based deduplication, and restoredKey one-shot guard
- New element-fingerprint.ts: shared fingerprint utility (id+position+size)
- whiteboard-canvas.tsx: auto-snapshot effect that saves the current stable
state after 2s debounce; unified fingerprint import; useMemo for elements
- index.tsx: pushSnapshot before UI clear; history panel trigger button
- stage.ts: i18n keys for history UI (zh/en)
* fix: address audit findings for whiteboard history
- engine.ts: AI wb_clear now saves snapshot before clearing (audit #3)
- page.tsx: clear whiteboard history on classroom switch (audit #4)
* fix: address review round 2 (P1/P2a/P2b/P3)
- P1: Block restore during clear animation (race condition)
- P2a: Skip no-op restores to avoid stale restoredKey
- P2b: clearHistory() now also resets restoredKey
- P3: Dedicated restoreError i18n key
* fix: fingerprint includes semantic content per element type (P2c)
* fix: address reviewer feedback (fingerprint cache, AI clear label, exhaustive check)