2026-09-02 20:18:58 +08:00

939 B

Test Strategy

Unit tests must run without OceanBase, BOS, Qianfan, internet, GPU or production credentials.

Provide deterministic fakes:

  • FakeEmbeddingProvider
  • FakeRerankerProvider
  • FakeVectorStore
  • FakeLLMProvider
  • FakeObjectStorage

External integrations use separate integration suites/markers.

Async ingestion tests run with an in-process recording dispatcher and deterministic providers. They must cover persisted Job/Attempt history, safe error summaries, bounded retry, cleanup-before-retry, active-lease duplicate delivery, expired-lease recovery, immutable-source preservation and terminal cleanup failure without requiring a live RabbitMQ broker.

E2E covers upload -> parse -> chunk -> embed -> index -> retrieve -> source trace, and source -> compilation draft -> review -> publish -> retrieval.

Any parsing/chunking/embedding/fusion/retrieval/reranking/query-routing change must run the Golden Dataset evaluation.