22 lines
939 B
Markdown
22 lines
939 B
Markdown
# Test Strategy
|
|
|
|
Unit tests must run without OceanBase, BOS, Qianfan, internet, GPU or production credentials.
|
|
|
|
Provide deterministic fakes:
|
|
- FakeEmbeddingProvider
|
|
- FakeRerankerProvider
|
|
- FakeVectorStore
|
|
- FakeLLMProvider
|
|
- FakeObjectStorage
|
|
|
|
External integrations use separate integration suites/markers.
|
|
|
|
Async ingestion tests run with an in-process recording dispatcher and deterministic providers. They
|
|
must cover persisted Job/Attempt history, safe error summaries, bounded retry, cleanup-before-retry,
|
|
active-lease duplicate delivery, expired-lease recovery, immutable-source preservation and terminal
|
|
cleanup failure without requiring a live RabbitMQ broker.
|
|
|
|
E2E covers upload -> parse -> chunk -> embed -> index -> retrieve -> source trace, and source -> compilation draft -> review -> publish -> retrieval.
|
|
|
|
Any parsing/chunking/embedding/fusion/retrieval/reranking/query-routing change must run the Golden Dataset evaluation.
|