2026-09-01 14:31:30 +08:00
2026-08-31 20:53:53 +08:00

Enterprise Knowledge Platform

Enterprise internal knowledge infrastructure.

Core capabilities

  • Multi-format document ingestion
  • OCR and document parsing
  • Structure-aware chunking
  • Multiple embedding providers
  • Hybrid retrieval and reranking
  • ACL-aware search
  • Knowledge Compilation
  • REST API
  • MCP Server
  • Admin Console

Architecture baseline

  • API First + Admin Console
  • Modular Monolith + async workers + MCP gateway
  • PostgreSQL + object storage as canonical source of truth
  • Mochow as the initial retrieval index, behind a replaceable adapter
  • Embedding / reranker / parser / LLM providers are replaceable
  • Raw source is immutable
  • Compiled Knowledge is derived and traceable
  • ACL is enforced before or during retrieval, never after Top-K

Start here

  1. Read AGENTS.md
  2. Read CODEX_START_HERE.md
  3. Read docs/product/PRD.md
  4. Read docs/architecture/ARCHITECTURE.md
  5. Read docs/plans/V1_EXECUTION_PLAN.md
  6. For the current milestone, read docs/demo/DEMO_SCOPE.md and pick exactly one DEMO-* task. The V1 tasks in docs/plans/TASKS.md remain the deferred product backlog.

Demo development

The current implementation target is the retrieval demo defined in docs/demo/DEMO_SCOPE.md.

Prerequisites:

  • uv
  • Docker (for PostgreSQL and later integration dependencies)

Install dependencies and run the API:

cp .env.example .env
make install
make run

The health endpoint is available at http://localhost:8000/healthz, and the versioned OpenAPI document is available at http://localhost:8000/api/v1/openapi.json.

Run the development checks with:

make format-check lint typecheck test migration-check eval

Document metadata is canonical in PostgreSQL. Demo source files use the local storage/ directory through the provider-neutral ObjectStorage interface; existing objects cannot be overwritten. The upload service accepts PDF, DOCX, TXT, and MD sources, streams at most MAX_UPLOAD_BYTES, and compensates stored bytes if metadata persistence fails. The ingestion service then routes PDF to PyMuPDF, DOCX to python-docx, and UTF-8 TXT/Markdown to lightweight parsers. It normalizes whitespace, retains available page/section context, and stores a versioned parsed JSON artifact under parsed/{document_id}/document.json. The structure_v1 chunk strategy keeps heading/section boundaries, combines paragraphs, and creates configurable 450-token windows with a 75-token overlap. Chunk metadata, including deterministic IDs, filename, page range, section, index, and strategy version, is stored atomically in PostgreSQL. The lightweight token counter is replaceable so DEMO-006 can inject model-specific behavior. Documents remain processing until embedding/indexing completes; pipeline failures become failed without deleting the immutable original. Public upload endpoints are introduced by DEMO-009.

Description
知识平台
Readme 1.9 MiB
Languages
Python 88.7%
CSS 3.8%
JavaScript 2.8%
HTML 1.6%
Shell 0.9%
Other 2.2%