Research Infrastructure

WHL Knowledge Layer. Platform Substrate.

536,264 documents indexed. 22GB SQLite corpus. FTS5 full-text plus semantic vector search using 768-dimensional embeddings. Flask query interface, self-hosted. Deep coverage of physics, mathematics, cryptography, philosophy, signal processing, and governance systems. Powers Cascade routing, GE-OS decision pathways, Safe Agent Runtime reasoning, and internal research. Queryable today.

536K
Documents Indexed
22GB
SQLite Corpus
FTS5 + Semantic
Hybrid Retrieval
Local
Self-Hosted Flask UI
How the Knowledge Layer Works

A 22GB indexed research corpus with hybrid full-text and semantic retrieval.

The substrate stores 536,264 documents in a SQLite corpus with two retrieval paths working in parallel: SQLite FTS5 for exact-term and lexical search, and a 768-dimensional vector store for semantic similarity. Queries hit both. Results carry document provenance and an integrity-anchored corpus reference.

Why the Knowledge Layer

A corpus you can search, cite, and trust the integrity of.

Cascade, GE-OS, and Safe Agent Runtime all benefit from a backing corpus: one integrity-anchored document set where the research context for decision pathways is provable across sessions and auditable. The Knowledge Layer serves as the shared reasoning substrate.

Hybrid Retrieval

FTS5 plus semantic vectors in the same query path. Lexical precision when you know the term, semantic recall when you don't. One result panel, two index types.

Integrity-Anchored

Corpus carries a SHA-256 anchor. Two decision pathways querying the same knowledge layer get the same document set. Audit trails over reasoning workflows become possible.

Part of the Stack

Integrated with Cascade (task routing), GE-OS (governance), and Safe Agent Runtime (continuous loops). Shared infrastructure, one corpus reference, deterministic decisions.

Verified Output

Tests pass. Receipts on disk.

Health check on the live knowledge layer.

$ python tools/health_check.py
Connecting to ACTIVE_KNOWLEDGE.db (22.0 GB)...
Total documents:      536,264
FTS5 index status:    ready
Embedding coverage:   128,256 / 536,264 (semantic)
Sample query "phi":   6,206 hits in 12 ms
Sample query "consciousness": 6,070 hits in 9 ms
Sample query "governance": 4,847 hits in 8 ms
Flask UI status:      running
Corpus SHA-256:       [anchored, verifiable on request]

Verified live: 536,264 documents indexed, FTS5 + 128K semantic embeddings, self-hosted. Corpus hash anchored. Powers Cascade, GE-OS, and Safe Agent Runtime reasoning.

Platform Infrastructure · Integrated with All Core Systems

Explore the Knowledge Layer architecture.

The Knowledge Layer is part of the WHL platform stack. For details on how it integrates with Cascade, GE-OS, and Safe Agent Runtime, request an architecture brief.