Cosift field guideNo. 05
Grounded private research

Answers are cheap.
Evidence is the product.

Build a private research surface that shows where an answer came from, how the evidence was retrieved, and whether the final response stays grounded in the sources you control.

What changed in the enterprise policy?
Research answer4 sources · 0.91 grounding

The policy now requires human approval before external transfers.

The August revision adds a review checkpoint for transfers outside approved counterparties and records the reviewer identity in the audit export.1 Existing internal transfers retain the prior threshold.2

  1. 01
    Enterprise policy · Aug 2026§4.2 External counterparties
    92%
  2. 02
    Transfer controls handbookThreshold and exception matrix
    87%
  3. 03
    Audit export referenceReviewer attribution fields
    81%
Answer generated from the approved indexView retrieval trace ↗
Retrieval is an engineering system

Measure the path
from corpus to claim.

Private knowledge is fragmented across websites, documents, and application boundaries. Even after it is indexed, a plausible answer can outrun its evidence. Cosift keeps the retrieval path visible and supports evaluation alongside generation, so teams can test source coverage, ranking, and answer grounding rather than relying on fluency alone.

StageWhat Pilot contributesInspectable output
01 · Collect

Self-hostable crawling and indexing

Choose the sources and retain control over the index, administration surface, and model endpoints.

Source inventory
02 · Retrieve

Lexical, dense, and hybrid search

Use BM25, optional embeddings, reranking, expansion, HyDE, and diversity controls for the query at hand.

Ranked passages
03 · Answer

Cited research workflows

Query, answer, and multi-step research endpoints return source context instead of hiding the retrieval trace.

Cited answer
Evaluation loop

Fluency is not the acceptance test.

Cosift keeps collection, retrieval, generation, and evaluation as separate observable stages. Teams can improve the stage that failed instead of treating search quality as model intuition.

  1. 01

    Define the source boundary

    Crawl the approved public or private knowledge surfaces.

  2. 02

    Select a retrieval strategy

    Start with BM25 or add dense retrieval and reranking where they improve measured quality.

  3. 03

    Ask for an answer or research run

    The agent receives the response together with source references.

  4. 04

    Evaluate the result

    Built-in retrieval and answer checks make quality a repeatable engineering concern.

Retrieval evaluation

Design a grounded-search test
for your own corpus.

Share the shape of the knowledge base and one question that matters. We will outline the crawl, retrieval, citation, and evaluation path worth testing.

What you get
  1. 01Source and crawl boundary
  2. 02Retrieval baseline
  3. 03Grounding evaluation plan
Start with one real workflowAbout 2 minutes

Do not include credentials, secrets, or customer data. By submitting, you agree that Pilot may use this information to respond. Privacy Policy.

Technical basis

Specific product surfaces.
Inspectable in the docs.

Product reviewPilot release 1.13.9Inspect documentation
  • 01Self-hostable crawler and index
  • 02BM25 plus optional hybrid retrieval
  • 03Source-cited answer and research APIs
  • 04Offline retrieval and answer evaluation