cosiftsearch + research infrastructure

Public corpus onlineSource ↗

Open-source search for agents

Cosift turns a web corpus into
an agent-callable research surface.

Search ranked documents, fetch cleaned contents, generate answers with attached sources, or run bounded multi-step research. Use the live public corpus through Pilot, or operate the complete Cosift stack on your own infrastructure.

Try Cosift live →Install through Pilot

Use the public corpus
Run your own backend
Structured JSON throughout

io.pilot.cosiftready

Callpilotctl appstore call io.pilot.cosift cosift.search '{"q":"raft leader election","retriever":"hybrid","k":"3"}'

Representative response shape

{
  "query": "raft leader election",
  "retriever": "bm25+dense:rrf",
  "hits": [
    { "url": "…", "title": "…", "excerpt": "…" },
    { "url": "…", "title": "…", "excerpt": "…" }
  ],
  "warnings": [],
  "took": "…"
}

Choose the work, not another integration

One product.
Three research depths.

Agents can choose a cheap retrieval call, a cited answer, or a bounded research run. cosift.help describes the choice at runtime.

01Fast

cosift.search

Return ranked evidence.

Search the indexed corpus with BM25, dense, or hybrid retrieval. The response carries URLs, titles, excerpts, scores, and the retriever that actually ran.

02Medium

cosift.answer

Answer one question with sources.

Retrieve a bounded source set, synthesize a direct answer, and keep numeric citations attached to the documents supplied to the model.

03Slow

cosift.research

Plan a multi-step research run.

Break a larger question into sub-queries, retrieve across them, fuse the evidence, and produce one cited report within explicit work limits.

How Cosift reaches an agent

A small front door.
A complete search stack.

The Pilot app is a thin local adapter. Crawling, indexing, retrieval, and synthesis stay in the Cosift backend—either the public instance or one you operate.

01Agent or harnessstructured method call

02Pilot daemonlocal app supervisor

03Cosift appsigned IPC → HTTP adapter

04Cosift backendpublic or self-hosted

Crawl→Index→Retrieve→Answer / research

Public corpusInstall and call immediately. The public Cosift backend receives the query; no backend configuration is required.

Your corpusRun the Go service and model endpoints on your infrastructure, then point the same adapter at that boundary.

Install through PilotTwo commands to a discoverable research surface.

1pilotctl appstore install io.pilot.cosift
2pilotctl appstore call io.pilot.cosift cosift.help '{}'

The app declares its file, audit, and network grants. Pilot verifies the catalogue, bundle, manifest signature, and pinned binary before execution. The Pilot adapter buffers answer and research into one JSON reply today; direct Cosift HTTP supports SSE streaming.

The published agent surface

Eight methods.
No API archaeology.

The current Pilot app exposes the useful product surface without copying the entire operator API into an agent’s tool list.

Retrieve

cosift.search

Rank documents with lexical, dense, or hybrid retrieval.

cosift.find_similar

Find neighboring documents from an indexed URL or supplied text.

cosift.contents

Return cleaned document text for one URL or a batch.

Synthesize

cosift.answer

Generate a single cited answer from retrieved sources.

cosift.research

Run bounded planning, multi-retrieval, fusion, and synthesis.

Inspect

cosift.stats

Inspect corpus shape and available retrievers.

cosift.health

Check whether the configured backend is reachable.

cosift.help

Discover methods, parameters, kinds, and latency classes locally.

Inspect what really happened

Cosift does not turn retrieval into a mystery number.

Source records stay attached to synthesized answers. Responses identify the effective retriever, report capability fallbacks as warnings, and do not pretend that an unfitted global confidence model is calibrated.

Read the response contracts ↗

requestedretriever=hybrid

executedbm25+dense:rrf

evidencesources[]

confidencecalibrated: false

Cosift workflow mapper

Bring one real question.
Leave with the right Cosift call.

Tell us what the agent needs back. We will map it to search, contents, answer, or research and outline whether the public corpus or a self-hosted Cosift backend is the better fit.

What you get

01Recommended Cosift method
02Example payload and response shape
03Public or self-hosted deployment path

Technical basis

Cosift ships as inspectable code.
The details are not implied.

Product evidenceCosift source + live APIReviewed 17 September 2026Inspect Cosift source →

01Single-binary crawler, index, and API
02BM25, HNSW dense, hybrid RRF, and reranking
03Cited answer and bounded research methods
04SQLite or multi-million-document Pebble backend

Return ranked evidence.

Answer one question with sources.

Plan a multi-step research run.

Retrieve

Synthesize

Inspect

Bring one real question.Leave with the right Cosift call.

Cosift ships as inspectable code.The details are not implied.

The workflow rarely endsat one boundary.

Bring one real question.
Leave with the right Cosift call.

Cosift ships as inspectable code.
The details are not implied.

The workflow rarely ends
at one boundary.