kyle/sift

T

kyle 8e3a6cd339 p1: cap jq output, log refusals, fail contract without SDK

jq results are bounded (10k items / output cap) and return 400 when
exceeded. 401/403 log caller, host, and reason. make contract exits 1
unless firecrawl-py is present (SIFT_CONTRACT_SKIP_SDK=1 to skip).

2026-09-22 22:02:38 -07:00

cmd/sift

p1: /v2/scrape, /v1/fetch, auth, CLI, contract tests

2026-09-22 21:54:01 -07:00

dist

p1: /v2/scrape, /v1/fetch, auth, CLI, contract tests

2026-09-22 21:54:01 -07:00

docs

docs: P1 spec — clean fetch, auth, CLI, contract facts from firecrawl-py 4.17.0, talos wiring

2026-09-22 21:38:29 -07:00

internal

p1: cap jq output, log refusals, fail contract without SDK

2026-09-22 22:02:38 -07:00

nix

p1: /v2/scrape, /v1/fetch, auth, CLI, contract tests

2026-09-22 21:54:01 -07:00

skill

p1: /v2/scrape, /v1/fetch, auth, CLI, contract tests

2026-09-22 21:54:01 -07:00

tests/contract

p1: cap jq output, log refusals, fail contract without SDK

2026-09-22 22:02:38 -07:00

vendor

p1: /v2/scrape, /v1/fetch, auth, CLI, contract tests

2026-09-22 21:54:01 -07:00

.gitignore

p0: skeleton, dialer-Control URL guard, flake, Makefile

2026-09-22 21:26:13 -07:00

flake.lock

p0: skeleton, dialer-Control URL guard, flake, Makefile

2026-09-22 21:26:13 -07:00

flake.nix

p1: /v2/scrape, /v1/fetch, auth, CLI, contract tests

2026-09-22 21:54:01 -07:00

go.mod

p1: /v2/scrape, /v1/fetch, auth, CLI, contract tests

2026-09-22 21:54:01 -07:00

go.sum

p1: /v2/scrape, /v1/fetch, auth, CLI, contract tests

2026-09-22 21:54:01 -07:00

Makefile

p1: cap jq output, log refusals, fail contract without SDK

2026-09-22 22:02:38 -07:00

README.md

p1: /v2/scrape, /v1/fetch, auth, CLI, contract tests

2026-09-22 21:54:01 -07:00

README.md

sift

LLM-oriented fetch and search for the Hermes fleet: fetch a resource and get it back cleaned, compact, and with useful context attached — using local models (Dixie), SearXNG and Brave on orion, and Honcho for retrieval.

Status: P1 clean fetch (/v2/scrape, /v1/fetch, CLI, auth). See docs/PLAN.md and docs/P1.md.

Build

Makefile is the source of truth for flags (CGO_ENABLED=0, -trimpath, -s -w -X main.version=).

make build          # bin/sift
make test           # go test -race ./...
make lint           # go vet, and staticcheck if installed
make install        # PREFIX=/usr/local; example config in /etc/sift/
nix build           # packages.sift, same ldflags
nix flake check     # make test lint

The service does not assume Nix store paths. Non-Nix hosts: make install plus dist/sift.service.