Dixie is capped (max_inflight 2, queue_depth 8, queue_wait 20s) and never queued on llama-server. Streaming chat, thinking off, 45s fallback to clean. Digest and chunk-embedding caches are content-addressed SQLite (Honcho context is not cached). Recover uses the guarded Fetcher. guardian-star is refused in code.
13 lines
273 B
Go
13 lines
273 B
Go
//go:build libc.memexpvar
|
|
|
|
package libc
|
|
|
|
import "expvar"
|
|
|
|
func init() {
|
|
// make sure to build with -tags=memory.counters to have the actual data accumulated in memory allocator
|
|
expvar.Publish("memory.allocator", expvar.Func(func() interface{} {
|
|
return MemStat()
|
|
}))
|
|
}
|