recipe
Validate LLM output before it propagates
· 2 min read
Bad structured output exits 1 before reaching downstream systems - you catch schema drift at the source, not in production. Gate the pipeline on ...
tag
#kv
6 posts tagged #kv
recipe
Scrub secrets from LLM output
· 2 min read
Catches secrets the model echoes back before they reach storage - one leaked API key in kv is a breach. Mask any accidentally leaked secrets before ...
recipe
JWT-based key lookup
· 1 min read
Ties storage to identity without custom parsing - the JWT carries the key, so the lookup stays stateless and auditable. Extract a claim from a JWT ...
recipe
Chunked RAG pipeline
· 1 min read
Keeps every chunk within the embedding model's token limit - no silent truncation during indexing. Split a document into chunks and store each for ...
recipe
Cache LLM response
· 1 min read
Avoids duplicate API calls for identical prompts - the hash keys the cache so reruns are free. Send a prompt, get the request hash, and store the ...
recipe
Batch LLM with rate limiting
· 2 min read
Prevents failure at job 847 of 10,000 - throttle paces filenames so each API call respects the rate limit. Process a large document set without ...