recipe
Validate LLM output before it propagates
· 2 min read
A bad structured response exits 1 before it reaches downstream systems, so you catch schema drift at the source. Check the LLM response against a ...
tag
#kv
8 posts tagged #kv
recipe
Scrub secrets from LLM output
· 2 min read
A model can echo a secret back, and mask removes it before it reaches storage. Redact secrets from an LLM response before the pipeline stores it in ...
recipe
Page change detector
· 2 min read
You find out when a page changes, and you need no scraper, database, or diff tool. Hash the text of a web page and compare it with the hash stored on ...
recipe
JWT-based key lookup
· 1 min read
The JWT carries the key, so the lookup needs no custom parsing and no extra state. Read the sub claim from a JWT and use it as a key to look up data ...
recipe
Daily token budget
· 2 min read
The counter refuses the call once the daily limit is reached, so a runaway loop cannot use up your API budget. Add each prompt's token count to a kv ...
recipe
Chunked RAG pipeline
· 1 min read
Each chunk stays within the token limit of the embedding model, so indexing does not truncate text silently. Split a document into token-sized chunks ...
recipe
Cache LLM response
· 2 min read
The content hash is the cache key, so a rerun with the same input makes no API call. Hash the input, look the hash up in kv, and call the model only ...
recipe
Batch LLM with rate limiting
· 2 min read
throttle releases filenames at a fixed rate, so each API call stays inside the rate limit. Process a large set of documents at a fixed request rate, ...