ai_summary API Goes Fully Deterministic: Your Instruction Is the Prompt, Byte for Byte

· API · Improvement · All updates
The ai_summary API is now fully deterministic: your instruction is the prompt. Whatever you send in instruction is exactly what the model reads, byte for byte. Nothing reorders it, relabels it, appends to it or shortens it, so a prompt you tuned behaves the same on every call. Retrieval stays yours: run embed_and_search, take your top results and place them in the prompt where you want them. The query and context parameters still work for existing integrations. Prompts up to 100,000 characters are accepted.
View the full changelog