Abstract
Software applications face critical challenges in rapidly and precisely mitigating emergent threats such as safety incidents or query-of-death attacks originating from or affecting backend calls. This disclosure describes techniques for dynamic, real-time, intelligent blocking or modification of harmful or problematic backend service call responses. The techniques combine traditional filtering with semantic analysis using a large language model (LLM). A control plane enables operators such as site reliability engineers (SREs) to define and deploy mitigation rules on-the-fly, without code changes or lengthy propagation delays. This enables rapid and precise response to emergent threats, such as safety incidents involving AI-generated content or query-of-death issues, thereby minimizing service disruption and user impact.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Start, Johannes and Lunney, John, "LLM-augmented Dynamic Selective Blocking of Service Calls for Application Control", Technical Disclosure Commons, ()
https://www.tdcommons.org/dpubs_series/8988