Abstract
This disclosure describes techniques for cache efficient assignment of serving tasks (workers) to client requests. Per techniques of this disclosure, a distributed computing system is configured such that a particular client can connect only to a subset of workers of the distributed computing system. To further ensure cache efficiency, the selection of a particular worker of an assigned subset of workers for a client request is based on a hash value of a key generated from a worker identifier. In some implementations, worker selection may be performed based on a consistent hash, wherein the worker (service task) name or identifier, client names or identifier, and/or task counters are provided as an input request key and a subset of workers is selected based on the hash output. Worker selection based on consistent hashing can provide maintainability and monitorability.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
n/a, "Cache Efficient Assignment of Serving Tasks", Technical Disclosure Commons, (May 09, 2025)
https://www.tdcommons.org/dpubs_series/8107