Foto 7

Elenco Pubblicazioni - Publications (1660)

We introduce a load-aware selective embedding-pruning method to be used in dense retrieval systems. Our method adapts the embedding dimensionality at inference time based on per-query deadlines and the current queue occupancy. Under light load,…
Computing-Aware Traffic Steering (CATS) optimizes the assignment of user requests to replicated service instances by jointly considering network and computing conditions.Although CATS has been widely studied for single-service scenarios, cloud--edge continuum deployments are typically multi-tenant:…