Radoslav Gerganov d26d1c8b85 rpc : cache and reuse compute graphs (llama/15405) ... Store the last computed graph and reuse it when possible. Also do not return response from GRAPH_COMPUTE and assume it always completes successfully. If this this is not the case, the server closes the connection. This saves us a network round trip to the server.		2025-12-12 17:53:11 +02:00
..
CMakeLists.txt	ggml : add support for dynamic loading of backends (llama/10469)	2024-12-08 20:14:35 +02:00
ggml-rpc.cpp	rpc : cache and reuse compute graphs (llama/15405)	2025-12-12 17:53:11 +02:00