LLMServiceBuilder Member List

This is the complete list of members for LLMServiceBuilder, including all inherited members.

batchSize(int val) (defined in LLMServiceBuilder)	LLMServiceBuilder	inline
build() (defined in LLMServiceBuilder)	LLMServiceBuilder	inline
contextSize(int val) (defined in LLMServiceBuilder)	LLMServiceBuilder	inline
embeddingOnly(bool val) (defined in LLMServiceBuilder)	LLMServiceBuilder	inline
flashAttention(bool val) (defined in LLMServiceBuilder)	LLMServiceBuilder	inline
loraPaths(const std::vector< std::string > &paths) (defined in LLMServiceBuilder)	LLMServiceBuilder	inline
model(const std::string &path) (defined in LLMServiceBuilder)	LLMServiceBuilder	inline
numGPULayers(int val) (defined in LLMServiceBuilder)	LLMServiceBuilder	inline
numSlots(int val) (defined in LLMServiceBuilder)	LLMServiceBuilder	inline
numThreads(int val) (defined in LLMServiceBuilder)	LLMServiceBuilder	inline