Package com.bytedesk.ai.springai.providers.ollama

Class SpringAIOllamaService

java.lang.Object

com.bytedesk.ai.service.BaseSpringAIService

com.bytedesk.ai.springai.providers.ollama.SpringAIOllamaService

All Implemented Interfaces:

SpringAIService

@Service
public class SpringAIOllamaService
extends BaseSpringAIService

Field Summary

Fields

Modifier and Type	Field	Description
private org.springframework.ai.ollama.OllamaChatModel	defaultChatModel
private LlmProviderRestService	llmProviderRestService
private TokenUsageHelper	tokenUsageHelper

Fields inherited from class com.bytedesk.ai.service.BaseSpringAIService

applicationEventPublisher, chunkElasticService, chunkVectorService, faqElasticService, faqVectorService, knowledgeBaseSearchHelper, messagePersistCache, messagePersistenceHelper, messageRestService, messageSendService, promptHelper, robotMessageCache, robotRestService, sseMessageHelper, textElasticService, textVectorService, threadRestService, uidUtils, webpageElasticService, webpageVectorService

Constructor Summary

Constructors

Constructor	Description
SpringAIOllamaService()

Method Summary

Modifier and Type	Method	Description
org.springframework.ai.ollama.api.OllamaApi	createOllamaApi(String apiUrl)
private org.springframework.ai.ollama.OllamaChatModel	createOllamaChatModel(RobotLlm llm)	根据机器人配置创建动态的OllamaChatModel
private org.springframework.ai.ollama.api.OllamaChatOptions	createOllamaChatOptions(RobotLlm llm)	根据机器人配置创建动态的OllamaChatOptions
Boolean	isModelExists(OllamaRequest request)	检查模型是否存在
protected void	processPromptSse(org.springframework.ai.chat.prompt.Prompt prompt, RobotProtobuf robot, MessageProtobuf messageProtobufQuery, MessageProtobuf messageProtobufReply, List<RobotContent.SourceReference> sourceReferences, org.springframework.web.servlet.mvc.method.annotation.SseEmitter emitter)
protected String	processPromptSync(String message, RobotProtobuf robot)
protected void	processPromptWebsocket(org.springframework.ai.chat.prompt.Prompt prompt, RobotProtobuf robot, MessageProtobuf messageProtobufQuery, MessageProtobuf messageProtobufReply)

Methods inherited from class com.bytedesk.ai.service.BaseSpringAIService

processSyncRequest, sendSseMessage, sendSyncMessage, sendWebsocketMessage

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

llmProviderRestService

@Autowired
private LlmProviderRestService llmProviderRestService

defaultChatModel

@Autowired(required=false)
@Qualifier("bytedeskOllamaChatModel")
private org.springframework.ai.ollama.OllamaChatModel defaultChatModel

tokenUsageHelper

@Autowired
private TokenUsageHelper tokenUsageHelper

Constructor Details

SpringAIOllamaService

public SpringAIOllamaService()

Method Details

createOllamaChatOptions

private org.springframework.ai.ollama.api.OllamaChatOptions createOllamaChatOptions(RobotLlm llm)

根据机器人配置创建动态的OllamaChatOptions

Parameters:

llm - 机器人LLM配置

Returns:

根据机器人配置创建的选项

createOllamaApi

public org.springframework.ai.ollama.api.OllamaApi createOllamaApi(String apiUrl)

createOllamaChatModel

private org.springframework.ai.ollama.OllamaChatModel createOllamaChatModel(RobotLlm llm)

根据机器人配置创建动态的OllamaChatModel

Parameters:

llm - 机器人LLM配置

Returns:

配置了特定模型的OllamaChatModel

processPromptWebsocket

protected void processPromptWebsocket(org.springframework.ai.chat.prompt.Prompt prompt,
 RobotProtobuf robot,
 MessageProtobuf messageProtobufQuery,
 MessageProtobuf messageProtobufReply)

Specified by:

processPromptWebsocket in class BaseSpringAIService

processPromptSync

protected String processPromptSync(String message,
 RobotProtobuf robot)

Specified by:

processPromptSync in class BaseSpringAIService

processPromptSse

protected void processPromptSse(org.springframework.ai.chat.prompt.Prompt prompt,
 RobotProtobuf robot,
 MessageProtobuf messageProtobufQuery,
 MessageProtobuf messageProtobufReply,
 List<RobotContent.SourceReference> sourceReferences,
 org.springframework.web.servlet.mvc.method.annotation.SseEmitter emitter)

Specified by:

processPromptSse in class BaseSpringAIService

isModelExists

public Boolean isModelExists(OllamaRequest request)

检查模型是否存在

Parameters:

model - 模型名称

Returns:

如果模型存在返回true，否则返回false