Class SpringAIBaiduService
java.lang.Object
com.bytedesk.ai.springai.service.BaseSpringAIService
com.bytedesk.ai.springai.providers.baidu.SpringAIBaiduService
- All Implemented Interfaces:
SpringAIService
-
Nested Class Summary
Nested classes/interfaces inherited from class com.bytedesk.ai.springai.service.BaseSpringAIService
BaseSpringAIService.PromptResult -
Field Summary
FieldsFields inherited from class com.bytedesk.ai.springai.service.BaseSpringAIService
applicationEventPublisher, chunkElasticService, chunkVectorService, faqElasticService, faqVectorService, messagePersistCache, messageRestService, messageSendService, robotMessageCache, robotRestService, textElasticService, textVectorService, threadRestService, uidUtils -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionprivate org.springframework.ai.openai.OpenAiChatModel根据机器人配置创建动态的OpenAiChatModelprivate org.springframework.ai.openai.OpenAiChatOptions根据机器人配置创建动态的OpenAiChatOptionsprivate ChatTokenUsageestimateBaiduTokenUsageFromResponse(org.springframework.ai.chat.model.ChatResponse response) 估算百度API的token使用量(当无法从API获取实际token信息时使用)private ChatTokenUsageestimateBaiduTokenUsageFromText(String outputText) 从完整响应文本估算百度API的token使用量private longestimateTokens(String text) 估算文本的token数量private ChatTokenUsageextractBaiduTokenUsage(org.springframework.ai.chat.model.ChatResponse response) 专门为百度API提取token使用情况 由于百度API返回的usage字段是EmptyUsage对象,需要特殊处理protected voidprocessPromptSse(org.springframework.ai.chat.prompt.Prompt prompt, RobotProtobuf robot, MessageProtobuf messageProtobufQuery, MessageProtobuf messageProtobufReply, org.springframework.web.servlet.mvc.method.annotation.SseEmitter emitter, String fullPromptContent) protected StringprocessPromptSync(String message, RobotProtobuf robot, String fullPromptContent) protected voidprocessPromptWebsocket(org.springframework.ai.chat.prompt.Prompt prompt, RobotProtobuf robot, MessageProtobuf messageProtobufQuery, MessageProtobuf messageProtobufReply, String fullPromptContent) Token usage data classMethods inherited from class com.bytedesk.ai.springai.service.BaseSpringAIService
createDynamicOptions, extractFullPromptContent, extractTextFromResponse, extractTokenUsage, getTokenUnitPrice, handleSseError, isEmitterCompleted, persistMessage, persistMessage, persistMessage, persistMessage, processDirectLlmRequest, processLlmResponseWebsocket, publishAiTokenUsageEvent, recordAiTokenUsage, searchKnowledgeBase, sendMessageWebsocket, sendSseMessage, sendStreamEndMessage, sendStreamMessage, sendStreamStartMessage, sendSyncMessage, sendWebsocketMessage
-
Field Details
-
llmProviderRestService
-
-
Constructor Details
-
SpringAIBaiduService
public SpringAIBaiduService()
-
-
Method Details
-
createDynamicOptions
根据机器人配置创建动态的OpenAiChatOptions- Parameters:
llm- 机器人LLM配置- Returns:
- 根据机器人配置创建的选项
-
createBaiduChatModel
根据机器人配置创建动态的OpenAiChatModel- Parameters:
llm- 机器人LLM配置- Returns:
- 配置了特定模型的OpenAiChatModel
-
processPromptWebsocket
protected void processPromptWebsocket(org.springframework.ai.chat.prompt.Prompt prompt, RobotProtobuf robot, MessageProtobuf messageProtobufQuery, MessageProtobuf messageProtobufReply, String fullPromptContent) Description copied from class:BaseSpringAIServiceToken usage data class- Specified by:
processPromptWebsocketin classBaseSpringAIService
-
processPromptSync
- Specified by:
processPromptSyncin classBaseSpringAIService
-
processPromptSse
protected void processPromptSse(org.springframework.ai.chat.prompt.Prompt prompt, RobotProtobuf robot, MessageProtobuf messageProtobufQuery, MessageProtobuf messageProtobufReply, org.springframework.web.servlet.mvc.method.annotation.SseEmitter emitter, String fullPromptContent) - Specified by:
processPromptSsein classBaseSpringAIService
-
extractBaiduTokenUsage
private ChatTokenUsage extractBaiduTokenUsage(org.springframework.ai.chat.model.ChatResponse response) 专门为百度API提取token使用情况 由于百度API返回的usage字段是EmptyUsage对象,需要特殊处理- Parameters:
response- ChatResponse对象- Returns:
- TokenUsage对象
-
estimateBaiduTokenUsageFromResponse
private ChatTokenUsage estimateBaiduTokenUsageFromResponse(org.springframework.ai.chat.model.ChatResponse response) 估算百度API的token使用量(当无法从API获取实际token信息时使用)- Parameters:
response- ChatResponse对象- Returns:
- 估算的TokenUsage对象
-
estimateBaiduTokenUsageFromText
从完整响应文本估算百度API的token使用量- Parameters:
outputText- 完整的输出文本- Returns:
- 估算的TokenUsage对象
-
estimateTokens
估算文本的token数量- Parameters:
text- 输入文本- Returns:
- 估算的token数量
-