Skip to content

feat:AI builds a system to add image resources to dialogues #1678

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from
Open

feat:AI builds a system to add image resources to dialogues #1678

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 11 additions & 6 deletions packages/plugins/robot/src/Main.vue
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -186,7 +186,7 @@ export default {
}
},
emits: ['close-chat'],
setup() {
setup(props) {
const {
getBlockContent,
initBlockList,
Expand Down Expand Up @@ -261,16 +261,20 @@ export default {
// 在每一次发送请求之前，都把提示词，给放到第一条消息中
// 为了不污染存储在localstorage里的用户的原始消息，这里进行了简单的对象拷贝
// 引入区块不存放在localstorage的原因：因为区块是可以变化的，用户可能在同一个会话中，对区块进行了删除和创建。那么存放的数据就不是即时数据了。
const getSendSeesionProcess = () => {
const getSendSeesionProcess = async () => {
const sendProcess = { ...sessionProcess }
const firstMessage = sendProcess.messages[0]
let firstContent = firstMessage.content
if (aiType.value === AI_MODES['Builder']) {
const res = await getMetaApi(META_SERVICE.Http).get('/material-center/api/resource/list')
const imageArr = res.map((item) => item.resourceUrl)
const imageStr = imageArr.length ? `[图片资源] ${imageArr}` : ''

firstContent = firstMessage.content.map((item) => {
if (item.type === 'text') {
item.text = `[指令] ${PROMPTS}\n[知识] ${searchContent.value}\n[当前schema] ${JSON.stringify(
pageState.pageSchema
)}`
item.text = `[指令] ${props.options?.prompts ? props.options?.prompts : PROMPTS}\n[知识] ${
searchContent.value
}\n[当前schema] ${JSON.stringify(pageState.pageSchema)}\n${imageStr}`
}
return item
})
Expand Down Expand Up @@ -326,6 +330,7 @@ export default {
const newValue = JSON.parse(match[1])
// 使用 applyPatch 修改 Schema
const result = newValue.reduce(jsonpatch.applyReducer, currentJson)
setSchema(result)
useHistory().addHistory()

sessionProcess.messages.push(getAiRespMessage(JSON.stringify(result, null, 2), chatMessage.role))
Expand Down Expand Up @@ -357,7 +362,7 @@ export default {
const requestLoading = ref(false)
// 发送流式请求
const sendStreamRequest = async () => {
const requestData = getSendSeesionProcess()
const requestData = await getSendSeesionProcess()
if (useMcpServer().isToolsEnabled && aiType.value === AI_MODES['Chat']) {
try {
requestLoading.value = true
Expand Down