Audio chat by julien-nc · Pull Request #292 · nextcloud/assistant

feat(audiochat): implement generic audio chat provider that schedules 3 sub tasks

julien-nc

committed

feat(audio-chat): record audio, store file, submit new fake message

julien-nc

committed

feat(audio-chat): adjust UI to really submit, handle audio attachments in the backend, schedule proper audioChat task

julien-nc

committed

feat(audio-chat): auto play new assistant audio messages

julien-nc

committed

feat(audio-chat): generate openAPI specs

julien-nc

committed

feat(audio-chat): remove fallback task type, register provider only if the server task type exists

julien-nc

committed

feat(audio-chat): filter out the audio chat task type in the assistant /task-types endpoint

julien-nc

committed

feat(audio-chat): implement ContextAgentAudioInteraction provider and the logic to schedule audio tasks for agency

julien-nc

committed

feat(audio-chat): add personal setting to toggle autoplay, fix personal settings task type availability values

julien-nc

committed

feat(audio-chat): make sure attachments are always set in the entity

julien-nc

committed

feat(audio-chat): perform TTS for response after agency confirmation

julien-nc

committed

feat(audio-chat): add support for optional remote_audio_id which we can use in the history instead of the transcripts

julien-nc

committed

fix(chat): delete related tasks when deleting a session or a message, prevent deleting a message from another session

julien-nc

committed

feat(audio-chat): store and use potential remote_audio_expires_at

julien-nc

committed

fix(audio-chat): prevent crash when trying to delete non existing task

julien-nc

committed

check if audio chat is available to show the record button, filter out ContextAgentAudioInteraction in the assistant task type list, change the audio html tag border radius

julien-nc

committed

clarify message mapper, use sessionId in deleteMessageById and getMessageById

julien-nc

committed

in regenerateForSession, delete task related with the deleted message

julien-nc

committed

rename initial state, mention integration_openai in comments, add missing phpDoc, rename autoplay_audio_chat and audio_chat_available initial states

julien-nc

committed

fix typos

julien-nc

committed

fix(audio-chat): update session title if the first message was audio, do it when we get its transcript

julien-nc

committed

enh(audio-chat): add warning log if TTS of agency post-confirmation message failed

julien-nc

committed

enh(audio-chat): add comments and adjust frontend error messages

julien-nc

committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Audio chat#292

Audio chat#292
julien-nc merged 23 commits intomainfrom
enh/noid/audio-chat

Commits on Jul 15, 2025

feat(audiochat): implement generic audio chat provider that schedules 3 sub tasks

feat(audio-chat): record audio, store file, submit new fake message

feat(audio-chat): adjust UI to really submit, handle audio attachments in the backend, schedule proper audioChat task

feat(audio-chat): auto play new assistant audio messages

feat(audio-chat): generate openAPI specs

feat(audio-chat): remove fallback task type, register provider only if the server task type exists

feat(audio-chat): filter out the audio chat task type in the assistant /task-types endpoint

feat(audio-chat): implement ContextAgentAudioInteraction provider and the logic to schedule audio tasks for agency

feat(audio-chat): add personal setting to toggle autoplay, fix personal settings task type availability values

feat(audio-chat): make sure attachments are always set in the entity

feat(audio-chat): perform TTS for response after agency confirmation

feat(audio-chat): add support for optional remote_audio_id which we can use in the history instead of the transcripts

fix(chat): delete related tasks when deleting a session or a message, prevent deleting a message from another session

feat(audio-chat): store and use potential remote_audio_expires_at

fix(audio-chat): prevent crash when trying to delete non existing task

check if audio chat is available to show the record button, filter out ContextAgentAudioInteraction in the assistant task type list, change the audio html tag border radius

clarify message mapper, use sessionId in deleteMessageById and getMessageById

in regenerateForSession, delete task related with the deleted message

rename initial state, mention integration_openai in comments, add missing phpDoc, rename autoplay_audio_chat and audio_chat_available initial states

fix typos

fix(audio-chat): update session title if the first message was audio, do it when we get its transcript

enh(audio-chat): add warning log if TTS of agency post-confirmation message failed

enh(audio-chat): add comments and adjust frontend error messages