Skip to content
/ MrDing Public

In order to solve the problems of complex operation, strong visual dependence, and weak semantic understanding ability of traditional cockpit systems, this project designed and implemented a multimodal human-computer interaction system for vehicle-mounted scenarios based on the RK3588 high-performance platform.

License

Notifications You must be signed in to change notification settings

trgue/MrDing

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

29 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

206

介绍

对传统座舱系统操作复杂、视觉依赖强、语义理解能力弱等问题,本项目基于RK3588高性能平台,设计并实现了一款面向车载场景的多模态人机交互系统。系统集成疲劳监测、面部解锁等近十项功能模块,支持语音与触觉融合操作,交互自然高效。通过引入大语言模型作为语音中枢,系统具备出色的自然语言理解能力,能够精准响应用户的口语化指令,实现无需视觉干预的智能控制,有效提升驾驶安全性与使用便捷性。同时,系统响应迅速、支持模块化扩展,具备良好的实用价值与推广前景。

使用说明

  1. 3rdparty已经上传至百度网盘,编译前需要下载解压至项目根目录
  2. 创建build文件夹,运行make.sh编译
  3. 将install文件夹拷贝至开发板,同时将QWen2B的模型也拷入install内的model文件夹
  4. 进入开发板对应目录,运行start.sh

About

In order to solve the problems of complex operation, strong visual dependence, and weak semantic understanding ability of traditional cockpit systems, this project designed and implemented a multimodal human-computer interaction system for vehicle-mounted scenarios based on the RK3588 high-performance platform.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published