Skip to content

task1+task2: 无人机键盘控制 + 神经网络视觉感知 - #156

Open
Enemy52 wants to merge 31 commits into
OpenHUTB:masterfrom
Enemy52:master
Open

Enemy52 wants to merge 31 commits into
OpenHUTB:masterfrom
Enemy52:master

Conversation

@Enemy52

@Enemy52 Enemy52 commented Oct 5, 2026 •

Copy link
Copy Markdown

修改概述:
新增无人机键盘飞行控制模块,支持 roslaunch 一键启动

修改的详细描述

  1. 新增 drone_keyboard_control 功能包
  2. 实现键盘控制无人机飞行节点(src/main_drone_keyboard_control.py)
  3. 提供 launch 启动文件(launch/drone_keyboard_control.launch)
  4. 编写 README 文档,包含环境、运行步骤、按键说明

经过了什么样的测试?

  1. 操作系统:Ubuntu 16.04
  2. ROS 版本:ROS Kinetic
  3. 基础校验:roslaunch 可正常启动节点,键盘按键可控制无人机

运行效果(动图、视频、图片、链接等)

修改所对应的前后效果(代码/网页):

所使用具体的大模型声明:
使用了豆包大模型辅助生成代码与文档
1  `      drone_keyboard_demo gif`

第二次作业(task2):uav_neural_perception

修改的详细描述

  1. 新增 uav_neural_perception 包
    • 前视摄像头图像 → CNN 推理 → 运动控制(行为克隆)
    • 包含数据集采集、CNN模型、训练脚本、ROS推理节点
  2. 提供 launch 启动文件
  3. 编写文档 docs/air/uav_neural_perception.md

运行环境

  • Ubuntu 20.04 + ROS Noetic
  • PyTorch(CPU)、OpenCV、cv_bridge

经过了什么样的测试?

  1. CNN 模型自检:参数量 164,131,输入图像→输出[vx,vy,yaw]
  2. 桥接环境自检:5/5 通过,连上 AirSim 仿真器
  3. 感知节点:每秒下发控制指令 vx/vy/yaw

声明

本项目使用大模型辅助撰写,作者对全部内容负责。
1  `          drone_keyboard_demo gif`

Enemy52 added 24 commits October 5, 2026 23:51
Implement a CNN model for UAV perception that maps RGB camera images to continuous control outputs.
This script handles image preprocessing and dataset collection for UAV neural perception. It reads image paths and associated actions from a CSV file and collects data using ROS.
This script implements a dataset for image preprocessing and ROS data collection, including a custom Dataset class and a function to collect images and associated actions.
This script trains a CNN perception model for behavior cloning using a dataset specified in a CSV file. It includes functionality for training, validation, and saving the best model weights.
The script trains a CNN perception model using behavior cloning on image data. It includes data loading, model training, validation, and saving the best model weights.
Add local regression tests for model, preprocessing, and safety clipping.
@donghaiwang

Copy link
Copy Markdown
Member

不要一个个添加,否则会受到不必要的邮件,暂时改为草稿,等做好准备后再打开

@donghaiwang
donghaiwang marked this pull request as draft October 7, 2026 13:42
Document the UAV neural perception system architecture, algorithm principles, and operational steps.
@Enemy52 Enemy52 changed the title task1: 新增无人机键盘飞行控制模块 task1+task2: 无人机键盘控制 + 神经网络视觉感知 Oct 7, 2026
@Enemy52
Enemy52 marked this pull request as ready for review October 7, 2026 15:40

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

代码约定放到src/air目录下

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

一般在文档中方运行效果,操作在文档中说清楚就行,而且文档应该都放在docs目录下,生成网页

Comment thread docs/index.md
___

## 参考文献
- [无人机神经网络视觉感知(任务②)](./air/uav_neural_perception.md)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

不是放在参考文献里,而是低空载具类别中

Comment thread docs/index.md

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

提交前先用mkdocs serve 检查效果是否符合要求

Image

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants