Skip to content

Commit

Permalink
Add files via upload
Browse files Browse the repository at this point in the history
  • Loading branch information
MikeDean2367 authored Jun 25, 2022
1 parent 9f8a5e2 commit 1bf6f0d
Show file tree
Hide file tree
Showing 25 changed files with 106 additions and 0 deletions.
Binary file added img/TV_distance.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/TV_eyes.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/TV_finish.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/TV_main.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/TV_measure.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/TV_testing.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/TV_waiting.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/connect.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/data.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/hand_extract.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/light_detection.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/login.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/main.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/measure_disappear.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/measure_init.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/measure_testing.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/modify_pwd.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/register.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/sanguang.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/semang.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/setting.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/tips.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/userlist.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/vision.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
106 changes: 106 additions & 0 deletions readme.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,106 @@
# AI EYE

## 总体介绍

本项目基于Mediapipe开发,开发了两个平台的APP,实现了测视力、测散光、测色盲三个主要功能模块,同时实现了测量距离(需要自定义计算图,我已经重新编译并且可以在Android上进行部署)、手势识别、测试环境亮度、连接电视等功能,并对测试的数据进行记录。本项目具有优秀的动画和交互体验(采用`MotionLayout` `Animation` `TransformationLayout` `Lottie`,比如一镜到底效果)。单击[此处](https://github.com/MikeDean2367/AI-EYE/releases/download/resource/apk.7z)下载安装包。(开发了PC端的,但是没有和此处进行连接,因此不在此处展示)



## 结构说明

该仓库为`AI EYE`的代码。下图为三个APP的通信方式(不同设备之间的、不同进程之间的)

![](./img/connect.png)

其中`handtiqu`为手势识别APP,它是一个独立的程序,但是无法单独运行,它在手机端的主程序中进行调用。其主要功能是建立与`TV`的连接,并且作为手势识别的平台,将解析的结果通过`Socket`传递到`TV`端。

`Vision``AI EYE`的主程序端,它是整个`AI EYE`的核心部分。

`TV``AI EYE``TV`端,可以在平板上运行(需要注意的是,`TV`需要有摄像头),其主要功能是和手势识别进行通信,用户通过手势和`TV`进行通信,从而在大屏幕上完成手势识别。

使用该程序的基本流程为:

1. 打开主程序`Vision`,注册后可以使用。可以单独在该程序上面完成测量视力、测量散光、测量色盲,并且查看历史数据。
2. 如果要在大屏幕上测试视力,需要在带有摄像头的大屏幕上如电视,安装`TV`端,同时在手机上安装`handtiqu`。安装完成后确保手机端和大屏幕同处于一个WIFI网络中。打开主程序并登录后,在主页点击`TV`,然后点击`连接电视`,扫描屏幕上的二维码。扫描成功后在主页点击`手势识别`,然后程序会切换到`handtiqu`程序,此时便可以按照提示完成测量。



## 代码使用说明

三个文件夹用三个`Android Studio`打开。

该代码编译需要在带有`Bazel`编译环境下进行,具体安装操作可以参考`Google``Mediapipe`官网,网址为www.mediapipe.dev。

由于`github`无法上传大于25MB的文件,因此部分文件在[此处](https://github.com/MikeDean2367/AI-EYE/releases/download/resource/resource.zip)

### Vision

`release/mp_iris_tracking_aar.aar`移动到`Vision/app/libs`中。

`res`文件夹移动到`vision/app/src/main`目录下。

### handtiqu

`release/mp_multi_hand_tracking_aar.aar`移动到`handTiqu/app/libs`中。

### TV

`release/mp_iris_tracking_aar.aar`移动到`pad/app/libs`中。



## 界面展示

### 主程序手机端

![](./img/register.jpg)

![](./img/login.jpg)

![](./img/userlist.jpg)

![](./img/main.jpg)



![](./img/setting.jpg)

![](./img/tips.jpg)

![](./img/vision.jpg)

![](./img/semang.jpg)

![](./img/sanguang.jpg)

![](./img/data.jpg)

![](./img/modify_pwd.jpg)

![](./img/light_detection.jpg)

![](./img/measure_init.jpg)

![](./img/measure_testing.jpg)

![](./img/measure_disappear.jpg)

### 手势识别端

![](./img/hand_extract.jpg)

### TV端

![](./img/TV_main.jpg)

![](./img/TV_eyes.jpg)

![](./img/TV_distance.jpg)

![](./img/TV_measure.png)

![](./img/TV_waiting.jpg)

![](./img/TV_testing.jpg)

![](./img/TV_finish.jpg)

0 comments on commit 1bf6f0d

Please sign in to comment.