[Feature]Add paddleslim ACT. #3457

shiyutang · 2023-08-16T09:50:18Z

PR types

New features

PR changes

Others

Description

Add paddleslim ACT function on ppliteseg as an example.

paddleseg/cvlibs/config.py

deploy/slim/act/run.py

juncaipeng · 2023-08-17T07:44:36Z

deploy/slim/act/readme_ch.md

+#### 3.1 准备环境
+
+- PaddlePaddle >= 2.4 （可从[Paddle官网](https://www.paddlepaddle.org.cn/install/quick?docurl=/documentation/docs/zh/install/pip/linux-pip.html)下载安装）
+- PaddleSlim >= 2.4


paddle和slim都是2.5，套件使用develop，pr合入develop，后cherry-pick到最新分支

juncaipeng

整个方案可以了；代码参考谷歌编程规范，很多地方再优化下；文档说清楚点。

deploy/slim/act/run_seg.py

juncaipeng · 2023-08-18T04:09:19Z

deploy/slim/act/run_seg.py

+        config['params_filename'])  # get the name of forward input
+    train_dataloader = reader_wrapper(train_loader, input_name)
+
+    rank_id = paddle.distributed.get_rank()


重复定义

juncaipeng · 2023-08-18T04:11:14Z

deploy/slim/act/readme.md

+| 模型 | 策略  | Total IoU (%) | CPU耗时(ms)<br>thread=10<br>mkldnn=on| Nvidia GPU耗时(ms)<br>TRT=off| 配置文件 | Inference模型  |
+|:-----:|:-----:|:----------:|:---------:| :------:|:------:|:------:|
+| OCRNet_HRNetW48 |Baseline |todo| todo| todo|todo|todo|
+| OCRNet_HRNetW48 | 量化训练QAT |todo| todo| todo|todo|todo|


只有量化训练QAT 还是量化训练QAT结合蒸馏？

已经替换成量化蒸馏训练

juncaipeng · 2023-08-18T04:12:20Z

deploy/slim/act/readme.md

+
+## 2.Benchmark
+
+| 模型 | 策略  | Total IoU (%) | CPU耗时(ms)<br>thread=10<br>mkldnn=on| Nvidia GPU耗时(ms)<br>TRT=off| 配置文件 | Inference模型  |


这个表格需要展示压缩前后的精度和推理速度，现在表头的字段不对啊

对于不同配置分成了两行来对比，一行是baseline，一行QAT，后续增加不同的配置可以增加多行，方便不同配置之间的对比。

juncaipeng · 2023-08-18T04:23:08Z

deploy/slim/act/readme.md

+
+- 示例数据集: cityscapes数据集的一个子集，用于快速跑通压缩和推理流程，不能用该数据集复现 benchmark 表中的压缩效果。[下载链接](https://bj.bcebos.com/v1/paddle-slim-models/data/mini_cityscapes/mini_cityscapes.tar)
+
+准备好数据后，需要放入到`deploy/slim/act`目录下。


怎么放？整个文档需要人家可以执行复现，比如文档甩给qa可以帮你测试完成，可以再整体优化下

已经修改内容，并已经向QA提测。

juncaipeng · 2023-08-18T04:25:16Z

deploy/slim/act/paddle_inference_eval.py

@@ -0,0 +1,319 @@
+# Copyright (c) 2023 PaddlePaddle Authors. All Rights Reserved.


这个文件名称改成test_seg.py

juncaipeng · 2023-08-24T08:53:04Z

deploy/slim/act/run_seg.py

+    return miou
+
+
+def reader_wrapper(reader, input_name):


开发者不太清楚这个wrapper的作用，需要说明act对dataset的要求，这部分还挺关键

act对dataset的要求和套件一致，因为数据的配置使用的seg的配置文件，通过segbuilder加载之后，使用dataloader获取数据。

juncaipeng · 2023-08-24T08:58:00Z

deploy/slim/act/readme.md

+
+### 3. 量化蒸馏训练精度很低？
+![2d916558811eb5f1bbb388025ddda21c](https://github.com/PaddlePaddle/PaddleOCR/assets/34859558/cc9bcc26-1568-4ab9-96f3-ff181486637c)
+**A**：去除量化训练的输出结果，重新运行一次，这是由于网络训练到局部极值点导致。


需要空行，预览错误

juncaipeng · 2023-08-24T09:02:33Z

docs/deployment/slim/act/readme.md

@@ -0,0 +1 @@
+请参考[语义分割模型自动压缩示例](../../../../deploy/slim/act/readme.md)了解更多基于PaddleSeg接入ACT的方式。


在seg的首页readme里面，可以加下Auto Compression，链接到这里面来

shiyutang added 2 commits August 16, 2023 14:38

compat_slim

eb33770

add_ppliteseg_act

3ea23dc

shiyutang requested a review from juncaipeng August 16, 2023 09:50

shiyutang changed the title ~~Slim act~~ [Feature]Add paddleslim ACT. Aug 16, 2023

update

2a29b65

shiyutang mentioned this pull request Aug 16, 2023

【模型压缩推全计划】为六大套件新增模型压缩功能 PaddlePaddle/PaddleOCR#10657

Closed

validate

66f59eb

juncaipeng reviewed Aug 17, 2023

View reviewed changes

shiyutang added 2 commits August 18, 2023 11:48

fix_by_comment

fa66924

update

1851b52

juncaipeng reviewed Aug 18, 2023

View reviewed changes

fix_by_comment

bd0a237

shiyutang requested a review from juncaipeng August 21, 2023 03:00

shiyutang added 2 commits August 23, 2023 11:52

add_faq

4b9f7ac

fix_config

4e724e8

juncaipeng reviewed Aug 24, 2023

View reviewed changes

shiyutang added 3 commits August 25, 2023 11:52

tensorrt

670cc42

update

a811e0b

update

af3b99e

shiyutang requested a review from juncaipeng August 25, 2023 08:51

juncaipeng approved these changes Aug 25, 2023

View reviewed changes

shiyutang merged commit 88cbff8 into PaddlePaddle:develop Aug 28, 2023

shiyutang deleted the slim_act branch August 28, 2023 02:58

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Feature]Add paddleslim ACT. #3457

[Feature]Add paddleslim ACT. #3457

shiyutang commented Aug 16, 2023

juncaipeng Aug 17, 2023

juncaipeng left a comment

juncaipeng Aug 18, 2023

shiyutang Aug 21, 2023

juncaipeng Aug 18, 2023

shiyutang Aug 21, 2023

juncaipeng Aug 18, 2023

shiyutang Aug 21, 2023

juncaipeng Aug 18, 2023

shiyutang Aug 21, 2023

shiyutang Aug 22, 2023

juncaipeng Aug 18, 2023

shiyutang Aug 21, 2023

juncaipeng Aug 24, 2023

shiyutang Aug 25, 2023

juncaipeng Aug 24, 2023

shiyutang Aug 24, 2023

juncaipeng Aug 24, 2023

shiyutang Aug 25, 2023


		## 2.Benchmark

		\| 模型 \| 策略 \| Total IoU (%) \| CPU耗时(ms)<br>thread=10<br>mkldnn=on\| Nvidia GPU耗时(ms)<br>TRT=off\| 配置文件 \| Inference模型 \|


		- 示例数据集: cityscapes数据集的一个子集，用于快速跑通压缩和推理流程，不能用该数据集复现 benchmark 表中的压缩效果。[下载链接](https://bj.bcebos.com/v1/paddle-slim-models/data/mini_cityscapes/mini_cityscapes.tar)

		准备好数据后，需要放入到`deploy/slim/act`目录下。

		@@ -0,0 +1,319 @@
		# Copyright (c) 2023 PaddlePaddle Authors. All Rights Reserved.

		@@ -0,0 +1 @@
		请参考[语义分割模型自动压缩示例](../../../../deploy/slim/act/readme.md)了解更多基于PaddleSeg接入ACT的方式。

[Feature]Add paddleslim ACT. #3457

[Feature]Add paddleslim ACT. #3457

Conversation

shiyutang commented Aug 16, 2023

PR types

PR changes

Description

Choose a reason for hiding this comment

juncaipeng left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment