Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

max op do not support compute at float16 #52584

Open
PommesPeter opened this issue Apr 6, 2023 · 4 comments
Open

max op do not support compute at float16 #52584

PommesPeter opened this issue Apr 6, 2023 · 4 comments
Assignees
@LielinJiang
Labels
good first issue PFCC Paddle Framework Contributor Club，https://github.com/PaddlePaddle/community/tree/master/pfcc status/new-issue 新建 type/question 用户提问

Comments

@PommesPeter
Copy link
Contributor

请提出你的问题 Please ask your question

When I am using paddle.amp.auto_cast to compute the data at float16, it shows some errors.

Errors below:
image

it seems that PaddlePaddle currently does not support compute tensor at float16 for paddle.max op, and I also have checked the doc of paddle.max op and have searched issues but can not get any information about it.

Have any other ways to let paddle.max op support computation at float16?

The environment I'm using:

Is debug build: False
Paddle Version: 2.4.2
CUDA used to build Paddle: 11.2

OS: Ubuntu 20.04.5 LTS (x86_64)
GCC version: (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0
Clang version: Could not collect
CMake version: Could not collect
Libc version: glibc-2.31

Python version: 3.8.16 (default, Mar  2 2023, 03:21:46)  [GCC 11.2.0] (64-bit runtime)
Python platform: Linux-5.4.0-136-generic-x86_64-with-glibc2.17
Is CUDA available: True
CUDA runtime version: 11.6.124
CUDA_MODULE_LOADING set to: LAZY

Nvidia driver version: 495.29.05
cuDNN version: 8.5.0.96
Is XNNPACK available: True
@PommesPeter PommesPeter mentioned this issue Apr 6, 2023
Closed
@PommesPeter
Copy link
Contributor Author

the same problem in #52601

@paddle-bot paddle-bot bot added the PFCC Paddle Framework Contributor Club，https://github.com/PaddlePaddle/community/tree/master/pfcc label Apr 6, 2023
@PommesPeter
Copy link
Contributor Author

PommesPeter commented Apr 7, 2023 •
edited
Loading

I think that paddle should make max op to support computation at float16.

@LielinJiang
Copy link
Contributor

已经在计划中了，预计很快就会支持

@PommesPeter
Copy link
Contributor Author

已经在计划中了，预计很快就会支持

好的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@LielinJiang LielinJiang

Labels
good first issue PFCC Paddle Framework Contributor Club，https://github.com/PaddlePaddle/community/tree/master/pfcc status/new-issue 新建 type/question 用户提问
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@luotao1 @LielinJiang @PommesPeter