Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Memory optimization in GLUON #12226

Open
sandeep-krishnamurthy opened this issue Aug 17, 2018 · 6 comments
Open

Memory optimization in GLUON #12226

sandeep-krishnamurthy opened this issue Aug 17, 2018 · 6 comments

Comments

@sandeep-krishnamurthy
Copy link
Contributor

Related user issue - #10382

  • Supporting Memonger with GLUON will help in memory optimization. Memonger is currently supported only with Symbolic mode.
  • There is a new environment variable - MXNET_GPU_MEM_POOL_TYPE introduced for Memory pool strategy which significantly reduces memory usage in - gpu mem pool strategy #11041 We need to test/experiment and document this feature.
@srochel
Copy link
Contributor

srochel commented Sep 2, 2018

+1, memory optimization is important.

@xinedison
Copy link

+1, we also agree with memory optimization. When we reimplement some experiment, we always get stuck with out of memory error if we want to use enough batch size for the experiment. And we found that MXNET_GPU_MEM_POOL_TYPE is not helpful.

@ThomasDelteil
Copy link
Contributor

+1 on documenting this environment variable

@szha
Copy link
Member

szha commented Sep 28, 2018

#12668

@eric-haibin-lin
Copy link
Member

@samskalicky

@sandeep-krishnamurthy
Copy link
Contributor Author

This PR has a useful fix, however, it was not taken to completion and closed due to inactivity. #11658
When we work on this issue, we need to revisit the changes suggested in this PR - #11658

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

6 participants