-
Notifications
You must be signed in to change notification settings - Fork 5.7k
Feature/engine refactor #10497
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature/engine refactor #10497
Conversation
paddle/fluid/inference/engine.h
Outdated
// Return the IO buffer that allocated in engine. One can read/write directly | ||
// on the buffer. If the buffer's buffer is nullptr, one can also allocate | ||
// memory and maintain it outside the engine. | ||
virtual Buffer& buffer(const std::string& tensor) = 0; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
tensor->name, 这里参数指的是buffer名字吧
@@ -1,4 +1,5 @@ | |||
nv_library(tensorrt_engine SRCS engine.h engine.cc helper.h ../engine.h) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nv_library(tensorrt_engine SRCS engine.cc)
@@ -87,7 +87,9 @@ class TensorRTEngine : public EngineBase { | |||
// these memory directly for acceleration, for example, output the converted | |||
// data directly to the buffer to save data copy overhead. | |||
// NOTE this should be used after calling `FreezeNetwork`. | |||
void*& buffer(const std::string& name); | |||
Buffer& buffer(const std::string& tensor) override; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
tensor->name
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
* init refactor * init * update some comment * fix build * fix errorrr * fix bug * fix comment * update
Refactor the engine base API for Anakin engine.