[one::OpBuilder] op interpreter core #4407
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…/github.com/Oneflow-Inc/oneflow into mig_instruction_build_api_about_op_atttribute
…mig_logical_and_pyhsical_run
oneflow-ci-bot
requested review from
oneflow-ci-bot
and removed request for
oneflow-ci-bot
hjchen2
requested review from
oneflow-ci-bot
and removed request for
oneflow-ci-bot
liujuncheng
pushed a commit
that referenced
this pull request
Jun 3, 2021
* del object_storage.cpp * use name GLOBAL_PARA_SYM2SHARED_OPKENEL_OBJ_MUTEX * mig CheckRefInBlobObjectParallelDesc and OperandBlobObjects rel api * mig _StatelessCall * mig _StatelessCall * [one::OpBuilder] Refactor Operation. * mig StatelessCall api * mig StatefulCall * mig callback api * mig MakeLazyRefBlobObject * refactor CudaHostPinBlob * sort out InstructionsBuilder api * [one::OpBuilder] Refine * mig PhysicalRun and LogicalRun * use oneflow_api.deprecated.LogicalRun & PhysicalRun * delete vm_util.py * change FindOrCreateDelegateBlobObject args * add SetShuttingDown * rm python_interpreter_util.py * add blank line * mig BlobCache * use FindOrCreateDelegateBlobObject in c++ * refactor session_util.cpp * use IsShutDown * refactor BlobRegister * [one::OpBuilder] Refactor OpExpr and OpExprInterpreter. * [one::OpBuilder] Remove member function evaluate. * [one::OpBuilder] Remove OpInterpreter to facilitate CR. * [one::OpBuilder] Refine * fix distribute test exit bug * del comment * [one::OpBuilder] Add more op exprs. * mig id_util and scope_util * use cfg_op_conf and Object* * use Object* * del _ * fix func name error * [one::OpBuilder] Refine * [one::OpBuilder] Modify op input names by InOutBnAccessor. * [one::OpBuilder] Fix op expr python api. * use MapAt and shared_ptr * [one::OpBuilder] Using indexed ibns and obns instead of tensor names. * [one::OpBuilder] Update * [one::OpBuilder] Complete op interpreter in the main. * use shared_ptr or const ref * minor fix * add todo * [one::OpBuilder] Export and extend BoxingUtil in python. * [one::OpBuilder] Support variable op interpretation. * [one::OpBuilder] Refine * [one::OpBuilder] Refine placeholder prefix. * minor fix * minor djustment * minor fix * [one::OpBuilder] Migrate snapshot manager. * minor optimize * minor fix * minor optimize * [one::OpBuilder] Migrate Session. * [one::OpBuilder] Fix return type. * [one::OpBuilder] Refine variable interpretation. * minor optimize * fix bug * [one::OpBuilder] Call python FeePath. * [one::OpBuilder] Fix typo. * minor fix * [one::OpBuilder] Fix merge bugs. * [one::OpBuilder] Bugfix. * [one::OpBuilder] Refine * [one::OpBuilder] Bugfix * [one::OpBuilder] Refine * [one::OpBuilder] Fix typo. * [one::OpBuilder] Fix placeholder prefix of op builer. * [one::OpBuilder] Set output blob object after running the instruction. * [one::OpBuilder] Remove TensorNameScope temporarily. * [one::OpBuilder] Fix api. * [one::OpBuilder] Add TensorNameScope. * [one::OpBuilder] Modify the op builder apis to return Maybe type. * [one::OpBuilder] Remove unused header. * [one::OpBuilder] Fix * [one::OpBuilder] Fix typo * [one::OpBuilder] Fix bugs. * [one::OpBuilder] Create tensor from blob object. * [one::OpBuilder] Return Maybe in op interpreter. * [one::OpBuilder] Fix merge conflicts and reformat. * [one::OpBuilder] Remove unused code. * [one::OpBuilder] Go through eager mode. * [one::OpBuilder] Fix typo * [one::OpBuilder] Refine * [one::OpBuilder] Remove redundant file system and refine code style. * [one::OpBuilder] Use TensorTuple instead of TensorList and provide method to access the valide interpreter. * [one::OpBuilder] Fix bug * [one::OpBuilder] Remove state input. * [one::OpBuilder] Create output tensors for lazy mode. * [one::OpBuilder] Change pybind hold type to shared_ptr for Callback, Watch and BoxingUtil. * [one::OpBuilder] Move to deprecated. * [one::OpBuilder] Remove unused code. * [one::OpBuilder] Fix typo. * [one::OpBuilder] Support TensorTuple input and fix typo. * [one::OpBuilder] Fix bugs. * [one::OpBuilder] Change pybind hold type to shared_ptr for Callback, Watch and BoxingUtil. * [one::OpBuilder] Fix bugs. * [one::OpBuilder] Migrate snapshot manager. * [one::OpBuilder] Remove redundant file system and refine code style. * [one::OpBuilder] Migrate Session. * [one::OpBuilder] Refine * [one::OpBuilder] Refine * [one::OpBuilder] Call python FeePath. * [one::OpBuilder] Export and extend BoxingUtil in python. * [one::OpBuilder] Deprecate boxing util python api. * [one::OpBuilder] Reformat * Merge * Refine * Use reference op expr. * Fix default value * Fix LocalFS use bug * Fix and refine * Return Maybe * Reformat * Refine * Remove initialization to simplify variable op interpretation. * Revert SnapshotManager and Session * Fix register BoxingUtil * Remove unused header * Revert foreign callback * Refine code style * Fix register BoxingUtil * Get device from parallel desc to make a new tensor. * Boxing call instructions and refine. * Fix ci error * Swap the op conf since the move constructor was not provided by protobuf messages. * Refine * Refine code style * Reformat * Fix error merge * Make interpreter stateless and remove OpExprInterpContext. * Refine * reformat * Fix typo * Revert interpreter interface * Use move assignment since protobuf has been upgrade. * Refine * Refine Co-authored-by: clackhan <han_binbin@163.com> Co-authored-by: hjchen2 <hjchen2> Co-authored-by: oneflow-ci-bot <69100618+oneflow-ci-bot@users.noreply.github.com> Former-commit-id: 8c7476c
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.