Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

【paddle.fleet】fleet_util move to paddle.fleet #25805

Merged
merged 27 commits into from
Aug 7, 2020
Merged
Changes from 1 commit
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
f430799
test=develop,test=document_fix, remove the out args
WuHaobo Jul 11, 2020
61fcbe8
fleet_util move to paddle.fleet
123malin Jul 29, 2020
19ad9c5
bug fix
123malin Jul 29, 2020
5c501b2
test=develop, add unittest
123malin Aug 3, 2020
03223c2
Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into…
123malin Aug 3, 2020
24030c6
test=develop, bug fix for setup
123malin Aug 3, 2020
02d00f5
test=develop, bug fix
123malin Aug 3, 2020
5603baa
test=develop, bug fix
123malin Aug 3, 2020
929ca5c
Merge remote-tracking branch 'upstream/develop' into develop
WuHaobo Aug 3, 2020
2e6fa20
delete out in inverse
WuHaobo Aug 3, 2020
1d4051a
test=develop, bug fix
123malin Aug 3, 2020
4759ca1
test=develop, open test_dist_fleet_ctr
123malin Aug 3, 2020
edceacb
test=develop, unittest
123malin Aug 3, 2020
a0abc75
test=develop, bug fix
123malin Aug 3, 2020
dd7b70f
test=develop, Merge remote-tracking branch 'WuHaobo/delete_inverse_ou…
123malin Aug 3, 2020
4d8e4dd
test=develop, add unittest
123malin Aug 3, 2020
987639e
test=develop, bug fix for unittest
123malin Aug 4, 2020
8585529
test=develop, bug fix for python35
123malin Aug 4, 2020
c8eaa2a
test=develop, bug fix
123malin Aug 4, 2020
7635d1d
test=develop,Merge branch 'develop' of https://github.com/PaddlePaddl…
123malin Aug 4, 2020
2f5d31e
test=develop, bug fix
123malin Aug 5, 2020
3038029
test=develop, Merge branch 'develop' of https://github.com/PaddlePadd…
123malin Aug 5, 2020
a9a0308
test=develop, conflit fix
123malin Aug 5, 2020
2e2fc65
test=develop, bug fix
123malin Aug 5, 2020
f5e056a
test=develop, bug fix
123malin Aug 5, 2020
87af8b7
test=develop, error message refine
123malin Aug 5, 2020
2ca0c34
Merge branch 'develop' into fleet_util
seiriosPlus Aug 6, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
test=develop, Merge branch 'develop' of https://github.com/PaddlePadd…
…le/Paddle into fleet_util
  • Loading branch information
123malin committed Aug 5, 2020
commit 30380295dd2091c99cb444f9a773660ef9f16713
21 changes: 10 additions & 11 deletions python/paddle/fleet/base/util_factory.py
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,15 @@
from paddle.fluid.proto import framework_pb2
from ..utils.fs import FS, LocalFS, HDFSClient

__all__ = ['UtilBase']

class UtilFactory(object):
def _create_util(self, context=None):
util = UtilBase()
if context is not None and "valid_strategy" in context:
util._set_strategy(context["valid_strategy"])
if context is not None and "role_maker" in context:
util._set_role_maker(context["role_maker"])
return util


class UtilBase(object):
Expand Down Expand Up @@ -428,13 +436,4 @@ def check_not_expected_ops(prog, not_expected_op_types):
return results


class UtilFactory(object):
def _create_util(self, dist_strategy, role_maker, optimize_ops,
params_grads):
util = UtilBase()
util._set_strategy(dist_strategy)
util._set_role_maker(role_maker)
return util


fleet_util = UtilFactory()._create_util(None, None, [], [])
fleet_util = UtilFactory()._create_util(None)
You are viewing a condensed version of this merge commit. You can view the full changes here.