Skip to content

Refine distribute transpiler api #10342

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

Yancey0623
Copy link
Contributor

@Yancey0623 Yancey0623 commented May 2, 2018

Fixed #10341

@Yancey0623 Yancey0623 changed the title Redefine distribute transpiler api Refine distribute transpiler api May 2, 2018
op.input("Param")[0]),
self.origin_program.global_block().var(
op.input("Grad")[0])))
elif op.type == "scale":
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you use ufind here to find the connected ops so that we can remove this hack here?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we only need scale op here, but ufind will find too many ops such as fc and fc_grad.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I saw get_pserver_program also have similar code, can you put this in a private function?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

@helinwang
Copy link
Contributor

Thanks! I will update #10316 according after this gets merged.

Copy link
Contributor

@typhoonzero typhoonzero left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, transpiler still need more refine and clean up later on.

@Yancey0623 Yancey0623 merged commit 73650a8 into PaddlePaddle:develop May 3, 2018
@Yancey0623 Yancey0623 deleted the refine_distribute_transpiler_api branch May 3, 2018 04:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants