-
Notifications
You must be signed in to change notification settings - Fork 5.7k
Refine distribute transpiler api #10342
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Refine distribute transpiler api #10342
Conversation
op.input("Param")[0]), | ||
self.origin_program.global_block().var( | ||
op.input("Grad")[0]))) | ||
elif op.type == "scale": |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you use ufind
here to find the connected ops so that we can remove this hack here?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we only need scale
op here, but ufind
will find too many ops such as fc and fc_grad.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I saw get_pserver_program
also have similar code, can you put this in a private function?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done.
Thanks! I will update #10316 according after this gets merged. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, transpiler still need more refine and clean up later on.
Fixed #10341