-
Notifications
You must be signed in to change notification settings - Fork 5.7k
Add OpProto implementation #2703
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
/* Copyright (c) 2016 PaddlePaddle Authors. All Rights Reserve. | ||
|
||
Licensed under the Apache License, Version 2.0 (the "License"); | ||
you may not use this file except in compliance with the License. | ||
You may obtain a copy of the License at | ||
|
||
http://www.apache.org/licenses/LICENSE-2.0 | ||
|
||
Unless required by applicable law or agreed to in writing, software | ||
distributed under the License is distributed on an "AS IS" BASIS, | ||
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
See the License for the specific language governing permissions and | ||
limitations under the License. */ | ||
|
||
syntax="proto2"; | ||
package paddle.framework; | ||
|
||
// Attribute Type for paddle's Op. | ||
// Op contains many attributes. Each type of attributes could be different. | ||
// The AttrType will be shared between AttrDesc and AttrProto. | ||
enum AttrType { | ||
INT = 0; | ||
FLOAT = 1; | ||
STRING = 2; | ||
INTS = 3; | ||
FLOATS = 4; | ||
STRINGS = 5; | ||
} |
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,69 @@ | ||
/* Copyright (c) 2016 PaddlePaddle Authors. All Rights Reserve. | ||
|
||
Licensed under the Apache License, Version 2.0 (the "License"); | ||
you may not use this file except in compliance with the License. | ||
You may obtain a copy of the License at | ||
|
||
http://www.apache.org/licenses/LICENSE-2.0 | ||
|
||
Unless required by applicable law or agreed to in writing, software | ||
distributed under the License is distributed on an "AS IS" BASIS, | ||
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
See the License for the specific language governing permissions and | ||
limitations under the License. */ | ||
|
||
// Protocol Message for 3rd-party language binding. | ||
// | ||
// Paddle Python package will use `OpProto` to generate op creation methods. | ||
// The op creation methods take user's input and generate `OpDesc` proto message, | ||
// then pass `OpDesc` to C++ side and create Op pointer. | ||
// | ||
syntax="proto2"; | ||
package paddle.framework; | ||
|
||
import "attr_type.proto"; | ||
|
||
// Attribute protocol message for 3rd-party language binding. | ||
// It will store the Op support what attribute and what type. | ||
message AttrProto { | ||
// Supported attribute name. e.g. `scale` for cosine op. | ||
required string name = 1; | ||
|
||
// Supported attribute type. | ||
required AttrType type = 2; | ||
|
||
// Supported attribute comments. It helps 3rd-party language generate doc-string. | ||
required string comment = 3; | ||
} | ||
|
||
// Input or output message for 3rd-party language binding. | ||
// It contains parameter name and its comments. | ||
message VarProto { | ||
// Input or output name in that op creation function. | ||
// e.g. `cos(a, b, output, ...)`, "a", "b", "output" are names. | ||
required string name = 1; | ||
|
||
// The comment for that input. It helps 3rd-party language generate doc-string. | ||
required string comment = 2; | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. add There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. That field will be added when it is needed for generating Maybe an enum type is needed, like
But I can not have a precise design about that field. It should be clearer when we start writing |
||
} | ||
|
||
// Op protocol message for 3rd-party language binding. | ||
// It contains all information for generating op creation method. | ||
message OpProto { | ||
// The input information to generate op creation method. | ||
repeated VarProto inputs = 1; | ||
|
||
// The output information to generate op creation method. | ||
repeated VarProto outputs = 2; | ||
|
||
// The attribute information to generate op creation method. | ||
repeated AttrProto attrs = 3; | ||
|
||
// The comments for that Op. It helps 3rd-party language generate | ||
// doc-string. The whole documentation of that Op is generated by comment, | ||
// inputs, outputs, attrs together. | ||
required string comment = 4; | ||
|
||
// The type of that Op. | ||
required string type = 5; | ||
} |
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,31 @@ | ||
#include <gtest/gtest.h> | ||
#include <paddle/framework/op_proto.pb.h> | ||
|
||
TEST(TestOpProto, ALL) { | ||
paddle::framework::OpProto proto; | ||
{ | ||
auto ipt = proto.mutable_inputs()->Add(); | ||
*ipt->mutable_name() = "a"; | ||
*ipt->mutable_comment() = "the one input of cosine op"; | ||
} | ||
{ | ||
auto ipt = proto.mutable_inputs()->Add(); | ||
*ipt->mutable_name() = "b"; | ||
*ipt->mutable_comment() = "the other input of cosine op"; | ||
} | ||
{ | ||
auto opt = proto.mutable_outputs()->Add(); | ||
*opt->mutable_name() = "output"; | ||
*opt->mutable_comment() = "the output of cosine op"; | ||
} | ||
{ | ||
auto attr = proto.mutable_attrs()->Add(); | ||
*attr->mutable_name() = "scale"; | ||
attr->set_type(paddle::framework::AttrType::FLOAT); | ||
*attr->mutable_comment() = "the scale attribute of cosine op"; | ||
} | ||
proto.set_type("cos"); | ||
*proto.mutable_comment() = "cosine op, output = scale * cos(a, b)"; | ||
|
||
ASSERT_TRUE(proto.IsInitialized()); | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Are we going to put our xx.proto file into the dir that need to use it or just in paddle/proto?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I am not sure.
But tensorflow make protobuf files into sub-directories. Since we are using google code style now, it seems that we should put our protobuf files in sub-directories.
Another advantage that make protobuf file in sub-directories is it make include line pretty like below.