Skip to content

V2 deadlinks #10518

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
May 9, 2018
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
47 changes: 37 additions & 10 deletions doc/v2/design/mkl/mkldnn.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
充分展现英特尔平台的优势,有效提升PaddlePaddle在英特尔架构上的性能。

<div align="center">
<img src="image/overview.png"><br/>
<img src="https://raw.githubusercontent.com/PaddlePaddle/Paddle/develop/doc/v2/images/overview.png"><br/>
Figure 1. PaddlePaddle on IA
</div>

Expand Down Expand Up @@ -42,16 +42,43 @@ Figure 1. PaddlePaddle on IA

MKL,MKLML以及MKL-DNN三者关系如下表:

| Name | Open Source | License | Descriptions |
| :---------- | :--------------- | :---------- | :------------ |
| MKL | No | Proprietary | Accelerate math processing routines |
| MKLML | No | Proprietary | Small package of MKL, especially for Machine Learning |
| MKL-DNN | Yes | Apache 2.0 | Accelerate primitives processing routines especially for Deep Neural Networks |
<table>
<thead>
<tr>
<th>Name</th>
<th>Open Source</th>
<th>License</th>
<th>Descriptions</th>
</tr>
</thead>
<tbody>
<tr>
<td>MKL</td>
<td>No</td>
<td>Proprietary</td>
<td>Accelerate math processing routines</td>
</tr>
<tr>
<td>MKLML</td>
<td>No</td>
<td>Proprietary</td>
<td>Small package of MKL, especially for Machine Learning</td>
</tr>

<tr>
<td>MKL-DNN</td>
<td>Yes</td>
<td>Apache 2.0</td>
<td>Accelerate primitives processing routines especially for Deep Neural Networks</td>
</tr>

</tbody>
</table>

MKLML可以与MKL-DNN共同使用,以此达到最好的性能。

<div align="center">
<img src="image/engine.png"><br/>
<img src="https://raw.githubusercontent.com/PaddlePaddle/Paddle/develop/doc/v2/images/engine.png"><br/>
Figure 2. PaddlePaddle with MKL Engines
</div>

Expand Down Expand Up @@ -103,7 +130,7 @@ MKL-DNN的库目前只有动态库`libmkldnn.so`。
所以我们定义了一个`MKLDNNMatrix`用于管理MKL-DNN数据的不同格式以及相互之间的转换。

<div align="center">
<img src="image/matrix.png"><br/>
<img src="https://raw.githubusercontent.com/PaddlePaddle/Paddle/develop/doc/v2/images/matrix.png"><br/>
Figure 3. MKLDNNMatrix
</div>

Expand All @@ -113,7 +140,7 @@ Figure 3. MKLDNNMatrix
子类只需要使用定义好的接口,实现具体的函数功能即可。

<div align="center">
<img src="image/layers.png"><br/>
<img src="https://raw.githubusercontent.com/PaddlePaddle/Paddle/develop/doc/v2/images/layers.png"><br/>
Figure 4. MKLDNNLayer
</div>

Expand Down Expand Up @@ -150,7 +177,7 @@ Figure 4. MKLDNNLayer
所以整体上,在实现每个子类的时候就不需要关心分支的事情了。

<div align="center">
<img src="image/gradients.png"><br/>
<img src="https://raw.githubusercontent.com/PaddlePaddle/Paddle/develop/doc/v2/images/gradients.png"><br/>
Figure 5. Merge Gradients
</div>

Expand Down
Binary file added doc/v2/images/FullyConnected.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/add_security_group.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/bi_lstm.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/checkpointing.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/create_efs.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/csr.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/data_dispatch.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/dataset.graffle
Binary file not shown.
Binary file added doc/v2/images/dataset.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/doc_en.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/efs_mount.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/encoder-decoder-attention-model.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/engine.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/file_storage.graffle
Binary file not shown.
Binary file added doc/v2/images/file_storage.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
42 changes: 42 additions & 0 deletions doc/v2/images/glossary_rnn.dot
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
digraph G{
subgraph cluster_timestep0 {
label="recurrent timestep i-1"
bgcolor=lightgray
node [style=filled,color=white]
fc0_0 [label="fc 0"]
fc0_1 [label="fc 1"]
fc0_2 [label="fc 2"]

fc0_0 -> fc0_1
fc0_1 -> fc0_2
}

subgraph cluster_timestep1 {
label="recurrent timestep i"
node [style=filled];
fc1_0 [label="fc 0"]
fc1_1 [label="fc 1"]
fc1_2 [label="fc 2"]
color=blue

fc1_0 -> fc1_1
fc1_1 -> fc1_2
}

subgraph cluster_timestep2 {
label="recurrent timestep i+1"
bgcolor=lightgray
node [style=filled,color=white]
fc2_0 [label="fc 0"]
fc2_1 [label="fc 1"]
fc2_2 [label="fc 2"]

fc2_0 -> fc2_1
fc2_1 -> fc2_2
}


fc0_1 -> fc1_1 [style="dotted" constraint=false]
fc1_1 -> fc2_1 [style="dotted" constraint=false]

}
48 changes: 48 additions & 0 deletions doc/v2/images/glossary_rnn_with_memory.dot
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
digraph G{
subgraph cluster_timestep0 {
label="recurrent timestep i-1"
bgcolor=lightgray
node [style=filled,color=white]
fc0_0 [label="fc 0"]
fc0_1 [label="fc 1"]
fc0_2 [label="fc 2"]
m0 [label="memory"]
fc0_0 -> fc0_1
fc0_1 -> fc0_2
fc0_1 -> m0
m0 -> fc0_1
}

subgraph cluster_timestep1 {
label="recurrent timestep i"
node [style=filled];
fc1_0 [label="fc 0"]
fc1_1 [label="fc 1"]
fc1_2 [label="fc 2"]
m1 [label="memory"]
color=blue
fc1_0 -> fc1_1
fc1_1 -> fc1_2
fc1_1 -> m1
m1 -> fc1_1
}

subgraph cluster_timestep2 {
label="recurrent timestep i+1"
bgcolor=lightgray
node [style=filled,color=white]
fc2_0 [label="fc 0"]
fc2_1 [label="fc 1"]
fc2_2 [label="fc 2"]
m2 [label="memory"]
fc2_0 -> fc2_1
fc2_1 -> fc2_2
fc2_1 -> m2
m2 -> fc2_1
}


m0 -> m1 [style="dotted" constraint=false]
m1 -> m2 [style="dotted" constraint=false]

}
Binary file added doc/v2/images/gradients.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/init_lock.graffle
Binary file not shown.
Binary file added doc/v2/images/init_lock.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/k8s-paddle-arch.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/layers.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/managed_policy.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/matrix.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/nvvp1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/nvvp2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/nvvp3.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/nvvp4.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/overview.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/paddle-cloud-in-data-center.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added doc/v2/images/paddle-etcd.graffle
Binary file not shown.
Binary file added doc/v2/images/paddle-etcd.png
Binary file added doc/v2/images/paddle-model-sharding.graffle
Binary file not shown.
Binary file added doc/v2/images/paddle-model-sharding.png
Binary file added doc/v2/images/paddle-ps-0.png
Binary file added doc/v2/images/paddle-ps-1.png
Binary file added doc/v2/images/paddle-ps.graffle
Binary file not shown.
Binary file added doc/v2/images/paddle-task-queues.graffle
Binary file not shown.
Binary file added doc/v2/images/paddle-task-queues.png
Binary file added doc/v2/images/paddle-task-states.graffle
Binary file not shown.
Binary file added doc/v2/images/paddle-task-states.png
Binary file added doc/v2/images/ps_cn.png
Binary file added doc/v2/images/ps_en.png
Binary file added doc/v2/images/pserver_and_trainer.png
Binary file added doc/v2/images/pserver_init.graffle
Binary file not shown.
Binary file added doc/v2/images/pserver_init.png
Binary file added doc/v2/images/route53_create_recordset.png
Binary file added doc/v2/images/route53_create_zone.png
Binary file added doc/v2/images/sequence_data.png
30 changes: 30 additions & 0 deletions doc/v2/images/simple_full_hierarchical_recurrent.dot
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
digraph G {
rankdir=LR;

subgraph cluster_t0 {
a [label="4"]
b [label="5"]
c [label="2"]
}

subgraph cluster_t1 {
d [label="0"]
e [label="9"]
}

subgraph cluster_t2 {
f [label="8"]
g [label="1"]
h [label="4"]
}

a -> b;
b -> c;
c -> d [constraint=false];

d -> e;
e -> f [constraint=false];

f -> g;
g -> h;
}
19 changes: 19 additions & 0 deletions doc/v2/images/simple_full_recurrent.dot
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
digraph G {
rankdir=LR;
a [label="4"]
b [label="5"]
c [label="2"]
d [label="0"]
e [label="9"]
f [label="8"]
g [label="1"]
h [label="4"]

a -> b;
b -> c;
c -> d;
d -> e;
e -> f;
f -> g;
g -> h;
}
Binary file added doc/v2/images/submit-job.graffle
Binary file not shown.
Binary file added doc/v2/images/submit-job.png
Binary file added doc/v2/images/trainer.graffle
Binary file not shown.
Binary file added doc/v2/images/trainer.png
Binary file added doc/v2/images/trainer_cn.png
Binary file added doc/v2/images/worker_security_group.png
Binary file added doc/v2/images/workflow_of_CAPI.png