We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 6308024 commit 15a7ddfCopy full SHA for 15a7ddf
intermediate_source/model_parallel_tutorial.py
@@ -342,3 +342,12 @@ def forward(self, x):
342
# sub-network structures require different stream management strategies. As no
343
# general multi-stream solution works for all model parallel use cases, we will
344
# not discuss it in this tutorial.
345
+#
346
+# **Note:**
347
348
+# This post shows several performance measurements. You might see different
349
+# numbers when running the same code on your own machine, because the result
350
+# depends on the underlying hardware and software. To get the best performance
351
+# for your environment, a proper approach is to first generate the curve to
352
+# figure out the best split size, and then use that split size to pipeline
353
+# inputs.
0 commit comments