-
Notifications
You must be signed in to change notification settings - Fork 39
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
28 changed files
with
1,693 additions
and
1,702 deletions.
There are no files selected for viewing
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,61 +1,61 @@ | ||
| # Benchmark | ||
|
|
||
| In terms of data shape validation, MLStyle can be strictly faster than even a carefully optimized handwritten code. | ||
|
|
||
| All benchmark scripts are provided in the directory [Matrix-Benchmark](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark). | ||
|
|
||
| To run these cross-implementation benchmarks, some extra dependencies should be installed: | ||
|
|
||
| - `(v1.4) pkg> add Gadfly MacroTools Rematch Match BenchmarkTools StatsBase Statistics ArgParse DataFrames`. | ||
|
|
||
| - `(v1.4) pkg> add MLStyle` for a specific version of MLStyle.jl is required. | ||
|
|
||
| After installing dependencies, you can directly benchmark them with `julia matrix_benchmark.jl tuple array datatype misc structfields vs-match` in the root directory. | ||
|
|
||
| The benchmarks presented here are made by Julia **v1.4** on **Windows 10(64 bit)**. | ||
|
|
||
| *Benchmark results for other platforms and Julia versions are welcome to get accepted as a pull request, if you figure out a better way to organize the files and their presentations in this README.* | ||
|
|
||
| (*We rule out the benchmarks of the space use, it's considered unnecessary as the cost are always zero which is not only for MLStyle*) | ||
|
|
||
| On the x-axis, after the name of test-case is the least time-consuming run's index in units of `ns`. | ||
|
|
||
| The y-label is the ratio of the implementation's time cost to that of the least time-consuming. | ||
|
|
||
| The benchmark results in dataframe format are available at [this directory](https://github.com/thautwarm/MLStyle.jl/tree/master/stats). | ||
|
|
||
| ## Arrays | ||
|
|
||
| - code: [matrix-benchmark/bench-array.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-array.jl) | ||
|
|
||
| [](https://github.com/thautwarm/MLStyle.jl/blob/master/stats/bench-array.txt) | ||
|
|
||
| ## Tuples | ||
|
|
||
| - code: [matrix-benchmark/bench-tuple.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-tuple.jl) | ||
|
|
||
| [](https://github.com/thautwarm/MLStyle.jl/blob/master/stats/bench-tuple.txt) | ||
|
|
||
| ## Data Types | ||
|
|
||
| - code: [matrix-benchmark/bench-datatype.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-datatype.jl) | ||
|
|
||
| [](https://github.com/thautwarm/MLStyle.jl/blob/master/stats/bench-datatype.txt) | ||
|
|
||
| ## Extracting Struct Definitions | ||
|
|
||
| - code: [matrix-benchmark/bench-structfields.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-structfields.jl) | ||
|
|
||
| [](https://github.com/thautwarm/MLStyle.jl/blob/master/stats/bench-structfields.txt) | ||
|
|
||
| ## Misc | ||
|
|
||
| - code: [matrix-benchmark/bench-misc.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-misc.jl) | ||
|
|
||
| [](https://github.com/thautwarm/MLStyle.jl/blob/master/stats/bench-misc.txt) | ||
|
|
||
| ## An Example from Match.jl Documentation | ||
|
|
||
| - code: [matrix-benchmark/bench-vs-match.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-vs-match.jl) | ||
|
|
||
| # Benchmark | ||
|
|
||
| In terms of data shape validation, MLStyle can be strictly faster than even a carefully optimized handwritten code. | ||
|
|
||
| All benchmark scripts are provided in the directory [Matrix-Benchmark](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark). | ||
|
|
||
| To run these cross-implementation benchmarks, some extra dependencies should be installed: | ||
|
|
||
| - `(v1.4) pkg> add Gadfly MacroTools Rematch Match BenchmarkTools StatsBase Statistics ArgParse DataFrames`. | ||
|
|
||
| - `(v1.4) pkg> add MLStyle` for a specific version of MLStyle.jl is required. | ||
|
|
||
| After installing dependencies, you can directly benchmark them with `julia matrix_benchmark.jl tuple array datatype misc structfields vs-match` in the root directory. | ||
|
|
||
| The benchmarks presented here are made by Julia **v1.4** on **Windows 10(64 bit)**. | ||
|
|
||
| *Benchmark results for other platforms and Julia versions are welcome to get accepted as a pull request, if you figure out a better way to organize the files and their presentations in this README.* | ||
|
|
||
| (*We rule out the benchmarks of the space use, it's considered unnecessary as the cost are always zero which is not only for MLStyle*) | ||
|
|
||
| On the x-axis, after the name of test-case is the least time-consuming run's index in units of `ns`. | ||
|
|
||
| The y-label is the ratio of the implementation's time cost to that of the least time-consuming. | ||
|
|
||
| The benchmark results in dataframe format are available at [this directory](https://github.com/thautwarm/MLStyle.jl/tree/master/stats). | ||
|
|
||
| ## Arrays | ||
|
|
||
| - code: [matrix-benchmark/bench-array.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-array.jl) | ||
|
|
||
| [](https://github.com/thautwarm/MLStyle.jl/blob/master/stats/bench-array.txt) | ||
|
|
||
| ## Tuples | ||
|
|
||
| - code: [matrix-benchmark/bench-tuple.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-tuple.jl) | ||
|
|
||
| [](https://github.com/thautwarm/MLStyle.jl/blob/master/stats/bench-tuple.txt) | ||
|
|
||
| ## Data Types | ||
|
|
||
| - code: [matrix-benchmark/bench-datatype.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-datatype.jl) | ||
|
|
||
| [](https://github.com/thautwarm/MLStyle.jl/blob/master/stats/bench-datatype.txt) | ||
|
|
||
| ## Extracting Struct Definitions | ||
|
|
||
| - code: [matrix-benchmark/bench-structfields.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-structfields.jl) | ||
|
|
||
| [](https://github.com/thautwarm/MLStyle.jl/blob/master/stats/bench-structfields.txt) | ||
|
|
||
| ## Misc | ||
|
|
||
| - code: [matrix-benchmark/bench-misc.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-misc.jl) | ||
|
|
||
| [](https://github.com/thautwarm/MLStyle.jl/blob/master/stats/bench-misc.txt) | ||
|
|
||
| ## An Example from Match.jl Documentation | ||
|
|
||
| - code: [matrix-benchmark/bench-vs-match.jl](https://github.com/thautwarm/MLStyle.jl/blob/master/matrix-benchmark/bench-vs-match.jl) | ||
|
|
||
| [](https://github.com/thautwarm/MLStyle.jl/blob/master/stats/bench-vs-match.txt) |
Oops, something went wrong.