@@ -23,7 +23,7 @@ or chat with us on [Freenode](https://freenode.net/faq.shtml#whatwhy) at `#teche
23
23
remote server dedicated to this project or by using a virtual machine.
24
24
Here's a short example:
25
25
26
- ```
26
+ ``` bash
27
27
# Clone the project, then move into the right directory
28
28
$ cd ~ /FrameworkBenchmarks/deployment/vagrant-development
29
29
# Turn on the VM. Takes at least 20 minutes
@@ -104,42 +104,39 @@ See [here](deployment) for additional details.
104
104
105
105
** Setting up the ` load server ` **
106
106
107
- ```
108
- toolset/run-tests.py --install client --verbose --install-only
107
+ ``` bash
108
+ $ toolset/run-tests.py --install client --install-only
109
109
```
110
110
111
111
** Setting up the ` database server ` **
112
112
113
- ```
114
- toolset/run-tests.py --install database --verbose --install-only
115
- # We are still working to automate MongoDO. Until this, please run
116
- # this as well (replacing database-ip with your own value)
117
- mongo --host database-ip < config/create.js
113
+ ``` bash
114
+ $ toolset/run-tests.py --install database --install-only
118
115
```
119
116
120
117
** Setting up the ` app server ` **
121
118
122
119
You can choose to selectively install components by using the
123
120
` --test ` and ` --exclude ` flags.
124
121
125
- ```
122
+ ``` bash
126
123
# Install just the software for beego (as an example)
127
- toolset/run-tests.py --install server --test beego --verbose --install-only
124
+ $ toolset/run-tests.py --install server --test beego --verbose --install-only
128
125
129
126
# Install all php software but php-fuel (as another example)
130
- toolset/run-tests.py --install server --test php* --exclude php-fuel --verbose --install-only
127
+ $ toolset/run-tests.py --install server --test php* --exclude php-fuel --verbose --install-only
131
128
132
129
# Install *all* framework software. Expect this to take hours!
133
130
# If running on a remote server, use `screen` or `tmux` or `nohup` to
134
131
# prevent the installation from being terminated if you are disconnected
135
- toolset/run-tests.py --install server --verbose --install-only
132
+ $ toolset/run-tests.py --install server --verbose --install-only
136
133
```
137
134
138
135
## Listing Tests
139
136
140
137
You can easily list all available tests
141
138
142
- ```
139
+ ``` bash
143
140
$ toolset/run-tests.py --list-tests
144
141
activeweb
145
142
activeweb-raw
@@ -156,23 +153,23 @@ aspnet-mono-mongodb-raw
156
153
157
154
There are a number of options that can be specified:
158
155
159
- ```
156
+ ``` bash
160
157
# Run a verification for test beego
161
- toolset/run-tests.py --test beego --mode verify
158
+ $ toolset/run-tests.py --test beego --mode verify
162
159
163
160
# Run the default benchmark for the beego test
164
- toolset/run-tests.py --test beego
161
+ $ toolset/run-tests.py --test beego
165
162
166
163
# Specify which test types are run during benchmark
167
- toolset/run-tests.py --test beego --type json
168
- toolset/run-tests.py --test beego --type db
169
- toolset/run-tests.py --test beego --type fortune
164
+ $ toolset/run-tests.py --test beego --type json
165
+ $ toolset/run-tests.py --test beego --type db
166
+ $ toolset/run-tests.py --test beego --type fortune
170
167
171
168
# Specify a number of options for how the load is generated
172
- toolset/run-tests.py --test beego --max-concurrency 24 --max-threads 24 --duration 20 --max-queries 200
169
+ $ toolset/run-tests.py --test beego --max-concurrency 24 --max-threads 24 --duration 20 --max-queries 200
173
170
174
171
# Run a tiny benchmark
175
- toolset/run-tests.py --test beego --max-threads 2 --max-concurrency 2
172
+ $ toolset/run-tests.py --test beego --max-threads 2 --max-concurrency 2
176
173
```
177
174
178
175
## Finding output logs
@@ -199,7 +196,9 @@ and all changes. These guidelines prevent us from having to give repeated feedba
199
196
the same topics:
200
197
201
198
* ** Use specific versions** : If you're updating any software or dependency, please be
202
- specific with the version number. Also, update the appropriate ` README ` to reflect that change
199
+ specific with the version number. Also, update the appropriate ` README ` to reflect
200
+ that change. Don't rely on the package manager to deliver a specific version, apt
201
+ consistently returns different versions on Ubuntu 12.04 vs 14.04.
203
202
* ** Rope in experts** : If you're making a performance tweak, our team may not be
204
203
able to verify your code--we are not experts in every language. It's always helpful
205
204
to ping expert users and provide a basic introduction on their credentials. If you
@@ -217,6 +216,10 @@ request will be verifed as normal.
217
216
different concepts and frameworks, and it can really help to read the README's, such
218
217
as this one, the one inside the ` toolset/ ` directory, and the ones inside specific
219
218
framework directories
219
+ * ** Use the Development Virtual Machine** : Our Vagrant scripts can setup a VM for you
220
+ that looks nearly identical to our test environment. This is even better than relying
221
+ on the Travis-CI verification, and you are strongly encouraged to use this. See
222
+ the [ deployment directory] ( deployment ) for specifics
220
223
221
224
---
222
225
0 commit comments