A set of command-line statistics tools.
Download the binaries and put them somewhere in your path.
git clone git://github.com/jweslley/stats-tools.git
cd stats-tools
make
- min - Calculate the minimum of a number sequence
- max - Calculate the maximum of a number sequence
- mean - Calculate the mean of a number sequence
- std - Calculate the standard deviation of a number sequence
- var - Calculate the variance of a number sequence
- sum - Calculate the sum of a number sequence
- stats - Output a summary table including mean, median, mininum, maximum, standard deviation, variance and number count of a number sequence
All utilities take as input a file in table format to perform some calculation based on it. A tipical input file is shown below:
1 2 4
3 5 4
6 4 6
4 5 6
9 12 16
Considering this input file, let's call it example1.dat, you can calculate some statistics like:
The max value on the first column:
max example1.dat
The min value on the second column:
min -c 2 example1.dat
If the input file's columns are separated by another character instead of whitespace characters, like CSV files, you can use the -s option to denote this. The next example outputs a statistical summary about the second column of the following file (example2.dat):
"A",10,12
"A",11,14
"B",5,8
"B",6,10
"A",10.5,13
"B",7,11
Calculating the summary:
stats -c 2 -s , example2.dat
Commonly, data files may contain a head, i.e., the first line describes the columns, something like the example3.dat file showed below:
Year,Make,Model,Description,Price
1997,Ford,E350,"ac abs moon",3000.00
1999,Chevy,"Venture ""Extended Edition""","",4900.00
1999,Chevy,"Venture ""Extended Edition, Very Large""","",5000.00
1996,Jeep,Grand Cherokee,"MUST SELL!air, moon roof, loaded",4799.00
The -b option remove the first line from calculations. In this case, the mean price of the cars is given by:
mean -b -s, -c5 test/example3.dat
All stats-tools read data from standard input if no file is passed to them. The following command calculates the max value on the second column containing the word bar in the file foo.dat:
grep bar foo.dat | max -c 2
If you discover any bugs or have some idea, feel free to create an issue on GitHub:
http://github.com/jweslley/stats-tools/issues
MIT license. Copyright (c) 2011 Jonhnny Weslley http://jonhnnyweslley.net
See the LICENSE file provided with the source distribution for full details.