Skip to content
This repository was archived by the owner on May 9, 2024. It is now read-only.

Measures back-pressure on the job queue, and exerts control strategies at Block Generation #12

Closed
wants to merge 569 commits into from
Closed

Measures back-pressure on the job queue, and exerts control strategies at Block Generation #12

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
569 commits
Select commit Hold shift + click to select a range
777a081
Preparing Spark release v1.4.0-rc1
pwendell May 19, 2015
ac3197e
Preparing development version 1.4.1-SNAPSHOT
pwendell May 19, 2015
2cce6bf
[SPARK-7681] [MLLIB] remove mima excludes for 1.3
mengxr May 19, 2015
8567d29
[SPARK-7704] Updating Programming Guides per SPARK-4397
daisukebe May 19, 2015
24cb323
[SPARK-7047] [ML] ml.Model optional parent support
jkbradley May 19, 2015
cd3093e
[SPARK-7678] [ML] Fix default random seed in HasSeed
jkbradley May 19, 2015
ee012e0
[SPARK-7726] Fix Scaladoc false errors
dragos May 19, 2015
c3871ee
[SPARK-7586] [ML] [DOC] Add docs of Word2Vec in ml package
yinxusen May 19, 2015
5643499
[SPARK-7652] [MLLIB] Update the implementation of naive Bayes predict…
viirya May 19, 2015
87fa8cc
[SPARK-7738] [SQL] [PySpark] add reader and writer API in Python
May 19, 2015
62b4c73
[SPARK-7662] [SQL] Resolve correct names for generator in projection
chenghao-intel May 19, 2015
2ef04a1
[SPARK-7744] [DOCS] [MLLIB] Distributed matrix" section in MLlib "Dat…
dusenberrymw May 20, 2015
8689339
[SPARK-7656] [SQL] use CatalystConf in FunctionRegistry
scwf May 20, 2015
10698e1
[SPARK-7320] [SQL] Add Cube / Rollup for dataframe
chenghao-intel May 20, 2015
996e2d4
[SPARK-7654] [MLLIB] Migrate MLlib to the DataFrame reader/writer API
mengxr May 20, 2015
606ae3e
[SPARK-6094] [MLLIB] Add MultilabelMetrics in PySpark/MLlib
yanboliang May 20, 2015
55bd1bb
[SPARK-7713] [SQL] Use shared broadcast hadoop conf for partitioned t…
yhuai May 20, 2015
b40c5ed
[SPARK-7537] [MLLIB] spark.mllib API updates
mengxr May 20, 2015
ae8a854
[SPARK-7579] [ML] [DOC] User guide update for OneHotEncoder
sryza May 20, 2015
f84bdbc
Revert "[SPARK-7320] [SQL] Add Cube / Rollup for dataframe"
pwendell May 20, 2015
096cb12
[SPARK-7511] [MLLIB] pyspark ml seed param should be random by defaul…
holdenk May 20, 2015
23356dd
[SPARK-7237] [SPARK-7741] [CORE] [STREAMING] Clean more closures that…
May 20, 2015
a502e4b
[SPARK-7767] [STREAMING] Added test for checkpoint serialization in S…
tdas May 20, 2015
09a1c62
Preparing Spark release rc-test
pwendell May 20, 2015
205ed15
Preparing development version 1.4.0-SNAPSHOT
pwendell May 20, 2015
7cea552
[SPARK-7698] Cache and reuse buffers in ExecutorMemoryAllocator when …
JoshRosen May 20, 2015
82bc518
[SPARK-7251] Perform sequential scan when iterating over BytesToBytesMap
JoshRosen May 20, 2015
5f4d87f
Preparing Spark release rc-test
May 20, 2015
534c787
Preparing development version 1.4.0-SNAPSHOT
May 20, 2015
ae29aea
Preparing Spark release rc-test
pwendell May 21, 2015
8d66849
Preparing development version 1.4.0-SNAPSHOT
pwendell May 21, 2015
5f64269
[SPARK-7762] [MLLIB] set default value for outputCol
mengxr May 21, 2015
1e458e3
Preparing Spark release rc-test
pwendell May 21, 2015
9b37e32
Preparing development version 1.4.0-SNAPSHOT
pwendell May 21, 2015
e1f7de3
[SPARK-7719] Re-add UnsafeShuffleWriterSuite test that was removed fo…
JoshRosen May 21, 2015
0d061ff
[SPARK-7750] [WEBUI] Rename endpoints from `json` to `api` to allow fu…
harishreedharan May 21, 2015
b6182ce
[SPARK-7777] [STREAMING] Fix the flaky test in org.apache.spark.strea…
zsxwing May 21, 2015
4fd6743
[SPARK-7320] [SQL] Add Cube / Rollup for dataframe
chenghao-intel May 21, 2015
9711e9b
[SPARK-7774] [MLLIB] add sqlContext to MLlibTestSparkContext
mengxr May 21, 2015
e70be69
[SPARK-7746][SQL] Add FetchSize parameter for JDBC driver
viirya May 21, 2015
b0e7c66
[SPARK-7606] [SQL] [PySpark] add version to Python SQL API docs
May 21, 2015
6476244
[SPARK-7753] [MLLIB] Update KernelDensity API
mengxr May 21, 2015
f08c6f3
[SPARK-7745] Change asserts to requires for user input checks in Spar…
brkyvz May 21, 2015
f0e4213
[SPARK-7320] [SQL] [Minor] Move the testData into beforeAll()
chenghao-intel May 21, 2015
3aa6185
[SPARK-7565] [SQL] fix MapType in JsonRDD
May 21, 2015
b97a805
[SPARK-7752] [MLLIB] Use lowercase letters for NaiveBayes.modelType
mengxr May 21, 2015
70d9839
[SPARK-7749] [SQL] Fixes partition discovery for non-partitioned tables
liancheng May 21, 2015
21b1505
[SPARK-7787] [STREAMING] Fix serialization issue of SerializableAWSCr…
tdas May 21, 2015
0df461e
[SPARK-6416] [DOCS] RDD.fold() requires the operator to be commutative
srowen May 21, 2015
fec3041
[SPARK-7394][SQL] Add Pandas style cast (astype)
kaka1992 May 21, 2015
f6a29c7
[SPARK-7793] [MLLIB] Use getOrElse for getting the threshold of SVM m…
coderxiang May 21, 2015
e79ecc7
[SQL] [TEST] udf_java_method failed due to jdk version
scwf May 21, 2015
e29b811
[SPARK-7585] [ML] [DOC] VectorIndexer user guide section
jkbradley May 21, 2015
7e0912b
[SPARK-7498] [MLLIB] add varargs back to setDefault
mengxr May 21, 2015
777733e
[SPARK-7722] [STREAMING] Added Kinesis to style checker
tdas May 21, 2015
96c8251
[SPARK-7763] [SPARK-7616] [SQL] Persists partition columns into metas…
yhuai May 21, 2015
e597692
[SPARK-7478] [SQL] Added SQLContext.getOrCreate
tdas May 21, 2015
c9a80fc
[SPARK-7711] Add a startTime property to match the corresponding one …
holdenk May 21, 2015
ba04b52
[SPARK-7718] [SQL] Speed up partitioning by avoiding closure cleaning
May 21, 2015
e4489c3
[SPARK-7800] isDefined should not marked too early in putNewKey
viirya May 21, 2015
2be72c9
[BUILD] Always run SQL tests in master build.
yhuai May 21, 2015
11a0640
[SPARK-7737] [SQL] Use leaf dirs having data files to discover partit…
yhuai May 21, 2015
ba620d6
[SPARK-7783] [SQL] [PySpark] add DataFrame.rollup/cube in Python
May 22, 2015
a17a5cb
[SPARK-7776] [STREAMING] Added shutdown hook to StreamingContext
tdas May 22, 2015
ef93363
[SPARK-7794] [MLLIB] update RegexTokenizer default settings
mengxr May 22, 2015
df55a0d
[SPARK-7219] [MLLIB] Output feature attributes in HashingTF
mengxr May 22, 2015
2cc7907
[DOCS] [MLLIB] Fixing broken link in MLlib Linear Methods documentation.
dusenberrymw May 22, 2015
11a5f32
[SPARK-7535] [.0] [MLLIB] Audit the pipeline APIs for 1.4
mengxr May 22, 2015
19e579c
[SPARK-7578] [ML] [DOC] User guide for spark.ml Normalizer, IDF, Stan…
jkbradley May 22, 2015
bfaf6a0
[SPARK-7322][SQL] Window functions in DataFrame
chenghao-intel May 22, 2015
1a28474
[MINOR] [SQL] Ignores Thrift server UISeleniumSuite
liancheng May 22, 2015
427dc04
[SPARK-6743] [SQL] Fix empty projections of cached data
marmbrus May 22, 2015
d709d7c
[SPARK-7404] [ML] Add RegressionEvaluator to spark.ml
May 22, 2015
cb1de97
Revert "[BUILD] Always run SQL tests in master build."
pwendell May 22, 2015
3b4f9ce
[SPARK-7574] [ML] [DOC] User guide for OneVsRest
May 22, 2015
2904d3f
[SPARK-7766] KryoSerializerInstance reuse is unsafe when auto-reset i…
JoshRosen May 22, 2015
40989ce
[SPARK-7758] [SQL] Override more configs to avoid failure when connec…
WangTaoTheTonic May 22, 2015
e18d623
[SPARK-7724] [SQL] Support Intersect/Except in Catalyst DSL.
smola May 22, 2015
d6cb044
[SPARK-7270] [SQL] Consider dynamic partition when inserting into hiv…
viirya May 22, 2015
afde401
[SPARK-7760] add /json back into master & worker pages; add test
squito May 22, 2015
d7660dc
[SPARK-7834] [SQL] Better window error messages
marmbrus May 23, 2015
0be6e3b
[SPARK-7771] [SPARK-7779] Dynamic allocation: lower default timeouts …
May 23, 2015
130ec21
[SPARK-7788] Made KinesisReceiver.onStart() non-blocking
tdas May 23, 2015
17a51c8
[SPARK-7224] [SPARK-7306] mock repository generator for --packages te…
brkyvz May 23, 2015
08464ec
[SPARK-7830] [DOCS] [MLLIB] Adding logistic regression to the list of…
dusenberrymw May 23, 2015
1a134e5
[MINOR] Add SparkR to create-release script
shivaram May 23, 2015
b928db4
[SPARK-7838] [STREAMING] Set scope for kinesis stream
tdas May 23, 2015
c636b87
[SPARK-6806] [SPARKR] [DOCS] Fill in SparkR examples in programming g…
May 23, 2015
c8eb76b
[SPARK-6811] Copy SparkR lib in make-distribution.sh
shivaram May 23, 2015
ea9db50
[SPARK-7777][Streaming] Handle the case when there is no block in a b…
zsxwing May 23, 2015
d151538
[SPARK-7322, SPARK-7836, SPARK-7822][SQL] DataFrame window function r…
May 23, 2015
c6e5742
[SPARK-7840] add insertInto() to Writer
May 23, 2015
8d6d8a5
[SPARK-7654] [SQL] Move insertInto into reader/writer interface.
yhuai May 23, 2015
fbc4480
[HOTFIX] Copy SparkR lib if it exists in make-distribution
shivaram May 23, 2015
8f50218
Preparing Spark release 1.4.0-rc2-test
pwendell May 23, 2015
8da8caa
Preparing development version 1.4.1-SNAPSHOT
pwendell May 23, 2015
0da7396
Preparing Spark release v1.4.0-rc2-test
pwendell May 23, 2015
f2f74b9
Preparing development version 1.4.1-SNAPSHOT
pwendell May 23, 2015
641edc9
[SPARK-7287] [HOTFIX] Disable o.a.s.deploy.SparkSubmitSuite --packages
pwendell May 24, 2015
03fb26a
Preparing Spark release v1.4.0-rc2
pwendell May 24, 2015
947d700
Preparing development version 1.4.0-SNAPSHOT
pwendell May 24, 2015
11d998e
[SPARK-7845] [BUILD] Bump "Hadoop 1" tests to version 1.2.1
yhuai May 24, 2015
b06389c
[SPARK-7805] [SQL] Move SQLTestUtils.scala and ParquetTest.scala to s…
yhuai May 24, 2015
16a6da5
[SPARK-7833] [ML] Add python wrapper for RegressionEvaluator
May 24, 2015
81b35d8
[SPARK-7684] [SQL] Invoking HiveContext.newTemporaryConfiguration() s…
liancheng May 25, 2015
7edb17b
[SPARK-7842] [SQL] Makes task committing/aborting in InsertIntoHadoop…
liancheng May 25, 2015
d5572ab
[SPARK-6391][DOCS] Document Tachyon compatibility.
calvinjia May 25, 2015
44b22a3
[SPARK-7832] [Build] Always run SQL tests in master build.
yhuai May 26, 2015
4b31a07
[SQL][minor] Removed unused Catalyst logical plan DSL.
rxin May 26, 2015
79bb7dc
[CORE] [TEST] Fix SimpleDateParamTest
scwf May 26, 2015
25b2f95
[SPARK-7339] [PYSPARK] PySpark shuffle spill memory sometimes are not…
Sephiroth-Lin May 26, 2015
42070f0
[SPARK-7806][EC2] Fixes that allow the spark_ec2.py tool to run with …
meawoppl May 26, 2015
dfd905d
[DOCS] [MLLIB] Fixing misformatted links in v1.4 MLlib Naive Bayes do…
dusenberrymw May 26, 2015
51d98b0
[SPARK-7844] [MLLIB] Fix broken tests in KernelDensity
MechCoder May 26, 2015
d014a44
[SPARK-3674] YARN support in Spark EC2
shivaram May 26, 2015
b5ee7ee
[SPARK-7748] [MLLIB] Graduate spark.ml from alpha
mengxr May 26, 2015
f9dfa4d
[SPARK-7864] [UI] Do not kill innocent stages from visualization
May 26, 2015
311fcf6
[SPARK-7883] [DOCS] [MLLIB] Fixing broken trainImplicit Scala example…
dusenberrymw May 27, 2015
faadbd4
[SPARK-7858] [SQL] Use output schema, not relation schema, for data s…
JoshRosen May 27, 2015
d0bd68f
[SPARK-7868] [SQL] Ignores _temporary directories in HadoopFsRelation
liancheng May 27, 2015
34e233f
[SPARK-7535] [.1] [MLLIB] minor changes to the pipeline API
mengxr May 27, 2015
4e12cec
[SPARK-7850][BUILD] Hive 0.12.0 profile in POM should be removed
May 27, 2015
01c3ef5
[SPARK-7697][SQL] Use LongType for unsigned int in JDBCRDD
viirya May 27, 2015
e535713
[SQL] Rename MathematicalExpression UnaryMathExpression, and specify …
rxin May 27, 2015
90525c9
[CORE] [TEST] HistoryServerSuite failed due to timezone issue
scwf May 27, 2015
a25ce91
[SPARK-7847] [SQL] Fixes dynamic partition directory escaping
liancheng May 27, 2015
13044b0
[SPARK-7864] [UI] Fix the logic grabbing the link from table in AllJo…
sarutak May 27, 2015
0468d57
Removed Guava dependency from JavaTypeInference's type signature.
rxin May 27, 2015
d33142f
[SPARK-7790] [SQL] date and decimal conversion for dynamic partition key
adrian-wang May 27, 2015
89fe93f
[SPARK-7684] [SQL] Refactoring MetastoreDataSourcesSuite to workaroun…
liancheng May 27, 2015
e07b715
[SPARK-7853] [SQL] Fixes a class loader issue in Spark SQL
chenghao-intel May 27, 2015
b4ecbce
[SPARK-7897][SQL] Use DecimalType to represent unsigned bigint in JDB…
viirya May 28, 2015
bd9173c
[SPARK-7907] [SQL] [UI] Rename tab ThriftServer to SQL.
yhuai May 28, 2015
9da4b6b
[SPARK-7873] Allow KryoSerializerInstance to create multiple streams …
JoshRosen May 28, 2015
d83c2ee
[SPARK-7896] Allow ChainedBuffer to store more than 2 GB
sryza May 28, 2015
4983dfc
Preparing Spark release v1.4.0-rc3
pwendell May 28, 2015
7c342bd
Preparing development version 1.4.0-SNAPSHOT
pwendell May 28, 2015
63be026
[DOCS] Fix typo in documentation for Java UDF registration
wisematthew May 28, 2015
bd568df
[SPARK-7782] fixed sort arrow issue
zuxqoj May 28, 2015
ab62d73
[SPARK-7895] [STREAMING] [EXAMPLES] Move Kafka examples from scala-2.…
zsxwing May 28, 2015
7b5dffb
[SPARK-7911] [MLLIB] A workaround for VectorUDT serialize (or deseria…
mengxr May 28, 2015
4485283
[MINOR] Fix the a minor bug in PageRank Example.
lastland May 28, 2015
0a65224
[DOCS] Fixing broken "IDE setup" link in the Building Spark documenta…
dusenberrymw May 28, 2015
b9bdf12
[SPARK-7198] [MLLIB] VectorAssembler should output ML attributes
mengxr May 28, 2015
9c2c6b4
Remove SizeEstimator from o.a.spark package.
rxin May 28, 2015
8f4a86e
[SPARK-7853] [SQL] Fix HiveContext in Spark Shell
yhuai May 29, 2015
7bb445a
[SPARK-7577] [ML] [DOC] add bucketizer doc
yinxusen May 29, 2015
f4b1353
[SPARK-7927] whitespace fixes for streaming.
rxin May 29, 2015
3b38c06
[SPARK-7927] whitespace fixes for Hive and ThriftServer.
rxin May 29, 2015
3479e6a
[SPARK-7933] Remove Patrick's username/pw from merge script
kayousterhout May 29, 2015
0c05115
[SPARK-7927] [MLLIB] Enforce whitespace for more tokens in style checker
mengxr May 29, 2015
9b97e95
[SPARK-7927] whitespace fixes for SQL core.
rxin May 29, 2015
142ae52
[SPARK-7929] Remove Bagel examples & whitespace fix for examples.
rxin May 29, 2015
22e42e3
[SPARK-7927] whitespace fixes for Catalyst module.
rxin May 29, 2015
e3dd280
[SPARK-7927] whitespace fixes for core.
rxin May 29, 2015
b3a5900
[SPARK-7927] whitespace fixes for GraphX.
rxin May 29, 2015
6e99dd5
[SPARK-7926] [PYSPARK] use the official Pyrolite release
mengxr May 29, 2015
1d49d8c
[MINOR] fix RegressionEvaluator doc
mengxr May 29, 2015
aee046d
[SPARK-7932] Fix misleading scheduler delay visualization
kayousterhout May 29, 2015
f7cb272
[SPARK-7930] [CORE] [STREAMING] Fixed shutdown hook priorities
tdas May 29, 2015
6855942
[SPARK-7922] [MLLIB] use DataFrames for user/item factors in ALSModel
mengxr May 29, 2015
7a52fdf
[SPARK-7931] [STREAMING] Do not restart receiver when stopped
tdas May 29, 2015
e419821
[HOTFIX] Minor style fix from last commit
pwendell May 29, 2015
2d97d7a
Preparing Spark release v1.4.0-rc3
pwendell May 29, 2015
119c93a
Preparing development version 1.4.0-SNAPSHOT
pwendell May 29, 2015
55dc7a6
[SPARK-7929] Turn whitespace checker on for more token types.
rxin May 29, 2015
f279681
Preparing Spark release v1.4.0-rc3
pwendell May 29, 2015
6bf5a42
Preparing development version 1.4.0-SNAPSHOT
pwendell May 29, 2015
509a7ca
[SPARK-7912] [SPARK-7921] [MLLIB] Update OneHotEncoder to handle ML a…
mengxr May 29, 2015
459c3d2
[SPARK-7756] [CORE] Use testing cipher suites common to Oracle and IB…
tellison May 29, 2015
23bd05f
HOTFIX: Scala style checker failure due to a missing space in Tachyon…
rxin May 29, 2015
caea7a6
[SPARK-7950] [SQL] Sets spark.sql.hive.version in HiveThriftServer2.s…
liancheng May 29, 2015
62df047
HOTFIX: Scala style checker for DataTypeSuite.scala.
rxin May 29, 2015
645e611
[SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftS…
liancheng May 29, 2015
4be701a
[SPARK-7946] [MLLIB] DecayFactor wrongly set in StreamingKMeans
MechCoder May 29, 2015
fb60503
Preparing Spark release v1.4.0-rc3
pwendell May 29, 2015
c68abaa
Preparing development version 1.4.0-SNAPSHOT
pwendell May 29, 2015
18811ca
Revert "[SQL] [TEST] [MINOR] Uses a temporary log4j.properties in Hiv…
pwendell May 29, 2015
dd109a8
Preparing Spark release v1.4.0-rc3
pwendell May 29, 2015
e549874
Preparing development version 1.4.0-SNAPSHOT
pwendell May 29, 2015
f40605f
[SPARK-7940] Enforce whitespace checking for DO, TRY, CATCH, FINALLY,…
rxin May 29, 2015
cf4122e
[SPARK-6806] [SPARKR] [DOCS] Add a new SparkR programming guide
shivaram May 29, 2015
2bd4460
[SPARK-7954] [SPARKR] Create SparkContext in sparkRSQL init
shivaram May 29, 2015
9a88be1
[SPARK-6013] [ML] Add more Python ML examples for spark.ml
May 29, 2015
400e6db
[DOCS][Tiny] Added a missing dash(-) in docs/configuration.md
mrt May 30, 2015
1513cff
[SPARK-7957] Preserve partitioning when using randomSplit
brkyvz May 30, 2015
11a4b30
[SPARK-7576] [MLLIB] Add spark.ml user guide doc/example for Elementw…
ogeagla May 30, 2015
8938a74
[SPARK-7962] [MESOS] Fix master url parsing in rest submission client.
tnachen May 30, 2015
2c45009
[SPARK-7459] [MLLIB] ElementwiseProduct Java example
ogeagla May 30, 2015
d6e9ead
[SPARK-7890] [DOCS] Document that Spark 2.11 now supports Kafka
srowen May 30, 2015
e7ba3ea
[DOCS] [MINOR] Update for the Hadoop versions table with hadoop-2.6
mrt May 30, 2015
b2b7601
[SPARK-7849] [SQL] [Docs] Updates SQL programming guide for 1.4
liancheng May 30, 2015
6d7cf53
Updated SQL programming guide's Hive connectivity section.
rxin May 30, 2015
2790bb0
[SPARK-7918] [MLLIB] MLlib Python doc parity check for evaluation and…
yanboliang May 30, 2015
df56309
[SPARK-7920] [MLLIB] Make MLlib ChiSqSelector Serializable (& Fix Rel…
dusenberrymw May 30, 2015
a60b8bf
[SPARK-5610] [DOC] update genjavadocSettings to use the patched versi…
mengxr May 31, 2015
dc58e68
[SQL] Tighten up visibility for JavaDoc.
rxin May 31, 2015
e74ea78
[SPARK-7971] Add JavaDoc style deprecation for deprecated DataFrame m…
rxin May 31, 2015
5e268d3
Update documentation for the new DataFrame reader/writer interface.
rxin May 31, 2015
adfc9d1
[SPARK-7976] Add style checker to disallow overriding finalize.
rxin May 31, 2015
0d093d6
[SQL] [MINOR] Adds @deprecated Scaladoc entry for SchemaRDD
liancheng May 31, 2015
2016927
[SPARK-7975] Add style checker to disallow overriding equals covarian…
rxin May 31, 2015
a7c2171
[SPARK-3850] Trim trailing spaces for core.
rxin May 31, 2015
f63eab9
[SPARK-3850] Trim trailing spaces for examples/streaming/yarn.
rxin May 31, 2015
a1904fa
[SPARK-3850] Trim trailing spaces for SQL.
rxin May 31, 2015
01f38f7
[SPARK-7979] Enforce structural type checker.
rxin May 31, 2015
8a72bc9
[MINOR] Add license for dagre-d3 and graphlib-dot
zsxwing May 31, 2015
70cf9c3
[SPARK-3850] Trim trailing spaces for MLlib.
rxin May 31, 2015
4d5ce46
[SPARK-7949] [MLLIB] [DOC] update document with some missing save/load
hhbyyh May 31, 2015
bab0fab
[SPARK-3850] Turn style checker on for trailing whitespaces.
rxin May 31, 2015
f1d4e7e
[SPARK-7227] [SPARKR] Support fillna / dropna in R DataFrame.
May 31, 2015
df0bf71
[HOTFIX] Remove trailing whitespace to fix Scalastyle checks
JoshRosen May 31, 2015
78a6723
[SPARK-7978] [SQL] [PYSPARK] DecimalType should not be singleton
Jun 1, 2015
2f41cf3
[DOC] Minor modification to Streaming docs with regards to parallel d…
nishkamravi2 Jun 1, 2015
d023300
[SPARK-7497] [PYSPARK] [STREAMING] fix streaming flaky tests
Jun 1, 2015
4cafc63
[SPARK-7584] [MLLIB] User guide for VectorAssembler
mengxr Jun 1, 2015
a76c2e1
[SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict
mnazbro May 29, 2015
a7c8b00
[SPARK-7958] [STREAMING] Handled exception in StreamingContext.start(…
tdas Jun 2, 2015
f5a9833
[MINOR] [UI] Improve error message on log page
Jun 2, 2015
cbfb682
[SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR
shivaram Jun 2, 2015
efc0e05
[SPARK-7982][SQL] DataFrame.stat.crosstab should use 0 instead of nul…
rxin Jun 2, 2015
8ac2376
[SPARK-8026][SQL] Add Column.alias to Scala/Java DataFrame API
rxin Jun 2, 2015
d542a35
[SPARK-8027] [SPARKR] Add maven profile to build R package docs
shivaram Jun 2, 2015
3af4c0b
[minor doc] Add exploratory data analysis warning for DataFrame.stat.…
rxin Jun 2, 2015
0d21a41
[SPARK-8025][Streaming]Add JavaDoc style deprecation for deprecated S…
zsxwing Jun 2, 2015
e6d5895
[SPARK-7965] [SPARK-7972] [SQL] Handle expressions containing multipl…
yhuai Jun 2, 2015
575f3b3
Fixed typo in the previous commit.
rxin Jun 2, 2015
011b07e
[SPARK-7582] [MLLIB] user guide for StringIndexer
mengxr Jun 2, 2015
9d6475b
[SPARK-6917] [SQL] DecimalType is not read back when non-native type …
Jun 2, 2015
4940630
[SPARK-8020] [SQL] Spark SQL conf in spark-defaults.conf make metadat…
yhuai Jun 2, 2015
87941ff
[SPARK-8023][SQL] Add "deterministic" attribute to Expression to avoi…
yhuai Jun 2, 2015
292ee1a
[SPARK-8021] [SQL] [PYSPARK] make Python read/write API consistent wi…
Jun 2, 2015
48c5067
Preparing Spark release v1.4.0-rc4
pwendell Jun 2, 2015
92a6778
Preparing development version 1.4.0-SNAPSHOT
pwendell Jun 2, 2015
97fedf1
[SPARK-7432] [MLLIB] fix flaky CrossValidator doctest
mengxr Jun 2, 2015
8c3fc3a
[HOT-FIX] Add EvaluatedType back to RDG
yhuai Jun 2, 2015
f71a09d
[SPARK-8037] [SQL] Ignores files whose name starts with dot in Hadoop…
liancheng Jun 2, 2015
fa292dc
[SPARK-8015] [FLUME] Remove Guava dependency from flume-sink.
Jun 2, 2015
139c824
[MINOR] Enable PySpark SQL readerwriter and window tests
JoshRosen May 31, 2015
815e056
[SPARK-7985] [ML] [MLlib] [Docs] Remove "fittingParamMap" references.…
dusenberrymw Jun 2, 2015
cbaf595
[SPARK-8014] [SQL] Avoid premature metadata discovery when writing a …
liancheng Jun 2, 2015
6b0f615
[SPARK-8038] [SQL] [PYSPARK] fix Column.when() and otherwise()
Jun 2, 2015
d630f4d
Preparing Spark release v1.4.0-rc4
pwendell Jun 2, 2015
92ccc5b
Preparing development version 1.4.0-SNAPSHOT
pwendell Jun 2, 2015
97d4cd0
[SPARK-8049] [MLLIB] drop tmp col from OneVsRest output
mengxr Jun 2, 2015
a14fad1
Preparing Spark release v1.4.0-rc4
pwendell Jun 3, 2015
e3c35b2
Preparing development version 1.4.0-SNAPSHOT
pwendell Jun 3, 2015
daeaa0c
[SQL] [TEST] [MINOR] Uses a temporary log4j.properties in HiveThriftS…
liancheng May 29, 2015
0d83720
[SQL] [TEST] [MINOR] Follow-up of PR #6493, use Guava API to ensure J…
liancheng Jun 3, 2015
22596c5
Preparing Spark release v1.4.0-rc4
pwendell Jun 3, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
1 change: 1 addition & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -65,6 +65,7 @@ scalastyle.txt
scalastyle-output.xml
R-unit-tests.log
R/unit-tests.out
python/lib/pyspark.zip

# For Hive
metastore_db/
Expand Down
11 changes: 10 additions & 1 deletion .rat-excludes
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,10 +30,12 @@ spark-env.sh.template
log4j-defaults.properties
bootstrap-tooltip.js
jquery-1.11.1.min.js
d3.min.js
dagre-d3.min.js
graphlib-dot.min.js
sorttable.js
vis.min.js
vis.min.css
vis.map
.*avsc
.*txt
.*json
Expand Down Expand Up @@ -71,5 +73,12 @@ logs
.*scalastyle-output.xml
.*dependency-reduced-pom.xml
known_translations
json_expectation
local-1422981759269/*
local-1422981780767/*
local-1425081759269/*
local-1426533911241/*
local-1426633911242/*
local-1430917381534/*
DESCRIPTION
NAMESPACE
Loading