usage of split() function

shiqilin123 · Apr 13, 2016 · 75f1313 · 75f1313
1 parent e4855b8
commit 75f1313
Showing 1 changed file with 18 additions and 0 deletions.
diff --git a/tutorial/split-function/README.md b/tutorial/split-function/README.md
@@ -1,6 +1,8 @@
 How To Use Split Function
 =========================
 
+* Example-1: Split ````RDD<String>```` into Tokens
+
 ````
 # ./bin/pyspark
 Python 2.7.10 (default, Oct 23 2015, 19:19:21)
@@ -31,3 +33,19 @@ SparkContext available as sc, HiveContext available as sqlContext.
 >>> rdd2.count()
 9
 ````
+
+* Example-2: Create Key-Value Pairs
+
+````
+>>> data2 = ["abc,de", "xyz,deeee,ze", "abc,de,ze,pe", "xyz,bababa"]
+>>> data2
+['abc,de', 'xyz,deeee,ze', 'abc,de,ze,pe', 'xyz,bababa']
+
+>>> rdd4 = sc.parallelize(data2)
+>>> rdd4.collect()
+['abc,de', 'xyz,deeee,ze', 'abc,de,ze,pe', 'xyz,bababa']
+
+>>> rdd5 = rdd4.map(lambda x : (x.split(",")[0], x.split(",")[1]))
+>>> rdd5.collect()
+[('abc', 'de'), ('xyz', 'deeee'), ('abc', 'de'), ('xyz', 'bababa')]
+````