Skip to content

Commit 8ebcc07

Browse files
RyanQueyRyanQuey
committed
add outline of spark scripts scala project
1 parent 364e2f9 commit 8ebcc07

File tree

90 files changed

+379
-0
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

90 files changed

+379
-0
lines changed

‎spark-scripts/README.md

+96
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,96 @@
1+
2+
3+
## How to start
4+
5+
```
6+
sbt package
7+
$HOME/lib/dse-6.8.0/bin/dse spark-submit \
8+
--class "SimpleApp" \
9+
--master local[4] \
10+
target/scala-2.11/spark-scripts-for-podcast-analysis-tool_2.11-0.3.0.jar
11+
```
12+
13+
Or since we made a quick script:
14+
```
15+
bash submit-script.sh
16+
17+
# OR
18+
19+
sbt package && bash submit-script.sh
20+
```
21+
22+
23+
## Setup For Development
24+
### Install Scala
25+
- Using [sbt](https://www.scala-sbt.org/1.x/docs/Installing-sbt-on-Linux.html) rather than IntelliJ
26+
- We want Scala 2.11 since that is what current DSE 6.8 uses and what we have setup in Zeppelin, etc
27+
28+
```
29+
echo "deb https://dl.bintray.com/sbt/debian /" | sudo tee -a /etc/apt/sources.list.d/sbt.list
30+
curl -sL "https://keyserver.ubuntu.com/pks/lookup?op=get&search=0x2EE0EA64E40A89B84B2DF73499E82A75642AC823" | sudo apt-key add
31+
sudo apt-get update
32+
sudo apt-get install sbt
33+
34+
### What we did to get everything setup (for record keeping):
35+
touch spark-scripts/build.sbt
36+
sbt
37+
```
38+
39+
#### Now in the sbt console:
40+
Set Scala version, and save to build.sbt
41+
```
42+
set ThisBuild / scalaVersion := "2.11.12"
43+
session save
44+
```
45+
46+
Turn on auto Compile (builds our directory tree)
47+
```
48+
~compile
49+
```
50+
51+
#### Now in bash
52+
Make directory tree, and better setup, and make our main file
53+
```
54+
mkdir -p src/main/scala/com/ryanquey/podcast
55+
vim src/main/scala/com/ryanquey/podcast/Main.scala
56+
# and then, edit it as we need
57+
58+
```
59+
60+
Then setup up build.sbt to [add dependencies](https://www.scala-sbt.org/1.x/docs/sbt-by-example.html#Add+a+library+dependency) etc
61+
[Spark's tutorial for sbt quickstart](https://spark.apache.org/docs/2.4.0/quick-start.html#self-contained-applications) is helpful too.
62+
63+
Make sure to run `reload` in sbt console
64+
65+
### ALTERNATIVELY
66+
If it's not working well, try Scala with maven
67+
https://docs.scala-lang.org/tutorials/scala-with-maven.html
68+
69+
I started a pom.xml file already, didn't get very far but it's kept under pom.xml.bkup in this folder
70+
71+
It would be nice to be able to use SBT though since it is more scala-native and also uses scala-style (such as loading dependencies how Zeppelin or spark-submit does)
72+
73+
### Using Spark standalone
74+
In the long run, this is what I want to use, since I switched over to using Elassandra
75+
TODO
76+
- add Spark docker image and link using docker-compose
77+
- Setup spark cassandra connector
78+
79+
### Using DSE
80+
81+
#### if you want to connect to Kafka
82+
$HOME/lib/dse-6.8.0/bin/dse spark --packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.4.0
83+
84+
## Notes:
85+
### Our setup
86+
Initialized using:
87+
88+
```
89+
mvn -B archetype:generate \
90+
-DarchetypeGroupId=org.apache.maven.archetypes \
91+
-DgroupId=com.ryanquey.podcast \
92+
-DartifactId=spark-scripts
93+
```
94+
95+
Followed instructions from Cloudera [here](https://docs.cloudera.com/documentation/enterprise/5-5-x/topics/spark_develop_run.html)
96+
Also [official Spark docs](https://spark.apache.org/docs/2.4.0/submitting-applications.html). But they are not very helpful for actually describing how to layout your spark scala code. (Must be assumed you know scala haha)

‎spark-scripts/build.sbt

+6
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
// NOTE sets scalaVersion for all subprojects too
2+
ThisBuild / scalaVersion := "2.11.12"
3+
name := "Spark Scripts for Podcast Analysis Tool"
4+
version := "0.3.0"
5+
libraryDependencies += "org.apache.spark" %% "spark-sql" % "2.4.0"
6+

‎spark-scripts/pom.xml.backup

+57
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,57 @@
1+
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
2+
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
3+
<modelVersion>4.0.0</modelVersion>
4+
<groupId>com.ryanquey.podcast</groupId>
5+
<artifactId>spark-scripts</artifactId>
6+
<packaging>jar</packaging>
7+
<version>1.0-SNAPSHOT</version>
8+
<name>spark-scripts</name>
9+
<url>http://maven.apache.org</url>
10+
11+
<dependencies>
12+
<dependency>
13+
<groupId>junit</groupId>
14+
<artifactId>junit</artifactId>
15+
<version>3.8.1</version>
16+
<scope>test</scope>
17+
</dependency>
18+
19+
<dependency>
20+
<groupId>org.scala-lang</groupId>
21+
<artifactId>scala-library</artifactId>
22+
<version>2.11.2</version>
23+
<scope>provided</scope>
24+
</dependency>
25+
26+
<dependency>
27+
<groupId>org.apache.spark</groupId>
28+
<artifactId>spark-core_2.11</artifactId>
29+
<version>2.4.0</version>
30+
<scope>provided</scope>
31+
</dependency>
32+
</dependencies>
33+
34+
<build>
35+
<plugins>
36+
<plugin>
37+
<groupId>org.scala-tools</groupId>
38+
<artifactId>maven-scala-plugin</artifactId>
39+
<executions>
40+
<execution>
41+
<goals>
42+
<goal>compile</goal>
43+
<goal>testCompile</goal>
44+
</goals>
45+
</execution>
46+
</executions>
47+
</plugin>
48+
</plugins>
49+
</build>
50+
<pluginRepositories>
51+
<pluginRepository>
52+
<id>scala-tools.org</id>
53+
<name>Scala-tools Maven2 Repository</name>
54+
<url>http://scala-tools.org/repo-releases</url>
55+
</pluginRepository>
56+
</pluginRepositories>
57+
</project>

‎spark-scripts/project/build.properties

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
sbt.version=1.3.13

‎spark-scripts/project/target/active.json

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"uri":"local:///home/ubuntu/.sbt/1.0/server/b892141e4c5f636e3663/sock"}

‎spark-scripts/project/target/config-classes/$0969a2c4927461a10167.cache

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
sbt.internal.DslEntry

‎spark-scripts/project/target/config-classes/$af12c7a17ad3421514d3.cache

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
sbt.internal.DslEntry

‎spark-scripts/project/target/config-classes/$db4dd8549dd978d5e38c.cache

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
sbt.internal.DslEntry

‎spark-scripts/project/target/config-classes/$f0391de4e08f05f9d3db.cache

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
sbt.internal.DslEntry

‎spark-scripts/project/target/scala-2.12/sbt-1.0/update/update_cache_2.12/inputs

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
1274142829

‎spark-scripts/project/target/scala-2.12/sbt-1.0/update/update_cache_2.12/output

+1
Large diffs are not rendered by default.

‎spark-scripts/project/target/streams/_global/_global/_global/streams/out

Whitespace-only changes.

‎spark-scripts/project/target/streams/_global/csrConfiguration/_global/streams/out

Whitespace-only changes.

‎spark-scripts/project/target/streams/_global/csrProject/_global/streams/out

Whitespace-only changes.

‎spark-scripts/project/target/streams/_global/dependencyPositions/_global/streams/update_cache_2.12/input_dsp

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
-1413115869

‎spark-scripts/project/target/streams/_global/dependencyPositions/_global/streams/update_cache_2.12/output_dsp

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
{"{\"organization\":\"org.scala-lang\",\"name\":\"scala-library\",\"revision\":\"2.12.10\",\"configurations\":\"provided\",\"isChanging\":false,\"isTransitive\":true,\"isForce\":false,\"explicitArtifacts\":[],\"inclusions\":[],\"exclusions\":[],\"extraAttributes\":{},\"crossVersion\":{\"type\":\"Disabled\"}}":{"value":{"$fields":["path","startLine"],"path":"(sbt.Classpaths.jvmBaseSettings) Defaults.scala","startLine":2531},"type":"LinePosition"}}

‎spark-scripts/project/target/streams/_global/ivyConfiguration/_global/streams/out

Whitespace-only changes.

‎spark-scripts/project/target/streams/_global/ivySbt/_global/streams/out

Whitespace-only changes.

‎spark-scripts/project/target/streams/_global/moduleSettings/_global/streams/out

Whitespace-only changes.

‎spark-scripts/project/target/streams/_global/projectDescriptors/_global/streams/out

Whitespace-only changes.

‎spark-scripts/project/target/streams/_global/scalaCompilerBridgeScope/_global/streams/out

Whitespace-only changes.

‎spark-scripts/project/target/streams/_global/update/_global/streams/out

+3
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
[debug] "not up to date. inChanged = true, force = false
2+
[debug] Updating ProjectRef(uri("file:/home/ubuntu/projects/java-podcast-processor/spark-scripts/project/"), "spark-scripts-build")...
3+
[debug] Done updating ProjectRef(uri("file:/home/ubuntu/projects/java-podcast-processor/spark-scripts/project/"), "spark-scripts-build")

‎spark-scripts/project/target/streams/compile/_global/_global/compileBinaryFileInputs/previous

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
["sbt.Task[scala.collection.immutable.Map[java.lang.String, scala.collection.Seq[scala.Tuple2[java.nio.file.Path, sbt.nio.FileStamp]]]]",{"2.12.10":{"hashes":[],"lastModifiedTimes":[["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/sbt/1.3.13/sbt-1.3.13.jar",1593293415000],["/home/ubuntu/.sbt/boot/scala-2.12.10/lib/scala-library.jar",1568150453000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/main_2.12/1.3.13/main_2.12-1.3.13.jar",1593293340000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/io_2.12/1.3.4/io_2.12-1.3.4.jar",1585597895000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/logic_2.12/1.3.13/logic_2.12-1.3.13.jar",1593293362000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/actions_2.12/1.3.13/actions_2.12-1.3.13.jar",1593293326000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/main-settings_2.12/1.3.13/main-settings_2.12-1.3.13.jar",1593293375000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/run_2.12/1.3.13/run_2.12-1.3.13.jar",1593293390000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/command_2.12/1.3.13/command_2.12-1.3.13.jar",1593293416000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/collections_2.12/1.3.13/collections_2.12-1.3.13.jar",1593293339000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/scripted-sbt-redux_2.12/1.3.13/scripted-sbt-redux_2.12-1.3.13.jar",1593293376000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/scripted-plugin_2.12/1.3.13/scripted-plugin_2.12-1.3.13.jar",1593293410000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/zinc-lm-integration_2.12/1.3.13/zinc-lm-integration_2.12-1.3.13.jar",1593293351000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-lang/modules/scala-xml_2.12/1.3.0/scala-xml_2.12-1.3.0.jar",1584381632000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/launcher-interface/1.1.4/launcher-interface-1.1.4.jar",1590640694000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/logging/log4j/log4j-api/2.11.2/log4j-api-2.11.2.jar",1549415503000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/logging/log4j/log4j-core/2.11.2/log4j-core-2.11.2.jar",1549415573000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/apache/logging/log4j/log4j-slf4j-impl/2.11.2/log4j-slf4j-impl-2.11.2.jar",1549415635000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/github/cb372/scalacache-caffeine_2.12/0.20.0/scalacache-caffeine_2.12-0.20.0.jar",1510153827000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/io/get-coursier/lm-coursier-shaded_2.12/2.0.0-RC6-4/lm-coursier-shaded_2.12-2.0.0-RC6-4.jar",1588768515000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/util-logging_2.12/1.3.3/util-logging_2.12-1.3.3.jar",1576119989000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/librarymanagement-core_2.12/1.3.4/librarymanagement-core_2.12-1.3.4.jar",1593205275000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/librarymanagement-ivy_2.12/1.3.4/librarymanagement-ivy_2.12-1.3.4.jar",1593205276000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/compiler-interface/1.3.5/compiler-interface-1.3.5.jar",1585527738000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/zinc-compile_2.12/1.3.5/zinc-compile_2.12-1.3.5.jar",1585527746000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/swoval/file-tree-views/2.1.3/file-tree-views-2.1.3.jar",1562617173000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/net/java/dev/jna/jna/5.5.0/jna-5.5.0.jar",1572453456000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/net/java/dev/jna/jna-platform/5.5.0/jna-platform-5.5.0.jar",1572453499000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/util-relation_2.12/1.3.3/util-relation_2.12-1.3.3.jar",1576119995000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/completion_2.12/1.3.13/completion_2.12-1.3.13.jar",1593293377000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/task-system_2.12/1.3.13/task-system_2.12-1.3.13.jar",1593293327000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/tasks_2.12/1.3.13/tasks_2.12-1.3.13.jar",1593293365000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/testing_2.12/1.3.13/testing_2.12-1.3.13.jar",1593293366000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/eed3si9n/sjson-new-scalajson_2.12/0.8.3/sjson-new-scalajson_2.12-0.8.3.jar",1563056822000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/util-tracking_2.12/1.3.3/util-tracking_2.12-1.3.3.jar",1576119981000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/zinc-classpath_2.12/1.3.5/zinc-classpath_2.12-1.3.5.jar",1585527746000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/zinc-apiinfo_2.12/1.3.5/zinc-apiinfo_2.12-1.3.5.jar",1585527734000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/zinc_2.12/1.3.5/zinc_2.12-1.3.5.jar",1585527734000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/core-macros_2.12/1.3.13/core-macros_2.12-1.3.13.jar",1593293351000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/util-cache_2.12/1.3.3/util-cache_2.12-1.3.3.jar",1576119990000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/util-control_2.12/1.3.3/util-control_2.12-1.3.3.jar",1576119992000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/protocol_2.12/1.3.13/protocol_2.12-1.3.13.jar",1593293368000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/eed3si9n/sjson-new-core_2.12/0.8.3/sjson-new-core_2.12-0.8.3.jar",1563056819000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/template-resolver/0.1/template-resolver-0.1.jar",1471834035000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/util-position_2.12/1.3.3/util-position_2.12-1.3.3.jar",1576119996000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/util-scripted_2.12/1.3.3/util-scripted_2.12-1.3.3.jar",1576119985000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/zinc-compile-core_2.12/1.3.5/zinc-compile-core_2.12-1.3.5.jar",1585527731000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/slf4j/slf4j-api/1.7.26/slf4j-api-1.7.26.jar",1550531761000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/github/cb372/scalacache-core_2.12/0.20.0/scalacache-core_2.12-0.20.0.jar",1510153816000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/github/ben-manes/caffeine/caffeine/2.5.6/caffeine-2.5.6.jar",1506124453000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/util-interface/1.3.3/util-interface-1.3.3.jar",1576119983000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/jline/jline/2.14.6/jline-2.14.6.jar",1522055915000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/lmax/disruptor/3.4.2/disruptor-3.4.2.jar",1523227268000],["/home/ubuntu/.sbt/boot/scala-2.12.10/lib/scala-reflect.jar",1568150359000],["/home/ubuntu/.sbt/boot/scala-2.12.10/lib/scala-compiler.jar",1568150551000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/jcraft/jsch/0.1.54/jsch-0.1.54.jar",1472895734000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/eed3si9n/gigahorse-okhttp_2.12/0.5.0/gigahorse-okhttp_2.12-0.5.0.jar",1560903298000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/squareup/okhttp3/okhttp-urlconnection/3.7.0/okhttp-urlconnection-3.7.0.jar",1492307721000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/ivy/ivy/2.3.0-sbt-839fad1cdc07cf6fc81364d74c323867230432ad/ivy-2.3.0-sbt-839fad1cdc07cf6fc81364d74c323867230432ad.jar",1589944567000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.7.0/protobuf-java-3.7.0.jar",1551913597000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/test-agent/1.3.13/test-agent-1.3.13.jar",1593293339000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar",1372459476000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/eed3si9n/shaded-scalajson_2.12/1.0.0-M4/shaded-scalajson_2.12-1.0.0-M4.jar",1499894894000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/spire-math/jawn-parser_2.12/0.10.4/jawn-parser_2.12-0.10.4.jar",1479009615000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/compiler-bridge_2.12/1.3.5/compiler-bridge_2.12-1.3.5.jar",1585527750000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/zinc-classfile_2.12/1.3.5/zinc-classfile_2.12-1.3.5.jar",1585527748000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/zinc-core_2.12/1.3.5/zinc-core_2.12-1.3.5.jar",1585527737000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/zinc-persist_2.12/1.3.5/zinc-persist_2.12-1.3.5.jar",1585527726000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/eed3si9n/sjson-new-murmurhash_2.12/0.8.3/sjson-new-murmurhash_2.12-0.8.3.jar",1563056833000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/ipcsocket/ipcsocket/1.0.1/ipcsocket-1.0.1.jar",1585533820000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-lang/modules/scala-parser-combinators_2.12/1.1.2/scala-parser-combinators_2.12-1.1.2.jar",1554501477000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/eed3si9n/gigahorse-core_2.12/0.5.0/gigahorse-core_2.12-0.5.0.jar",1560903293000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/squareup/okhttp3/okhttp/3.14.2/okhttp-3.14.2.jar",1558287483000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/trueaccord/scalapb/scalapb-runtime_2.12/0.6.0/scalapb-runtime_2.12-0.6.0.jar",1498805900000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/scala-sbt/sbinary_2.12/0.5.0/sbinary_2.12-0.5.0.jar",1535526772000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/typesafe/ssl-config-core_2.12/0.4.0/ssl-config-core_2.12-0.4.0.jar",1556196605000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/org/reactivestreams/reactive-streams/1.0.2/reactive-streams-1.0.2.jar",1513627594000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/squareup/okio/okio/1.17.2/okio-1.17.2.jar",1547754336000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/trueaccord/lenses/lenses_2.12/0.4.12/lenses_2.12-0.4.12.jar",1496557872000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/lihaoyi/fastparse_2.12/0.4.2/fastparse_2.12-0.4.2.jar",1478110998000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/typesafe/config/1.3.3/config-1.3.3.jar",1519222085000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/lihaoyi/fastparse-utils_2.12/0.4.2/fastparse-utils_2.12-0.4.2.jar",1478111016000],["/home/ubuntu/.cache/coursier/v1/https/repo1.maven.org/maven2/com/lihaoyi/sourcecode_2.12/0.1.3/sourcecode_2.12-0.1.3.jar",1477938730000]]}}]

‎spark-scripts/project/target/streams/compile/_global/_global/compileOutputs/previous

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
["sbt.Task[scala.collection.Seq[java.nio.file.Path]]",["/home/ubuntu/projects/java-podcast-processor/spark-scripts/project/target/streams/compile/compileOutputs/_global/streams/inc_compile_2.12.zip"]]

‎spark-scripts/project/target/streams/compile/_global/_global/compileSourceFileInputs/previous

+1
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
["sbt.Task[scala.collection.immutable.Map[java.lang.String, scala.collection.Seq[scala.Tuple2[java.nio.file.Path, sbt.nio.FileStamp]]]]",{"2.12.10":{"hashes":[],"lastModifiedTimes":[]}}]

0 commit comments

Comments
 (0)