Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optional IngestionJob parameters passed by Spark Launcher #1130

Merged
merged 22 commits into from
Nov 4, 2020
Merged

Optional IngestionJob parameters passed by Spark Launcher #1130

Changes from 1 commit
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
6c7a404
optional job parameters
pyalex Nov 4, 2020
15b750b
default values
pyalex Nov 4, 2020
ba1481e
default values
pyalex Nov 4, 2020
5c2e162
add job service to docker compose
pyalex Nov 4, 2020
f93289b
remove jobcontroller from makefile
pyalex Nov 4, 2020
6ef85a7
pass project to job
pyalex Nov 4, 2020
ecb1337
helm update: jobservice secrets
pyalex Nov 4, 2020
3f00e19
run feast cli directly
pyalex Nov 4, 2020
a87e4ce
fix jobservice host name
pyalex Nov 4, 2020
e26a167
statsd enabled
pyalex Nov 4, 2020
e0d3e54
shared directory
pyalex Nov 4, 2020
4ca5beb
override staging path in local env
pyalex Nov 4, 2020
3aa6e03
override staging path in local env
pyalex Nov 4, 2020
b6d20b3
debug
pyalex Nov 4, 2020
ef24730
use root
pyalex Nov 4, 2020
2f694ee
cleanup
pyalex Nov 4, 2020
d985845
ingestion & jobcontroller module deleted from pom
pyalex Nov 4, 2020
a6a1894
ingestion & jobcontroller module deleted from pom
pyalex Nov 4, 2020
fe14419
--with-job-service
pyalex Nov 4, 2020
a375d8e
make feast_jobservice fixture scope - session
pyalex Nov 4, 2020
934e359
local jar path
pyalex Nov 4, 2020
e5903d0
stage only local files
pyalex Nov 4, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
use root 
Signed-off-by: Oleksii Moskalenko <moskalenko.alexey@gmail.com>
  • Loading branch information
@pyalex
pyalex committed Nov 4, 2020
commit ef247307305da1bbab6f63c958f1da75e649ecd8
3 changes: 2 additions & 1 deletion infra/scripts/test-docker-compose.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,5 +69,6 @@ docker exec \
-e FEAST_VERSION=${FEAST_VERSION} \
-e DISABLE_SERVICE_FIXTURES=true \
-e DISABLE_FEAST_SERVICE_FIXTURES=true \
--user root \
feast_jupyter_1 bash \
-c 'cd /feast/tests && ls -la /shared && python -m pip install -r requirements.txt && pytest e2e/ -m "not bq" --ingestion-jar https://storage.googleapis.com/feast-jobs/spark/ingestion/feast-ingestion-spark-${FEAST_VERSION}.jar --redis-url redis:6379 --core-url core:6565 --serving-url online_serving:6566 --job-service-url jobservice:6568 --staging-path file:///shared/staging/ --kafka-brokers kafka:9092'
-c 'cd /feast/tests && python -m pip install -r requirements.txt && pytest e2e/ --ingestion-jar https://storage.googleapis.com/feast-jobs/spark/ingestion/feast-ingestion-spark-${FEAST_VERSION}.jar --redis-url redis:6379 --core-url core:6565 --serving-url online_serving:6566 --job-service-url jobservice:6568 --staging-path file:///shared/staging/ --kafka-brokers kafka:9092'