Skip to content

automatic harvest #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Aug 22, 2018
Merged

automatic harvest #4

merged 4 commits into from
Aug 22, 2018

Conversation

rerowep
Copy link
Contributor

@rerowep rerowep commented Aug 22, 2018

For the automatic harvest CELERY and BEAT must be started:

./scripts/worker_beat

rerowep and others added 3 commits August 22, 2018 09:06
Signed-off-by: Peter Weber <Peter.Weber@rero.ch>
Co-authored-by: Bertrand Zuchuat <Bertrand.Zuchuat@rero.ch>
Signed-off-by: Peter Weber <Peter.Weber@rero.ch>
Signed-off-by: Peter Weber <Peter.Weber@rero.ch>
@rerowep rerowep force-pushed the wep-#625-automatic-harvest branch 7 times, most recently from cfe03d9 to 12dbba5 Compare August 22, 2018 11:53
@@ -31,19 +29,3 @@ def create_records(records, verbose=False):
if verbose:
click.echo('record uuid: ' + str(rec.id) + ' | ' + status)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use current_app.logger.info instead.

scripts/setup Outdated
@@ -29,3 +29,8 @@ invenio oaiharvester initconfig data/oaisources.yml
dojson -l marcxml -i data/ebooks.xml do cantookmarc21 | invenio records create_or_update --vendor cantook
# invenio index reindex -t ebook --yes-i-know
# invenio index run

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

to be removed, but where is invenio oaiharvester initconfig?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Was already there:
invenio oaiharvester initconfig data/oaisources.yml

Signed-off-by: Peter Weber <Peter.Weber@rero.ch>
@rerowep rerowep force-pushed the wep-#625-automatic-harvest branch from 12dbba5 to 6dc27d7 Compare August 22, 2018 13:01
@jma
Copy link
Contributor

jma commented Aug 22, 2018

Add scheduler to kubernetes and docker-compose.

@jma jma merged commit b1ea98f into rero:master Aug 22, 2018
@rerowep rerowep deleted the wep-#625-automatic-harvest branch November 26, 2018 07:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants