Skip to content

Latest commit

 

History

History

etl

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 

dis-utilities:sync

ETL programs for DIS system

Name Description
fix_jrc_author.py Add jrc_author field to DOIs that don't have it
fix_middle_names.py Expand given names in the orcid collection

Setup

First, create a Python virtual environment:

cd sync/bin
python3 -m venv my_venv

Enter the virtual environment and install necessary libraries:

source my_venv/bin/activate
my_venv/bin/pip install -r requirements.txt

Programs can now be run in the virtual environment:

cd ../../etl/bin
my_venv/bin/python3 fix_middle_names.py --verbose

Dependencies

  1. The libraries specified in requirements.txt need to be installed.
  2. The Configuration system must be accessible. The following configurations are used:
    • databases