This program downloads data from a variety of CBS databases and performs a conversion to a CSV schema designed for Digitales Archiv.
- Install curl.
- Install cpanminus.
- Install Catmandu. The necessary dependencies are automatically resolved and installed.
- Install the Catmandu MARC importer:
sudo cpanm Catmandu::Importer::MARC
- Install the Catmandu CSV exporter:
sudo cpanm Catmandu::Exporter::CSV
./da_fetch.sh [OPTIONS]
The program accepts the following options:
Option | Description | Default value |
---|---|---|
-f, --file <FILE> |
Specification of the input file with the PPNs. | |
-t, --target <DATABASE> |
Selection of the PICA database. Available options: | owc-de-206 |
- owc-de-206 (ZBW work catalog) |
||
- k10plus (Database 1.1) |
||
- ebooks (Database 1.2) |
||
- nl-monographien (Database 1.50) |
||
- nl-zeitschriften (Database 1.55) |
||
-i, --isil <ISIL> |
Specification of an ISIL. | |
-s, --schema <FORMAT> |
Specification of format. Available options: | marcxml-solr |
- marcxml |
||
- marcxml-solr |
||
-h, --help |
Display of the help menu. |
The records are now being downloaded and converted using Catmandu's ETL engine.
The PPN file will be automatically moved to a distinct directory: archive/ppns
A CSV file records-[FILE].csv
will be created that stores the converted records. The column separator is tab (\t). The file will be moved to archive/records
.
If the mapping has to be adjusted, it is as simple as editing the mapping file da_fetch_mapping.fix
. Use Catmandu's fix language.
- Felix Hemme - Initial work - ZBW
- Luisa Kramer-Ibig - Extensions within the scope of the SAVE project - ZBW
This project is licensed under the MIT License - see the LICENSE file for details.