/
Newspaper-prompt-doms-ingester - Release 1.8

Newspaper-prompt-doms-ingester - Release 1.8

This an autonomous component responsible for ingesting the metadata from a newly-uploaded batch-run into DOMS tree-structure, as described here.

The release is downloadable at https://sbforge.org/nexus/service/local/repositories/releases/content/dk/statsbiblioteket/newspaper/newspaper-prompt-doms-ingester/1.8/newspaper-prompt-doms-ingester-1.8-package.tar.gz

On unpacking the tar-archive, the release is structured as

 

newspaper-prompt-doms-ingester-1.8
├── bin
│   └── start_prompt_ingest_component.sh
├── conf
│   ├── config.properties
│   └── logback.xml
└── lib
    ├── authchecker-authutils-1.0.1.jar
    ├── autonomous-component-2.6.jar
    ├── batch-iterator-2.6.jar
(etc.)

 

 

The file start_prompt_ingest_component.sh can be used as a sample of how the component can be started from a cron-job.

As with all autonomous components, the component takes a single command-line argument which is the path to a properties file containing the configuration. The Newspaper-prompt-doms-ingester uses only the common properties for autonomous components. In addition, there should be a logback configuration file present on the classpath or configured as a system property.

The following properties should be set to values specific for this component:

 

iterator.useFileSystem=true
autonomous.pastSuccessfulEvents=Data_Received
doms.update.retries=2

 

Changelog

https://raw.githubusercontent.com/statsbiblioteket/newspaper-prompt-doms-ingester/newspaper-prompt-doms-ingester-1.8/CHANGELOG.md