Versions Compared

Version Old Version 15 New Version 16
Changes made by

Colin Samuel Rosenthal

Colin Samuel Rosenthal

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

 

Table of Contents
outlinetrue

Prerequisites

This test requires restart of infrastructure components (database and jms broker). These steps must be coordinated with the other testers.

Excerpt

Resubmit jobs after restart, restart of failed jobs, upload of old files at harvester restart, scheduler skips old jobs.

 

Info

Under migration from old twiki test, TEST6: Err-1 (Resubmit af jobs efter nedlukning, genstart af fejlede jobs, upload af gamle filer ved høster-genstart, scheduler overspringer gamle jobs). 

...

Install and Start System

On test@kb-prod-udv-001.kb.dk:

 

export TESTX=TEST6
export PORT=807?
export MAILRECEIVERS=foo@bar.dk
stop_test.sh
cleanup_all_test.sh
prepare_test.sh deploy_config_database.xml
install_test.sh
start_test.sh

Check that the GUI is available that the System Status doesn not show any startup problems.

Start a selective harvest

Start a hourly selective harvest for the 'netarkivet.dk' domain.

Create a new template:

...

  • Download the template "default_orderxml

...

  1. Click 'Definition->Edit harvest template' from the left menu.
  2. Select the 'default_orderxml' in the Download dropdown.
  3. Select 'Save to disk'
  4. Press 'Retrieve'

...

  • " 
  • Edit the template so that max-size-bytes

...

  1. Open the downloaded file in a text editor
  2. Change the number 100.000.000 to 5.000.
  3. Save the file 

...

  • is 5000 in the WARCWriterProcessor
  • Upload the template with a new name, for example "Small Warcfiles"

Modify domain templates 

  1. Configure the defaultconfig for  kum.dk to use template 'small_arcfiles_order.xml'.
  2. Configure the  defaultconfig for  dbc.dk to use template 'frontpages'.
  3. Configure the  defaultconfig for  bs.dk to use template 'path_10levels_order.xml'. 

...