2018-11-06 Statusmeeting

Owned by Sara Aubry
Last updated: Nov 06, 2018 by Andreas P

Agenda for the joint NetarchiveSuite tele-conference 2018-11-06, 13:00-14:00.

Participants

  • BNF: Sara, Géraldine
  • ONB: Andreas, Michaela
  • KB/DK - Copenhagen: Tue, Stephen, Anders
  • KB/DK - Aarhus: Colin, Sabine
  • BNE: Mar
  • KB/Sweden: Bengt

Update on NAS latest tests and developments

The Release Test for NetarchiveSuite 5.5 is under way and expected to be finished this week, followed by a formal release as soon as possible after that. See NetarchiveSuite 5.5 Release Notes for more details about the content of the release.

We are beginning a new development phase concentrating on updating our backend storage and processing architecture. We are moving to http://bitrepository.org software and also investigating a more modern mass-processing platform - for example index-generation via hadoop instead of our own NAS batch framework. For this reason we will be surveying our NAS partners to find out which parts of the NAS package are actually in use in different institutions. 

Preparation of 2019 NAS workshop

2019 NAS workshop

Status of the production sites

Netarkivet

We launched step 2 of our 3rd broad crawl this year (with a limit of 14GB per domain) on 2018/10/23

We looked at all our open issues and grouped them thematically:

  • Harvesting problems
  • Replay problems
  • Improving existing functionalities
  • New functionalities
  • Automatization of operations, which are solved manually at the moment
  • Will be solved  by existing projects

The aim was to find the most urgent problems, which we cannot solve without developers help

 

We are working on the implementation of SOLR wayback to search in Netarchive. By now SOLR Wayback still is a protoype. Amongst others we need to clarify  UX, security questions, how to do the logging and to chose a platform for the user access.

But the display of the results is much better than Blacklight

We are working on a procedure for a new type of usage from the archive: data extraction for research project from the archive. The data to be extracted are determined by a search string – hopefully this would be rather easy with SOLR-wayback

We are going to prepare a mini-event harvest “Week 46”. In week 46 the Royal Library collects local broadcast stations’ (both radio and television) productions. For a couple of years ago Netarchive started collecting there home pages.

 

BnF


ONB

  • We are still running our domain crawl for this year and we are in the last quarter of the crawl. We are expecting the end in a few weeks.

BNE


KB-Sweden


Next meetings

  • December 4th
  • January 8th 2019

Any other business?