/
2026-06-02 Statusmeeting

2026-06-02 Statusmeeting

Agenda for the joint NetarchiveSuite teleconference 2026-06-02, 13:00-14:00.

Participants

  • BNF:  Sara, Auriane, Anaïs, Leslie

  • ONB: Andreas, Antares

  • KB/DK - Copenhagen: Stephen, Tue, Anders

  • KB/DK - Aarhus: Colin, Lars, Bolette, Halina

  • BNE: José, Miguel, Eva, Alberto

  • KB/Sweden: Peter, Pär, Johan

Update on NAS latest tests and developments

  • Release of NetarchiveSuite 8.2 that adds fixes to CrawlRSS and includes Heritrix version 3.14.1. (latest version date): https://github.com/netarchivesuite/netarchivesuite/releases/tag/netarchivesuite-8.2

  • Team Indsamling (collection team) would like to plan the next release. If there are any fixes from BNF or others, we would like to know so that Team Indsamling can plan to post them before BNF's broad crawl. Team Indsamling have a workshop on Tuesday and therefore cannot participate at the NAS-meeting.

  • Question: Were there Heritrix upgrades and if yes, were there done on IIPC repository?

Status of the production sites

Netarkivet

  • Q2 broadcrawl finished

  • SolrWayback workshop at iPRES - “SolrWayback- Unlocking Archived Web Data with SolrWayback: Deploy, Explore, Collaborate”

  • Browsertrix

  • YouTube experiments

    • Issues with Browsertrix crawling of watch-urls. Ilya is on it

    • Archiveweb.page can crawl and replay videos (but not in solrWayback, Pywb - we know that already).

    • Is our old YouTubeDl-method still blocked by Google?

    • Looking at YouTube crawls over time

      • Milestones/changes

        • Facets: from video to TS/Chunks (when did it happen)

        • Replay (how can videos be found during the years)?

        • Domains?

        • Embedded vs. YouTube-domains

    • We have a government again - som we need to finish our eventcrawls in the coming weeks, including some Social media crawling.

BnF

Our annual selective harvest has just ended. We archived more than 268 million URLs during 6 weeks for a total budget of 20.84 TB.

Our special blog crawl is almost complete. All the queues are finished except for the Centerblogs queue due to blockages. The new system implemented this year - 4 queues opened at the same time, one per blogging platform - is working well and allows us to shorten the crawl duration.

Finally, we have just launched the Pharmacovigilance harvest, produced within the framework of a research project led by Solène Lellinger, lecturer in history and philosophy of health at Paris Cité University. The harvest comprises 146 selections covering the following main areas: pharmacovigilance, pharmacoepidemiology, the public health network (university hospital centers, regional pharmacovigilance centers, etc.), patient associations, professional federations, pharmaceutical companies and research laboratories. The selections were made in collaboration with the various teams participating in the research project.

ONB

 

BNE

Due to issues with the NAS upgrade to version 8.0, we have had to postpone the execution of the broad crawls.

The annual broad crawl of the .gal domain (Galicia) has been completed, covering 4 700 domains and 0.18 TB of data.

We are currently working on launching the .eus domain harvest (Basque Country) and preparing the .es domain harvest, which this year are around 2 100 000 domains.

We are also working on “small events” related to the Pope’s visit to Spain and the total solar eclipse on 12th August.

KB-Sweden

 

Next meetings

  • July 7th

  • September 1st

  • October 6th

  • November 3rd

  • December 1st

  • January 5th 2027

Any other business?

  •