2025-12-09 Statusmeeting

• 4th Broadcrawl 2025- finished

• Working on web sites blocking us -should we write a letter to all web site owner?

• New handling of 404 results!:

  Broadcrawl-2025-3 404 total: 256.926.520
  Broadcrawl-2025-4 404 total:  76.754.968

   

  Broadcrawl-3 200 total: 663.739.510
  Broadcrawl-4 200 total: 740.083.671

   

  Broadcrawl--2025-3 -5003 total: 560.158.139
  Broadcrawl--2025-4 -5003 total: 527.073.093

   

  Broadcrawl--2025-3: 88,4TB

  Broadcrawl--2025-4: 76,8TB
  
  

• Event crawl on election: Kommunalvalg 2025 finished

  • Lot of scoail media crawled with Browsertrix: Facebook + Instagram (logged in), TikTok and more

• Browsertrix

  • Looking at performance and transfer issues

  • custom behaviours focus

• Data delivery.

  • WEB CHILD - WARC-files for AU - Two fromer KB employees will work on the project, including SolrWayback-efforts

• Outreach and more

  • IIPC WAC - 2026 Brussels - 2 proposals approved

    • SolrWayback 3 hours workshop

    • 5 min Lightning talk on Climate debate-collection- converted from 15-min presentation

  • https://cst.ku.dk/kalender/sprogteknologisk-konference-2025/Went really well!

    • Panel debate: Trust, design and data in language technology solutions for Danish use

Our broad crawl is still ongoing. The estimates indicate that the budget should reach around 177 TiB of data.

We launched last week the "Social movements" and "Solidarity" harvests, for which the projected budget is 1 and 0.80 TB respectively.

After the tests realized this summer, we launched last week a part of the OpenStreetMap harvest. The rest of the harvest will be launched bit by bit between the end of 2025 and the beginning of 2026.

A new event collection has been created to harvest the elections to the Assembly of Extremadura (western Spain). We are supporting web archivists in the selection of seeds.

On November 13 and 14, the 1st Conference on Legal Deposit Experiences was held with the participation of all ABINIA Ibero-American countries. Each representative presented the current situation regarding legal deposit and legislation in their respective countries. The BNE participated with a practical workshop on web archiving and the tools we use (NAS, CWeb, OW) to encourage the creation and development of web archives. To this end, Tessa from Browsertrix also participated, explaining how their tool works. The conference is available on YouTube: https://www.youtube.com/watch?v=1qOSbcVkvLo (day 1) and https://www.youtube.com/watch?v=e5PKN9XQ0Xw (day 2).