2025-06-03 Statusmeeting

• 2nd Broadcrawl 2025- step 2 ongoing - lot of issues with uplaod and more

• Browsertrix

  • Ingest flow to Netarkivet on the way

• Data delivery of all WARC-files

  • Workshop done

  • Context is important. Was less important 3-4 years ago.

• Outreach and more

  • Anders at Resaw 2025 - The datafied web (no presentations etc. 4-6 june)

  • Reviewing 2 panels, subtitles from IIPC WAC 2025 Oslo. seems really great so far.

  • https://cas.au.dk/arrangementer/artikel/the-web-archives-sources-loss-and-use

    • 1.5 hour presentation and QA on Netarkivet

    • 2 hours workshop on searching with SolrWayback

    • Niels Brügger conclusion on research; The IA-crawl from 1995-1999 contains content for maround 8% of the domains that existed in Denmark at that time (took a lot detective work to find an old domain-list!

  • An invitation to visit and donate content to https://arcticworldarchive.org/ with collaborators

    • https://en.wikipedia.org/wiki/Arctic_World_Archive

    • https://artsandculturalstudies.ku.dk/research/daloss/

Our annual selective harvest ended in mid-May. More than 248 million URLs were archived for nearly 6 weeks for a total budget of 23.92 TB.

We launched our Podcast harvest on May 15th. 12 750 podcasts and more than 650 000 episodes are currently being crawled for an estimated budget of 16 TB. It should last approximately 40 days.

Finally, the preparatory meeting concerning the work on our 2025 broad crawl held last week. We plan to work on several topics:

• update NAS and Heritrix versions

• participate in NAS updating work (Split Browser Bundle Out and Replace Viewerproxy)

• managing redirect deduplication

• testing the JS extractor used by Icelanders to see if it improves the 404 error problem

• blacklists and DNS problems

Two new event collections:

1-DANA 2024: Collection created on the occasion of the floods that occurred on 29 October 2024, as a result of an extreme cold drop (Isolated Depression at High Levels or DANA in spanish) that caused significant material damage and hundreds of deaths in several Regions, the most affected being Valencia.

2-Apagón 2025: On 28 April 2025, a massive blackout left more than 40 million people in Spain without electricity. Madrid evacuated 150.000 metro passengers, and key sectors such as industry and transport were disrupted. Full recovery of supply took up to 14 hours.