Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Next »

Agenda for the joint NetarchiveSuite tele-conference 2022-12-06, 13:00-14:00.

Participants

  • BNF:  Auriane, Sara
  • ONB: Andreas
  • KB/DK - Copenhagen: Anders, Thomas, Stephen , Tue
  • KB/DK - Aarhus: Colin
  • BNE: -
  • KB/Sweden: Peter, Pär, Jonas

Update on NAS latest tests and developments


Status of the production sites

Netarkivet

  • Broad crawl
    • 4th broadcrawl step 2 - 2022 started a few weeks ago. More than 100 harvesters used concurrently (120 harvester capacity, 77 broadcrawlers)
    • Also working on other part of the broadcrawl with selective harvesters.
    • Bytelimit downgraded 61K shops to 10K maxobjects and 499MB maxbyte
  • Event harvest
    • General election still running but will end soon
    • World Championship Soccer in Quatar- needs more seeds and then to be ended

  • IIPC WAC 2023
    • 4 proposals approved: 

      SolrWayback: Best practice, community usage and engagement 

      Run your own full stack SolrWayback 

      Browser-Based Crawling For All: Getting Started with Browsertrix Cloud 

      Browser-Based Crawling For All: The Story So Far 


  •  JWAT for validation of Warc-files updated - there might be some more work on documentation.

  • Browserbased crawling for all IIPC-project proceeding. UX update will come soon with enhancements of exclusions and also using more explanations for each step/input.


BnF


ONB


BNE


KB-Sweden


Next meetings

  • January 10th, 2023

Any other business?


  • No labels