...
- BNF: Lam, Géraldine, Sara
- ONB: Michaela, Andreas
- KB/DK: Stephen, Tue
- SB: Sabine, Colin
- BNE: Mar-
- KB/Sweden: Bengt, Stewart-
Upcoming NAS 5.3 Release
Status of developments.
...
Branch BnF (on fork https://github.com/bnfklm/netarchivesuite/)
https://sbforge.org/jirakb-dk.atlassian.net/browse/NAS-2589
Add an H3 extension to enable the addition of RejectRules
https://sbforge.org/jira/kb-dk.atlassian.net/browse/NAS-2588
Add an H3 extension to enable queue budget modification
https://sbforge.org/jirakb-dk.atlassian.net/browse/NAS-2565
Fix orderXMLName and add operator/templateUpdateDate/templateDescription fields in harvestInfo.xml
https://sbforge.org/jirakb-dk.atlassian.net/browse/NAS-2591
Evolutions on the Crawllog page
https://sbforge.org/jira/kb-dk.atlassian.net/browse/NAS-2590
Evolutions on the H3 Frontier page
...
Branch NAS-2592 (on fork https://github.com/bnfklm/netarchivesuite/)
https://sbforge.org/jira/kb-dk.atlassian.net/browse/NAS-2592
Evolutions on H3 Running Job page (History/history/job/ID/)
https://sbforge.org/jirakb-dk.atlassian.net/browse/NAS-2593
Minor label changes in the "Harvest Status" menu
https://sbforge.org/jirakb-dk.atlassian.net/browse/NAS-2594
Evolutions on Running Job X Details (Harveststatus-running-jobdetails.jsp)
...
Branch NAS-2595 (on fork https://github.com/bnfklm/netarchivesuite/)
https://sbforge.org/jira/browse/NAS-2595
Minor evolutions on Running Jobs (Harveststatus-running.jsp)
...
Panel |
---|
We still keep NAS 5.2.2 in our test environment because of an unsolved blocking bug. Meanwhile a bug, which had prevented NAS 5.2 from creating Heritrix jobs. Jobs did not start, selctive crawls were deactivated by the system or the jobs just hung without getting in touch with H3. The bug is solved but meanwhile we had started the fourth broad crawl for 2016 (it ran from Nov. 28 to Dec. 27 2016), so we wait with implementing NAS 5.2.2 in our production system until the beginning of 2017. We are updating our access procedure and our citrix solution. Because of the rather restrictive Danish data protection law we have complicated user group administration and we have problems with one of the groups We still work on the compression of the archive. There is a bug in JWA S, the compression software, when it is solved we will reschedule the compression project. |
...
Panel |
---|
We are still working on our move to NAS 5 and H3 (see above). Our annual broad crawl was completed on December 5th, after 8 weeks. We gathered 90,4TB of data (compressed), which makes this crawl the biggest ever realised at the BnF. The infrastructure was stable and we didn't encounter any technical problems. We will be analysing the data more precisely on two subjects: regional domains and ebooks. |
ONB
Panel | ||||||||
---|---|---|---|---|---|---|---|---|
In the meantime we have a president, so we keep running our presidental elections crawl until our president will start to work. That will be at the end of january. We created a new collection “women/gender” in cooperation with ONB’s women/gender-documentation department. The crawl was done in December. Our next broad crawl will take place in 2017, we still run broad crawls every two years. We will work on a new concept for the webarchive regarding harvesting intervals etc. In Production we had to switch to NAS 5.2.2 due to a bug in the DeduplicateToCDXAdapter (
|
...