Harvesting digital newspapers at the Bibliothèque nationale de France: All we need is news preservation

Abstract : Acquiring, promoting and giving access to press collections is a major objective for heritage institutions, which need to address the accelerating shift from analogue to digital documentation in order to maintain the continuity of their missions. At the National library of France (Bibliothèque nationale de France or BnF), this mission has mainly been performed in the framework of legal deposit. In 2006, a new law on copyright extended this legal deposit to the internet: its scope covers all kinds of news websites, from digital equivalents of printed newspapers to journalists' blogs and news aggregation portals. During the last ten years, the BnF has experimented two different approaches to ensure the preservation of online news: direct deposit of electronic publications and web harvesting of freely accessible new websites; the latter has been more successful than the former. In order to cover subscription based content, the BnF is experimenting currently a third solution, as a mix of what worked in the two first approaches: web harvesting through agreements with producers. This paper intends to present this third approach, and to explain how the BnF tried to implement it through a dedicated project, the "subscription-based press project". This project launched in late 2012 relies on the possibility of giving the robot a login and a password, in order to let it identify itself as a subscriber. Then, the robot is able to access and copy the protected content. Even though the crawling part was technically the most critical one, this project covered all parts of the documentary lifecycle: from selection to long term preservation, including quality control, cataloguing and access in reading rooms. The paper presents the different steps of the project, its successes and achievements (in terms of collection, technical innovation and human resources), its limits, and considers its future evolutions.
Document type :
Conference papers
Complete list of metadatas

Cited literature [3 references]  Display  Hide  Download

https://hal-bnf.archives-ouvertes.fr/hal-01098523
Contributor : Clément Oury <>
Submitted on : Friday, December 26, 2014 - 12:44:05 PM
Last modification on : Thursday, October 19, 2017 - 2:36:03 PM
Long-term archiving on : Friday, March 27, 2015 - 11:05:50 AM

Files

Oury-IFLA-2014-en.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

  • HAL Id : hal-01098523, version 1

Collections

Citation

Clément Oury. Harvesting digital newspapers at the Bibliothèque nationale de France: All we need is news preservation. IFLA World Library and Information Congress, Aug 2014, Lyon, France. ⟨hal-01098523⟩

Share

Metrics

Record views

294

Files downloads

246