The primary function of the NetarchiveSuite is to plan, schedule and archive web harvests of parts of the internet using the open source webcrawler Heritrix from Internet Archives.
The NetarchiveSuite is a complete web archiving software package developed from 2004 and onwards. The primary function of the NetarchiveSuite is to plan, schedule and run web harvests of parts of the Internet. It scales to a wide range of tasks, from small, thematic harvests (e.g. related to special events, or special domains) to harvesting and archiving the content of an entire national domain. The software has built-in bit preservation functionality. The systems architecture allows for the software to be distributed among several machines, possibly on more than one geographical location.
See the wiki documentation for further details.
NetarchiveSuite was initially developed by The Royal Danish Library (KB) and The Danish State and University Library (SB) together as part of the National Netarkivet.dk initialtiv. The first release of the platform was in July 2005 and Netarkivet.dk has since used NetarchiveSuite to harvest Danish websites as required by the latest Danish Legal Deposit Act. As of Januar 1st 2017, The Danish State and University Library is now part of The Royal Danish Library NetarchiveSuite was released on July 2007 as Open Source under the LGPL license. The French National Library (BnF) and the Austrian National Libraries (ONB) joined the project in 2008.
See the Quickstart manual for a short guide on how to setup a small standalone system.
See developer wiki.