Although web crawlers have been around for twenty years by now, there is virtually no freely available, open-source crawling software that guarantees high throughput, overcomes the limits of single-machine tools and at the same time scales linearly with the amount of resources available. This paper aims at filling this gap.
BUbiNG: Massive crawling for the masses / Boldi, Paolo; Marino, Andrea; Santini, Massimo; Vigna, Sebastiano. - ELETTRONICO. - (2014), pp. 227-228. (Intervento presentato al convegno 23rd International Conference on World Wide Web, WWW 2014 tenutosi a kor nel 2014) [10.1145/2567948.2577304].
BUbiNG: Massive crawling for the masses
Marino, Andrea;
2014
Abstract
Although web crawlers have been around for twenty years by now, there is virtually no freely available, open-source crawling software that guarantees high throughput, overcomes the limits of single-machine tools and at the same time scales linearly with the amount of resources available. This paper aims at filling this gap.
File in questo prodotto:
Non ci sono file associati a questo prodotto.
I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
