“Inktomi and the NEC Research Institute, Inc. have completed a new study that verifies the Web has grown to more than one billion unique pages. This milestone for the Internet comes as an outgrowth of Inktomi’s global Web crawling operations, and the new expanded database represents the industry’s largest catalog of unique Web pages. Read the press release. Inktomi has been crawling the Web over the past 4 months using a 100 MB/sec ethernet connection to build the WebMap database. All URLs in this database have the host names canonicalized. We also analyze certain properties of each page: for example rich media files, pornographic content, and search-engine spoofing.”