Grub is an exciting new type of software, born for one purpose - to index the ENTIRE Internet. To achive this, Grub will utilize a distributed network, comprised of member machines that volenteer their time to crawling and indexing the Internet. With enough clients, Grub will enable a comprehensive database to be built - and maintained - in real time. The software is currently in pre-Alpha state, but is functional. At this point we are testing the client's ability to build URL databases. Feel free to download and run the software. Check back often for updates. Grub.org is a COMPANY formed for the primary purpose of building this database. We are committed to providing what has been lacking on the Internet since it was born - a complete index of the Web. Go GRUB!
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Maybe the idea of a bandwidth limiting switch. for those users that cannot saturate their bandwidth at all times but would like to be able to help build the Grub database?
something user definable...... like 2K, 4K, 6K, etc.
just an idea
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Yes we will have it so that the client is fully configurable. A switch for the number of sites crawled (and thus bandwidth used) will be incorporated into the client at a later date.
Some of you have been asking about limiting the crawler to
certain sites. The final client should have some type of limiting to the sites that you want to crawl. Not all of you are expected to crawl the porn sites after all.
Keep the questions coming people!
Kord
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Grub is an exciting new type of software, born for one purpose - to index the ENTIRE Internet. To achive this, Grub will utilize a distributed network, comprised of member machines that volenteer their time to crawling and indexing the Internet. With enough clients, Grub will enable a comprehensive database to be built - and maintained - in real time. The software is currently in pre-Alpha state, but is functional. At this point we are testing the client's ability to build URL databases. Feel free to download and run the software. Check back often for updates. Grub.org is a COMPANY formed for the primary purpose of building this database. We are committed to providing what has been lacking on the Internet since it was born - a complete index of the Web. Go GRUB!
Maybe the idea of a bandwidth limiting switch. for those users that cannot saturate their bandwidth at all times but would like to be able to help build the Grub database?
something user definable...... like 2K, 4K, 6K, etc.
just an idea
Rif,
Yes we will have it so that the client is fully configurable. A switch for the number of sites crawled (and thus bandwidth used) will be incorporated into the client at a later date.
Some of you have been asking about limiting the crawler to
certain sites. The final client should have some type of limiting to the sites that you want to crawl. Not all of you are expected to crawl the porn sites after all.
Keep the questions coming people!
Kord