Forum:Grub: Bandwith not used

It seems Grub is not using the Bandwith wich is availible. As example i have an 3Mbit Connection but the Gub client uses only 400 to 800n kbits. But Grub seems to need much upstream to upload the crawl results to the server but i only have 300kbit Upstream, perhaps the crawler uses not the full Downstream because there are not enough capacities to upload the results.

Perhaps it would be better to compress the crawled Data before it is uploaded to the server, this would make clients running on Asynchron internet connections more effective. As example the Majestic12 crawler uses an text based compression wich compresses the crawl results up to 90% before they are uploaded.