HarvestMan version 1.0 
Author Message
 HarvestMan version 1.0

HarvestMan is an world wide web crawler(robot) program written in
python
using urllib2, httplib, and HTMLParser. It is a re-write of the
earlier 'PIDER'(Program for Internet Data Extraction and Retrieval)
program.

This release 1.0 features the following.

1. A much-improved 'fast-mode' for download using multiple threads.
2. Many options in the config file for tweaking download.
3. Control by Depth-of-url checking.
4. A brower page for browsing finished projects.
5. A default configuration suitable to download online manuals/
   tutorials/books/html presentations.
6. Many bug fixes.

The project page is situated at
http://www.*-*-*.com/

Thanks for your kind support and attention.

Regards,

Anand Pillai



Sun, 27 Nov 2005 01:07:58 GMT  
 
 [ 1 post ] 

 Relevant Pages 

1. ANNOUNCE: mkWidgets 1.3, mkHttpd 1.0, mkTulip 1.0, mkZiplib 1.0, mkGeneric 1.3

2. Want APL2 for Windows Version 1.0?

3. TryAPL2 for free, Version 1.0

4. load a 1.0 version Boss file in an image 2.0

5. ANNOUNCE: CodeMagicCD Version 1.0

6. ANNOUNCING: TA/CSS version 1.0

7. ANNOUNCE: CodeMagicCD Version 1.0

8. ST/V Version 1.0

9. CapeSoft File Explorer Version 1.0 Gold Shipped.

10. Forth OnLine Resource/Technical Help Letter (version 1.0)

11. Answers to Frequently Asked Questions (version 1.0)

12. Forth OnLine Resource/Technical Help Letter (version 1.0)

 

 
Powered by phpBB® Forum Software