Welcome, Guest! Log In | Create Account

Donate Share

OpenWebSpider

Older News Items

Project News for OpenWebSpider

  • OpenWebSpider# v0.1.4 Released

    OpenWebSpider now supports MP3s and PDFsCHANGELOG:OpenWebSpiderCS v0.1.4- Mysql/NET Connector upgraded to 5.2.5.0- Enhanced encodings support - New feature: Support to META: "robots" (NOINDEX, NOFOLLOW)- New feature: New configuration file field: crawler_id- New field "crawler_id" in table "hostlist"- New table: crawler_act- New feature: Remote actions over running crawlers [Status, Play, Pause, Kill]- New file support: PDFs [Using PDFBox and IKVM]- New table: pdf- New file support: MP3s [Using UltraID3Lib]- New table: mp3- New feature: new command-line argument: --pdf- New feature: new command-line argument: --mp3http://www.openwebspider.org/

    2009-05-07 08:59:17 UTC by shen139

  • OpenWebSpider# v0.1 Released

    OpenWebSpider has been stopped for a long time… but I’ve decided that’s not the time to make it dead and so I worked hard in the last 3-4 weeks and I released a new version of the crawler written from scratch entirely in C#.
    For more info: http://www.openwebspider.org/

    2008-07-29 22:12:52 UTC by shen139

  • Released OpenWebSpider v0.6.1 Source Code + Win32 Binary

    Files released:
    2006-05-07 11:38 15726 openwebspider-0.6.1\macro\ows_macro.c
    2005-08-19 20:16 533 openwebspider-0.6.1\macro\macro.dsw
    2005-08-19 21:06 4353 openwebspider-0.6.1\macro\macro.dsp
    2006-04-19 04:41 34900 openwebspider-0.6.1\macro\libmysql.lib
    2006-07-02 11:03 3912 openwebspider-0.6.1\modules\mod_pdf\mod_pdf.c
    2006-06-30 10:55 4041 openwebspider-0.6.1\modules\mod_pdf\mod_pdf.vcproj
    2006-06-30 11:04 4253 openwebspider-0.6.1\modules\regexFilter\regexFilter.vcproj
    2005-11-15 17:26 541 openwebspider-0.6.1\modules\regexFilter\regexFilter.dsw
    2005-12-27 13:50 4492 openwebspider-0.6.1\modules\regexFilter\regexFilter.dsp
    2006-06-30 11:00 5399 openwebspider-0.6.1\modules\regexFilter\regexFilter.c
    2006-03-20 20:27 2018 openwebspider-0.6.1\modules\sampleModReplace.c
    2005-12-27 13:34 1670 openwebspider-0.6.1\modules\sampleModFilter.c
    2006-03-20 20:09 1648 openwebspider-0.6.1\modules\modHeader.h
    2005-12-28 21:22 1265 openwebspider-0.6.1\mysql\typelib.h
    2005-12-28 21:22 5841 openwebspider-0.6.1\mysql\raid.h
    2005-12-28 21:22 8076 openwebspider-0.6.1\mysql\m_string.h
    2005-12-28 21:22 19095 openwebspider-0.6.1\mysql\m_ctype.h
    2005-12-28 21:22 35589 openwebspider-0.6.1\mysql\my_sys.h
    2005-12-28 21:22 25154 openwebspider-0.6.1\mysql\my_pthread.h
    2005-12-28 21:22 1515 openwebspider-0.6.1\mysql\my_list.h
    2005-12-28 21:22 41825 openwebspider-0.6.1\mysql\my_global.h
    2005-12-28 21:22 3000 openwebspider-0.6.1\mysql\my_getopt.h
    2005-12-28 21:22 3678 openwebspider-0.6.1\mysql\my_dbug.h
    2005-12-28 21:22 1859 openwebspider-0.6.1\mysql\my_alloc.h
    2005-12-28 21:22 790 openwebspider-0.6.1\mysql\mysql_version.h
    2005-12-28 21:22 2184 openwebspider-0.6.1\mysql\mysql_time.h
    2005-12-28 21:22 1224 openwebspider-0.6.1\mysql\mysql_embed.h
    2005-12-28 21:22 16766 openwebspider-0.6.1\mysql\mysql_com.h
    2005-12-28 21:22 16114 openwebspider-0.6.1\mysql\mysqld_error.h
    2005-12-28 21:22 16059 openwebspider-0.6.1\mysql\mysqld_ername.h
    2005-12-28 21:22 32725 openwebspider-0.6.1\mysql\mysql.h
    2005-12-28 21:22 2862 openwebspider-0.6.1\mysql\libmysql.def
    2005-12-28 21:22 3876 openwebspider-0.6.1\mysql\errmsg.h
    2005-12-28 21:22 12923 openwebspider-0.6.1\mysql\config-win.h
    2005-12-28 21:22 22387 openwebspider-0.6.1\mysql\config-os2.h
    2005-12-28 21:22 3607 openwebspider-0.6.1\mysql\config-netware.h
    2006-05-07 14:11 572 openwebspider-0.6.1\PHP\vars.php
    2006-05-07 12:49 4808 openwebspider-0.6.1\PHP\searchfunct.php
    2005-11-30 19:53 887 openwebspider-0.6.1\PHP\search.php
    2005-11-30 19:56 1325 openwebspider-0.6.1\PHP\cache.php
    2006-06-30 11:04 6656 openwebspider-0.6.1\Win32_bin\modules\regexFilter.dll
    2006-02-08 13:42 536576 openwebspider-0.6.1\Win32_bin\modules\pdftotext.exe
    2006-06-30 10:55 7680 openwebspider-0.6.1\Win32_bin\modules\mod_pdf.dll
    2006-05-07 14:03 45056 openwebspider-0.6.1\Win32_bin\ows_macro.v0.2.win32.exe
    2006-06-30 10:46 94208 openwebspider-0.6.1\Win32_bin\openwebspider.v0.6.1.win32.exe
    2006-05-07 14:07 658 openwebspider-0.6.1\Win32_bin\openwebspider.conf
    2006-04-19 04:41 34900 openwebspider-0.6.1\Win32_bin\libmysql.lib
    2006-04-19 04:41 1449984 openwebspider-0.6.1\Win32_bin\libmysql.dll
    2006-07-02 11:18 967 openwebspider-0.6.1\Makefile
    2006-07-02 11:16 668 openwebspider-0.6.1\openwebspider.conf
    2006-07-02 10:50 237 openwebspider-0.6.1\mod_pdf.conf
    2005-10-30 11:48 303 openwebspider-0.6.1\xmalloc.c
    2006-06-30 10:36 21924 openwebspider-0.6.1\urlfunct.h
    2006-06-30 10:36 11375 openwebspider-0.6.1\thread.h
    2006-04-30 17:40 3750 openwebspider-0.6.1\temptable.h
    2006-06-30 10:36 8256 openwebspider-0.6.1\strfnct.h
    2006-04-30 16:47 6244 openwebspider-0.6.1\sqlfnct.h
    2006-06-30 10:36 3839 openwebspider-0.6.1\socket.h
    2006-03-07 20:36 18975 openwebspider-0.6.1\snprintf.c
    2006-06-30 10:36 18847 openwebspider-0.6.1\server.h
    2006-06-30 10:36 4373 openwebspider-0.6.1\search.h
    2006-06-30 10:36 3427 openwebspider-0.6.1\robots.h
    2005-10-30 11:48 18702 openwebspider-0.6.1\regex.h
    2006-02-10 19:33 161839 openwebspider-0.6.1\regex.c
    2006-02-18 12:52 2303 openwebspider-0.6.1\rank.h
    2006-06-30 10:36 5079 openwebspider-0.6.1\parse_conf.h
    2006-06-30 10:36 11204 openwebspider-0.6.1\options.h
    2006-05-30 09:44 8108 openwebspider-0.6.1\openwebspider.vcproj
    2005-04-09 15:55 541 openwebspider-0.6.1\openwebspider.dsw
    2006-04-30 16:48 6372 openwebspider-0.6.1\openwebspider.dsp
    2006-06-30 10:44 12941 openwebspider-0.6.1\openwebspider-0.6.c
    2006-02-11 14:02 2979 openwebspider-0.6.1\mymutex.h
    2006-01-11 20:03 317 openwebspider-0.6.1\mod_regex.conf
    2006-06-30 10:36 3940 openwebspider-0.6.1\modules.h
    2006-06-30 10:36 12079 openwebspider-0.6.1\misc.h
    2006-04-30 16:50 3475 openwebspider-0.6.1\macro.h
    2006-06-30 10:36 4690 openwebspider-0.6.1\list.h
    2005-01-13 09:46 33890 openwebspider-0.6.1\libmysql.lib
    2006-06-30 10:36 14400 openwebspider-0.6.1\indexer.h
    2006-06-30 10:36 10742 openwebspider-0.6.1\htmlfnct.h
    2005-12-18 16:05 3465 openwebspider-0.6.1\hstlist.h
    2005-10-30 11:48 6663 openwebspider-0.6.1\getopt.h
    2005-10-30 11:48 40239 openwebspider-0.6.1\getopt.c
    2006-06-30 10:36 7508 openwebspider-0.6.1\functions.h
    2006-06-30 11:08 3628 openwebspider-0.6.1\Changelog.txt
    2005-10-30 11:48 5327 openwebspider-0.6.1\alloca.c
    #
    # Total Size Files
    # 3028826 86

    2006-07-02 09:53:39 UTC by shen139

  • Released OpenWebSpider v0.6 Source Code + Win32 Binary

    File released:
    openwebspider-0.6\alloca.c 5327
    openwebspider-0.6\functions.h 7192
    openwebspider-0.6\getopt.c 40239
    openwebspider-0.6\getopt.h 6663
    openwebspider-0.6\hstlist.h 3465
    openwebspider-0.6\htmlfnct.h 10126
    openwebspider-0.6\indexer.h 13394
    openwebspider-0.6\list.h 4247
    openwebspider-0.6\macro\libmysql.lib 34900
    openwebspider-0.6\macro\macro.dsp 4353
    openwebspider-0.6\macro\macro.dsw 533
    openwebspider-0.6\macro\ows_macro.c 15726
    openwebspider-0.6\macro.h 3475
    openwebspider-0.6\Makefile 765
    openwebspider-0.6\misc.h 11566
    openwebspider-0.6\modules\modHeader.h 1648
    openwebspider-0.6\modules\regexFilter.c 5359
    openwebspider-0.6\modules\regexFilter.dsp 4492
    openwebspider-0.6\modules\regexFilter.dsw 541
    openwebspider-0.6\modules\sampleModFilter.c 1670
    openwebspider-0.6\modules\sampleModReplace.c 2018
    openwebspider-0.6\modules.h 4120
    openwebspider-0.6\mod_regex.conf 317
    openwebspider-0.6\mymutex.h 2979
    openwebspider-0.6\openwebspider-0.6.c 12480
    openwebspider-0.6\openwebspider.conf 658
    openwebspider-0.6\openwebspider.dsp 6372
    openwebspider-0.6\openwebspider.dsw 541
    openwebspider-0.6\options.h 10834
    openwebspider-0.6\parse_conf.h 4827
    openwebspider-0.6\PHP\cache.php 1325
    openwebspider-0.6\PHP\search.php 887
    openwebspider-0.6\PHP\searchfunct.php 4808
    openwebspider-0.6\PHP\vars.php 572
    openwebspider-0.6\rank.h 2303
    openwebspider-0.6\regex.c 161839
    openwebspider-0.6\regex.h 18702
    openwebspider-0.6\robots.h 3256
    openwebspider-0.6\search.h 4288
    openwebspider-0.6\server.h 17994
    openwebspider-0.6\snprintf.c 18975
    openwebspider-0.6\socket.h 3575
    openwebspider-0.6\sqlfnct.h 6244
    openwebspider-0.6\strfnct.h 7929
    openwebspider-0.6\temptable.h 3750
    openwebspider-0.6\thread.h 11151
    openwebspider-0.6\urlfunct.h 20726
    openwebspider-0.6\Win32_bin\libmysql.dll 1449984
    openwebspider-0.6\Win32_bin\libmysql.lib 34900
    openwebspider-0.6\Win32_bin\openwebspider.conf 658
    openwebspider-0.6\Win32_bin\openwebspider.v0.6.win32.exe 86016
    openwebspider-0.6\Win32_bin\ows_macro.v0.2.win32.exe 45056
    openwebspider-0.6\Win32_bin\regexFilter.dll 65536
    openwebspider-0.6\xmalloc.c 303
    openwebspider-0.6\Changelog.txt 3557

    Files Size
    55 2195161

    2006-05-07 12:59:15 UTC by shen139

  • Released OpenWebSpider v0.5.2 Source Code + Win32 Binary

    File released:
    openwebspider-0.5.2\alloca.c 5327
    openwebspider-0.5.2\doc\cache.php.txt 1325
    openwebspider-0.5.2\doc\Changelog.txt 3145
    openwebspider-0.5.2\doc Folder
    openwebspider-0.5.2\functions.h 5937
    openwebspider-0.5.2\getopt.c 40239
    openwebspider-0.5.2\getopt.h 6663
    openwebspider-0.5.2\gui.h 5608
    openwebspider-0.5.2\hstlist.h 3465
    openwebspider-0.5.2\htmlfnct.h 13322
    openwebspider-0.5.2\libmysql.lib 33890
    openwebspider-0.5.2\list.h 1914
    openwebspider-0.5.2\macro Folder
    openwebspider-0.5.2\macro\macro.dsp 4353
    openwebspider-0.5.2\macro\macro.dsw 533
    openwebspider-0.5.2\Win32_bin\macro.exe 45056
    openwebspider-0.5.2\Makefile 765
    openwebspider-0.5.2\misc.h 22691
    openwebspider-0.5.2\mod_regex.conf 317
    openwebspider-0.5.2\modules\modHeader.h 1612
    openwebspider-0.5.2\modules Folder
    openwebspider-0.5.2\modules.h 4120
    openwebspider-0.5.2\mymutex.h 2979
    openwebspider-0.5.2\doc\openwebspider-0.5-handbook.htm 52012
    openwebspider-0.5.2 Folder
    openwebspider-0.5.2\openwebspider-0.5.c 10513
    openwebspider-0.5.2\openwebspider.conf 512
    openwebspider-0.5.2\openwebspider.dsp 6002
    openwebspider-0.5.2\openwebspider.dsw 541
    openwebspider-0.5.2\Win32_bin\openwebspider.exe 65536
    openwebspider-0.5.2\options.h 10059
    openwebspider-0.5.2\macro\ows_macro.c 15260
    openwebspider-0.5.2\rank.h 2302
    openwebspider-0.5.2\regex.c 161839
    openwebspider-0.5.2\regex.h 18702
    openwebspider-0.5.2\modules\regexFilter.c 5133
    openwebspider-0.5.2\modules\regexFilter.def 103
    openwebspider-0.5.2\Win32_bin\regexFilter.dll 65536
    openwebspider-0.5.2\modules\regexFilter.dsp 4492
    openwebspider-0.5.2\modules\regexFilter.dsw 541
    openwebspider-0.5.2\robots.h 3406
    openwebspider-0.5.2\modules\sampleModFilter.c 1670
    openwebspider-0.5.2\doc\search.php.txt 887
    openwebspider-0.5.2\doc\searchfunct.php.txt 4811
    openwebspider-0.5.2\snprintf.c 18954
    openwebspider-0.5.2\socket.h 2915
    openwebspider-0.5.2\sqlfnct.h 2191
    openwebspider-0.5.2\strfnct.h 7608
    openwebspider-0.5.2\temptable.h 3746
    openwebspider-0.5.2\thread.h 9884
    openwebspider-0.5.2\urlfunct.h 14663
    openwebspider-0.5.2\doc\vars.php.txt 573
    openwebspider-0.5.2\Win32_bin Folder
    openwebspider-0.5.2\xmalloc.c 303

    2006-02-11 14:22:53 UTC by shen139