Share

Methabot Web Crawler

Code

Programming Languages: C, JavaScript

License: ISC License

Repositories

browse code, statistics git://methabot.git.sourceforge.net/gitroot/methabot/methabot (read-only)

Show:

What's happening?

  • working with mb-client

    Hello, I'm wondering how to setup mb-clients, specifically how to seed the crawl with a set of urls ? Unfortunately the documentation does not talk about this, only mentions giving urls to mb on command line. Also, it would greatly help if you could provide a production example of a Methanol system that works with masterd, slaved, and clients. The examples found in the documentation are...

    2009-10-18 23:25:55 UTC by celeriis

  • Followup: RE: mn-masterd - failed: no configuration file

    Ok, i found the Problem ;) The Problem was, i haven't set the "config_file" variable in the mn-masterd.conf. The file must looks like: master { user = "d4brain"; group = "d4brain"; listen = "127.0.0.1:5505"; mysql_host = "localhost"; mysql_user = "methanol"; mysql_pass = "hsbc1616";.

    2009-09-25 13:17:35 UTC by d4brain

  • Followup: RE: mn-masterd - failed: no configuration file

    Forgot: **I'am use Methanol 1.7.0 on Debian 5.02 Lenny**.

    2009-09-25 12:53:13 UTC by d4brain

  • mn-masterd - failed: no configuration file

    Hiho, by the way. Very nice Crawler. ;) I've coded some crawler scripts, eg. with Filetypes etc. Works fine. But if i would start the mn-masterd Server. It says: "failed: no configuration file" i've tested it with cmd line: mn-masterd --config /etc/mn-masterd.conf But the same error. mhmm... What i could do ? Here you could see the config and log files...

    2009-09-25 12:42:13 UTC by d4brain

  • Followup: RE: could not find ev.h compiler bug

    It seems like you are missing the package `libev'; use your package manager and install `libev'.

    2009-07-15 14:32:47 UTC by pajlada

  • could not find ev.h compiler bug

    hello, I am trying to configure the methanol sys but am having some trouble. I fixed several issues but now Linux tells me i am missing the ev.h file. Any help would be appreciated!! thanks Pawel ********* MaciejX:~# /tmp/methanol/1.7.0/configure --enable-master checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for...

    2009-07-15 03:57:45 UTC by pppglowacki

Our Numbers