I have just create a database Crawler.
How is it possible to launch it for example every 30 minutes ?
There is an HTTP API for that. You can launch any database crawl by using this
Replace indexname and dbcrawlername with your values.
If you have activated the privileges, you have to add the login and the (api)
If you are on a Unix/Linux environment, you can then add a crontab entry to
automate the job:
*/30 * * * * wget [url]http://localhost:8080/database?use=indexname&name=dbcrawlername[/url]
Thanks Emmanuel for your quickly answer.
I'm on Windows plateform.
If I want to add a scheduler in OSS (like for the web crawler), how can I
start to study this add on ?
We plan to embed Quartz http://www.quartz-scheduler.org.
On windows you may use Wget for Windows, available here http://www.christophe
And then use the task scheduler of Windows to trigger a batch file.
Thanks for your answer.
For my project, it will not possible to use an external scheduler..... no I
don't want to use an external scheduler because I will have 25 index with for
each a Database crawler. So I prefer to have the possibility to launch or stop
the crawler with a web interface.
For information, I just to finish to update the source code in order to add
this crawler. Are you interested for a patch file ?
We are always happy to integrate valuables contributions !
If you want to do that, you can create a related artifact in the new features
tracker and attach your patch.
Log in to post a comment.
Sign up for the SourceForge newsletter:
You seem to have CSS turned off.
Please don't fill out this field.