Re: [Treebase-devel] Treebase Dev problems

[Mattison W. <mat...@ne...>]

The Nagios monitoring system queries treebase-dev every few minutes to
make sure it is up using this query:

http://treebase-dev.nescent.org/treebase-web/search/studySearch.html?query=prism.publicationName=Nature&format=null&recordSchema=null


It might be unrelated, but I saw a fair amount of activity from search
engines in the web server logs.

I can set up a robots.txt file to keep search engines from crawling
the dev and staging sites.

Would it make sense to keep search engines from crawling any sections
of the production site?

-Mattison

On Mon, Nov 14, 2011 at 5:10 PM, William Piel <wil...@ya...> wrote:
>
> Is anyone hitting dev with a lot of queries (e.g. asking for
> publication=="Nature") ?  Or is there anything else in these logs that
> indicates what might be taking down treebasedev ? (please see the attached
> logs)
> Admittedly, it doesn't take much to cause a denial-of-service... But I was
> thinking that it might be in our group, seeing as dev is being hit.
> bp
>
> Begin forwarded message:
>
> From: Mattison Ward <mat...@ne...>
> Date: November 14, 2011 4:12:35 PM EST
> To: William Piel <wil...@ya...>, Harry Shyket
> <har...@ya...>
> Cc: David Palmer <dav...@ne...>
> Subject: Treebase Dev problems
>
> Hi Bill and Harry.
>
> Starting late last night, the treebasedev tomcat process has been
> overloading the server.  I restarted tomcat several times today but
> after a few hours the problem occurred again.  No changes have been
> made to the system recently and I don't see any deployments from
> Hudson recently either.
>
> I have the treebasedev tomcat service shut down now.
>
> I have attached the logs for you to review to see if it looks like an
> application problem.  I can send them in a different format if you
> don't like tgz files.
>
> Regards,
>
> Mattison
>
> ---------- Forwarded message ----------
> From: root <ro...@tr...>
> Date: Mon, Nov 14, 2011 at 4:07 PM
> Subject: treebaselogs
> To: mat...@gm...
>
>
> logs
>
>
>
> --
> Mattison Ward
> NESCent at Duke University
> 2024 W. Main Street, Suite A200
> Durham, NC 27705-4667
> 919-668-4585 (desk)
> 919-668-4551 (alternate)
> 919-668-9198 (fax)
>
>
>
>



-- 
Mattison Ward
NESCent at Duke University
2024 W. Main Street, Suite A200
Durham, NC 27705-4667
919-668-4585 (desk)
919-668-4551 (alternate)
919-668-9198 (fax)