I'm nearing the completion of a migration of a repository from fedora 2.2.3 to fedora 3.1 and I'm having an infrequent problem. (it's occurred twice in several weeks of testing several fedora instances)
The symptom is that for a period of time, all requests return a "(401) Unauthorized" response. In both cases the situation arose during a process of paging through the results of a search for all items in the repository and exporting each object for indexing by an external service. This may not be what caused the problem, but it's the heaviest test each install has gotten.
Here are all the observations I made from the most recent occurrence of this problem.
1. The period of time where all requests failed, the only thing written in fedora's logs was a bunch of lines consisting of "(Cache) Authenticating user [searchIndexer]"
2. The duration of the problem appeared to be exactly 10 minutes (see log excerpt below)
3. Before and after that period, all requests (using the same credentials, and triggered by the same piece of code) worked properly.
I encountered a similar situation in the migration of the first test server, but it was early in the process, and until now never reoccurred. The observations I have are that, direct access to items in the repository through a browser also failed during that period, and restarting fedora resolved the problem (I was present, and stopped the process and restarted in less than 10 minutes, so I don't know if it would have corrected itself in that case).
In the second repository I migrated (about 100K objects) I did not encounter the error, even though I performed this long-running "export and index" task several times.
Has anyone experienced anything like this, or have any advice?
---- EXCERPT FROM fedora.log ---
INFO 2008-12-11 20:06:56.150 [http-8090-Processor21] (FedoraAccessServlet) Got request: http://localhost:8090/fedora/get/iudl:338702/METADATA
INFO 2008-12-11 20:06:56.172 [http-8090-Processor23] (Cache) Authenticating user [searchIndexer]
10's of thousands of "(Cache) Authenticating user [searchIndexer]"
INFO 2008-12-11 20:16:56.130 [http-9443-Processor24] (Cache) Authenticating user [searchIndexer]
INFO 2008-12-11 20:16:56.151 [http-9443-Processor24] (DefaultManagement) Completed export(pid: iudl:349153, format: info:fedora/fedora-system:FOXML-1.1, exportContext: migrate, encoding: UTF-8)