From: Steve L. (JIRA) <ji...@sm...> - 2009-05-28 11:13:02
|
[ http://jira.smartfrog.org/jira/browse/SFOS-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=11686#action_11686 ] Steve Loughran commented on SFOS-1208: -------------------------------------- commented out the fs.close in ExtJobTracker.close(): that is not the problem. > filesystem is closed in tasktracker in Job submission tests > ----------------------------------------------------------- > > Key: SFOS-1208 > URL: http://jira.smartfrog.org/jira/browse/SFOS-1208 > Project: SmartFrog > Issue Type: Bug > Components: _service_hadoop > Affects Versions: 3.17.x > Reporter: Steve Loughran > Assignee: Steve Loughran > > [sf-startdaemon-debug] 09/05/27 17:58:33 [pool-1-thread-1] ERROR mapred.JobHistory : Failed creating job history log file, disabling history > [sf-startdaemon-debug] java.io.IOException: Filesystem closed > [sf-startdaemon-debug] at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:198) > [sf-startdaemon-debug] at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:429) > [sf-startdaemon-debug] at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:206) > [sf-startdaemon-debug] at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:529) > [sf-startdaemon-debug] at org.apache.hadoop.mapred.JobHistory$JobInfo.logSubmitted(JobHistory.java:904) > [sf-startdaemon-debug] at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:387) > [sf-startdaemon-debug] at org.apache.hadoop.mapred.EagerTaskInitializationListener$InitJob.run(EagerTaskInitializationListener.java:81) > [sf-startdaemon-debug] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885) > [sf-startdaemon-debug] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) > [sf-startdaemon-debug] at java.lang.Thread.run(Thread.java:637) > [sf-startdaemon-debug] 09/05/27 17:58:33 [pool-1-thread-1] ERROR mapred.JobHistory : Failed to store job conf on the local filesystem > [sf-startdaemon-debug] java.io.IOException: Filesystem closed > [sf-startdaemon-debug] at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:198) > [sf-startdaemon-debug] at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:545) > [sf-startdaemon-debug] at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:488) > [sf-startdaemon-debug] at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:674) > [sf-startdaemon-debug] at org.apache.hadoop.mapred.JobHistory$JobInfo.logSubmitted(JobHistory.java:985) > [sf-startdaemon-debug] at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:387) > [sf-startdaemon-debug] at org.apache.hadoop.mapred.EagerTaskInitializationListener$InitJob.run(EagerTaskInitializationListener.java:81) > [sf-startdaemon-debug] at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885) > [sf-startdaemon-debug] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) > [sf-startdaemon-debug] at java.lang.Thread.run(Thread.java:637) > [sf-startdaemon-debug] 09/05/27 17:58:33 [pool-1-thread-1] INFO mapred.JobInProgress : Input size for job job_200905271758_0001 = 75. Number of splits = 1 > [sf-startdaemon-debug] 09/05/27 17:58:33 [pool-1-thread-1] INFO map -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://jira.smartfrog.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira |