Task 12191138

Name	hadam3p_pnw_z1my_1969_1_006913442_0
Workunit	7116758
Created	21 Nov 2010, 12:46:56 UTC
Sent	12 Apr 2011, 21:30:13 UTC
Report deadline	25 Mar 2012, 2:50:13 UTC
Received	23 Apr 2011, 4:47:34 UTC
Server state	Over
Outcome	No reply
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1081512
Run time
CPU time	3 days 6 hours 29 min 50 sec
Validate state	Invalid
Credit	2,255.04
Device peak FLOPS	3.40 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.4.5</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4752, selfPID=4752, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4752, selfPID=20040, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18040, selfPID=18040, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18040, selfPID=13456, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24776, selfPID=24776, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24776, selfPID=15640, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15212, selfPID=20356, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15212, selfPID=15212, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18924, selfPID=13052, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18924, selfPID=18924, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14780, selfPID=14780, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5920, selfPID=24444, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5920, selfPID=5920, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17460, selfPID=13956, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17460, selfPID=17460, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23232, selfPID=23232, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23232, selfPID=12692, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24468, selfPID=23620, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24468, selfPID=24468, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14156, selfPID=14868, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14156, selfPID=14156, iMonCtr=1 14:48:29 (22824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:48:30 (22824): No heartbeat from core client for 30 sec - exiting 14:48:31 (22824): No heartbeat from core client for 30 sec - exiting 14:48:32 (22824): No heartbeat from core client for 30 sec - exiting 14:48:33 (22824): No heartbeat from core client for 30 sec - exiting 14:48:34 (22824): No heartbeat from core client for 30 sec - exiting 14:48:35 (22824): No heartbeat from core client for 30 sec - exiting 14:48:36 (22824): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10372, selfPID=10372, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10372, selfPID=16440, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11860, selfPID=21848, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11860, selfPID=11860, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20732, selfPID=20732, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20732, selfPID=22220, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20292, selfPID=20292, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20292, selfPID=14928, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=23916, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14216, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5952, selfPID=5472, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5952, selfPID=5952, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3516, selfPID=3516, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3516, selfPID=4344, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5300, selfPID=3660, iMonCtr=1 Model crash detected, will try to restart... 22:29:02 (3804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:03 (3804): No heartbeat from core client for 30 sec - exiting 22:29:04 (3804): No heartbeat from core client for 30 sec - exiting 22:29:05 (3804): No heartbeat from core client for 30 sec - exiting 22:29:06 (3804): No heartbeat from core client for 30 sec - exiting 22:29:07 (3804): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3036, selfPID=3036, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3664, selfPID=3664, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3664, selfPID=1196, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8388, selfPID=8388, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8888, selfPID=8888, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8888, selfPID=7244, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2892, selfPID=2892, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2892, selfPID=7072, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8308, selfPID=8308, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8308, selfPID=8940, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3776, selfPID=3776, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3776, selfPID=8512, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7084, selfPID=7084, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7084, selfPID=7316, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6944, selfPID=6944, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6944, selfPID=3668, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8036, selfPID=8036, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8036, selfPID=7160, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7164, selfPID=7164, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7164, selfPID=8944, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5324, selfPID=5324, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5324, selfPID=7304, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5308, selfPID=5308, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5308, selfPID=6020, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7724, selfPID=7724, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7724, selfPID=6172, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6748, selfPID=6748, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6748, selfPID=8736, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7468, selfPID=7468, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7468, selfPID=6864, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6264, selfPID=6264, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6264, selfPID=1452, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1376, selfPID=1376, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1376, selfPID=1368, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8600, selfPID=5896, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8600, selfPID=8600, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6572, selfPID=6572, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6572, selfPID=7160, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7624, selfPID=7624, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7624, selfPID=4736, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1684, selfPID=1684, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1684, selfPID=7748, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4684, selfPID=4684, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4684, selfPID=2196, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5560, selfPID=5560, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5560, selfPID=1316, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6356, selfPID=6356, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6356, selfPID=5776, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1124, selfPID=6208, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1124, selfPID=1124, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5484, selfPID=8512, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5484, selfPID=5484, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8844, selfPID=5756, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8844, selfPID=8844, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8608, selfPID=8936, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8608, selfPID=8608, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7888, selfPID=7888, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7888, selfPID=7036, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4144, iMonCtr=2 Model crash detected, will try to restart... 21:22:24 (3600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:29 (3600): No heartbeat from core client for 30 sec - exiting 21:22:30 (3600): No heartbeat from core client for 30 sec - exiting 21:22:31 (3600): No heartbeat from core client for 30 sec - exiting 21:22:32 (3600): No heartbeat from core client for 30 sec - exiting 21:22:33 (3600): No heartbeat from core client for 30 sec - exiting 21:22:34 (3600): No heartbeat from core client for 30 sec - exiting 21:22:35 (3600): No heartbeat from core client for 30 sec - exiting 21:22:36 (3600): No heartbeat from core client for 30 sec - exiting 21:22:37 (3600): No heartbeat from core client for 30 sec - exiting 21:22:38 (3600): No heartbeat from core client for 30 sec - exiting 21:22:39 (3600): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5808, selfPID=5432, iMonCtr=1 forrtl: Access is denied. rrtl: Access is denied. forrtl: severe (38): error during write, unit 8, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_pnw_z1my_1969_1_006913442\tmp\xaakg.pipe_dummy Image PC Routine Line Source hadrm3p_pnw_um_6. 0069C52A Unknown Unknown Unknown hadrm3p_pnw_um_6. 00644460 Unknown Unknown Unknown hadrm3p_pnw_um_6. 0064362A Unknown Unknown Unknown hadrm3p_pnw_um_6. 0061A6ED Unknown Unknown Unknown hadrm3p_pnw_um_6. 005C3551 Unknown Unknown Unknown hadrm3p_pnw_um_6. 00369860 Unknown Unknown Unknown hadrm3p_pnw_um_6. 00680893 Unknown Unknown Unknown kernel32.dll 7673ECCB Unknown Unknown Unknown ntdll.dll 772BD80D Unknown Unknown Unknown ntdll.dll 772BDA1F Unknown Unknown Unknown forrtl: severe (38): error during write, unit 8, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_pnw_z1my_1969_1_006913442\tmp\xaakm.pipe_dummy Image PC Routine Line Source hadam3p_pnw_um_6. 00FAA39A Unknown Unknown Unknown hadam3p_pnw_um_6. 00F52CD0 Unknown Unknown Unknown hadam3p_pnw_um_6. 00F51E9A Unknown Unknown Unknown hadam3p_pnw_um_6. 00F2AA9D Unknown Unknown Unknown hadam3p_pnw_um_6. 00ECF27C Unknown Unknown Unknown hadam3p_pnw_um_6. 00C49BD2 Unknown Unknown Unknown hadam3p_pnw_um_6. 00F8E638 Unknown Unknown Unknown kernel32.dll 7673ECCB Unknown Unknown Unknown ntdll.dll 772BD80D Unknown Unknown Unknown ntdll.dll 772BDA1F Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5044, selfPID=5196, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4924, iMonCtr=2 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_z1my_1969_1_006913442_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_z1my_1969_1_006913442_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_z1my_1969_1_006913442_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Apr 2011 04:50:28	1081512	12191138	hadam3p_pnw_z1my_1969_1_006913442_0	103,781	267,018	2.5729
23 Apr 2011 04:50:28	1081512	12191138	hadam3p_pnw_z1my_1969_1_006913442_0	103,776	266,689	2.5699
23 Apr 2011 04:50:28	1081512	12191138	hadam3p_pnw_z1my_1969_1_006913442_0	92,256	235,550	2.5532
23 Apr 2011 04:50:28	1081512	12191138	hadam3p_pnw_z1my_1969_1_006913442_0	80,742	204,441	2.5320
23 Apr 2011 04:50:28	1081512	12191138	hadam3p_pnw_z1my_1969_1_006913442_0	80,736	204,060	2.5275
23 Apr 2011 04:50:28	1081512	12191138	hadam3p_pnw_z1my_1969_1_006913442_0	69,216	170,115	2.4577
23 Apr 2011 04:50:28	1081512	12191138	hadam3p_pnw_z1my_1969_1_006913442_0	57,696	138,052	2.3927
23 Apr 2011 04:50:28	1081512	12191138	hadam3p_pnw_z1my_1969_1_006913442_0	46,176	110,805	2.3996
23 Apr 2011 04:50:28	1081512	12191138	hadam3p_pnw_z1my_1969_1_006913442_0	34,656	83,135	2.3989
23 Apr 2011 04:50:28	1081512	12191138	hadam3p_pnw_z1my_1969_1_006913442_0	23,136	54,988	2.3767
13 Apr 2011 09:19:28	1081512	12191138	hadam3p_pnw_z1my_1969_1_006913442_0	11,616	27,724	2.3867