climateprediction.net home page
Task 15477307

Task 15477307

Name hadcm3n_z8ac_1920_40_008245035_2
Workunit 8400159
Created 14 Dec 2012, 5:13:03 UTC
Sent 14 Dec 2012, 5:16:59 UTC
Report deadline 15 Mar 2013, 12:44:10 UTC
Received 11 Jan 2013, 0:40:30 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1091586
Run time 22 days 21 hours 57 min 31 sec
CPU time 21 days 8 hours 11 min 56 sec
Validate state Invalid
Credit 7,776.00
Device peak FLOPS 1.79 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:32:32 (7148): No heartbeat from core client for 30 sec - exiting
17:32:33 (7148): No heartbeat from core client for 30 sec - exiting
17:32:35 (7148): No heartbeat from core client for 30 sec - exiting
17:32:36 (7148): No heartbeat from core client for 30 sec - exiting
17:32:37 (7148): No heartbeat from core client for 30 sec - exiting
17:32:38 (7148): No heartbeat from core client for 30 sec - exiting
17:32:39 (7148): No heartbeat from core client for 30 sec - exiting
17:32:40 (7148): No heartbeat from core client for 30 sec - exiting
17:32:41 (7148): No heartbeat from core client for 30 sec - exiting
17:32:42 (7148): No heartbeat from core client for 30 sec - exiting
17:32:43 (7148): No heartbeat from core client for 30 sec - exiting
17:32:44 (7148): No heartbeat from core client for 30 sec - exiting
17:32:45 (7148): No heartbeat from core client for 30 sec - exiting
17:32:47 (7148): No heartbeat from core client for 30 sec - exiting
17:32:48 (7148): No heartbeat from core client for 30 sec - exiting
17:32:49 (7148): No heartbeat from core client for 30 sec - exiting
17:32:50 (7148): No heartbeat from core client for 30 sec - exiting
17:32:51 (7148): No heartbeat from core client for 30 sec - exiting
17:32:52 (7148): No heartbeat from core client for 30 sec - exiting
17:32:53 (7148): No heartbeat from core client for 30 sec - exiting
17:32:54 (7148): No heartbeat from core client for 30 sec - exiting
17:32:55 (7148): No heartbeat from core client for 30 sec - exiting
17:32:56 (7148): No heartbeat from core client for 30 sec - exiting
17:32:57 (7148): No heartbeat from core client for 30 sec - exiting
17:32:59 (7148): No heartbeat from core client for 30 sec - exiting
17:33:00 (7148): No heartbeat from core client for 30 sec - exiting
17:33:01 (7148): No heartbeat from core client for 30 sec - exiting
17:33:02 (7148): No heartbeat from core client for 30 sec - exiting
17:33:03 (7148): No heartbeat from core client for 30 sec - exiting
17:33:04 (7148): No heartbeat from core client for 30 sec - exiting
17:33:05 (7148): No heartbeat from core client for 30 sec - exiting
17:33:06 (7148): No heartbeat from core client for 30 sec - exiting
17:33:07 (7148): No heartbeat from core client for 30 sec - exiting
17:33:08 (7148): No heartbeat from core client for 30 sec - exiting
17:33:09 (7148): No heartbeat from core client for 30 sec - exiting
17:33:11 (7148): No heartbeat from core client for 30 sec - exiting
17:33:12 (7148): No heartbeat from core client for 30 sec - exiting
17:33:13 (7148): No heartbeat from core client for 30 sec - exiting
17:33:14 (7148): No heartbeat from core client for 30 sec - exiting
17:33:15 (7148): No heartbeat from core client for 30 sec - exiting
17:33:16 (7148): No heartbeat from core client for 30 sec - exiting
17:33:17 (7148): No heartbeat from core client for 30 sec - exiting
17:33:18 (7148): No heartbeat from core client for 30 sec - exiting
17:33:19 (7148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5180, iMonCtr=1
Model crash detected, will try to restart...
20:14:47 (7864): No heartbeat from core client for 30 sec - exiting
20:14:48 (7864): No heartbeat from core client for 30 sec - exiting
20:14:49 (7864): No heartbeat from core client for 30 sec - exiting
20:14:51 (7864): No heartbeat from core client for 30 sec - exiting
20:14:52 (7864): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:14:53 (7864): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:30:04 (5076): No heartbeat from core client for 30 sec - exiting
17:30:06 (5076): No heartbeat from core client for 30 sec - exiting
17:30:07 (5076): No heartbeat from core client for 30 sec - exiting
17:30:08 (5076): No heartbeat from core client for 30 sec - exiting
17:30:09 (5076): No heartbeat from core client for 30 sec - exiting
17:30:10 (5076): No heartbeat from core client for 30 sec - exiting
17:30:11 (5076): No heartbeat from core client for 30 sec - exiting
17:30:12 (5076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:47:50 (6640): No heartbeat from core client for 30 sec - exiting
17:47:52 (6640): No heartbeat from core client for 30 sec - exiting
17:47:53 (6640): No heartbeat from core client for 30 sec - exiting
17:47:54 (6640): No heartbeat from core client for 30 sec - exiting
17:47:55 (6640): No heartbeat from core client for 30 sec - exiting
17:47:56 (6640): No heartbeat from core client for 30 sec - exiting
17:47:57 (6640): No heartbeat from core client for 30 sec - exiting
17:47:58 (6640): No heartbeat from core client for 30 sec - exiting
17:47:59 (6640): No heartbeat from core client for 30 sec - exiting
17:48:00 (6640): No heartbeat from core client for 30 sec - exiting
17:48:01 (6640): No heartbeat from core client for 30 sec - exiting
17:48:03 (6640): No heartbeat from core client for 30 sec - exiting
17:48:04 (6640): No heartbeat from core client for 30 sec - exiting
17:48:05 (6640): No heartbeat from core client for 30 sec - exiting
17:48:06 (6640): No heartbeat from core client for 30 sec - exiting
17:48:07 (6640): No heartbeat from core client for 30 sec - exiting
17:48:08 (6640): No heartbeat from core client for 30 sec - exiting
17:48:09 (6640): No heartbeat from core client for 30 sec - exiting
17:48:10 (6640): No heartbeat from core client for 30 sec - exiting
17:48:11 (6640): No heartbeat from core client for 30 sec - exiting
17:48:12 (6640): No heartbeat from core client for 30 sec - exiting
17:48:14 (6640): No heartbeat from core client for 30 sec - exiting
17:48:15 (6640): No heartbeat from core client for 30 sec - exiting
17:48:16 (6640): No heartbeat from core client for 30 sec - exiting
17:48:17 (6640): No heartbeat from core client for 30 sec - exiting
17:48:18 (6640): No heartbeat from core client for 30 sec - exiting
17:48:19 (6640): No heartbeat from core client for 30 sec - exiting
17:48:20 (6640): No heartbeat from core client for 30 sec - exiting
17:48:21 (6640): No heartbeat from core client for 30 sec - exiting
17:48:22 (6640): No heartbeat from core client for 30 sec - exiting
17:48:23 (6640): No heartbeat from core client for 30 sec - exiting
17:48:25 (6640): No heartbeat from core client for 30 sec - exiting
17:48:26 (6640): No heartbeat from core client for 30 sec - exiting
17:48:27 (6640): No heartbeat from core client for 30 sec - exiting
17:48:28 (6640): No heartbeat from core client for 30 sec - exiting
17:48:29 (6640): No heartbeat from core client for 30 sec - exiting
17:48:30 (6640): No heartbeat from core client for 30 sec - exiting
17:48:31 (6640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2472, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2472, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2472, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2472, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2472, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2472, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
04:21:42 (4100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8160, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8160, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8160, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/ocean_restart.day after 11 attempts
18:37:56 (2776): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_z8ac_1920_40_008245035/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jan 2013 10:42:25 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 648,000 1,800,164 2.7780
07 Jan 2013 14:21:19 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 622,080 1,730,831 2.7823
06 Jan 2013 17:53:21 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 596,160 1,661,510 2.7870
05 Jan 2013 20:36:43 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 570,240 1,591,424 2.7908
04 Jan 2013 22:41:17 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 544,320 1,517,895 2.7886
04 Jan 2013 00:38:17 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 518,400 1,443,805 2.7851
03 Jan 2013 02:24:30 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 492,480 1,369,147 2.7801
02 Jan 2013 03:59:06 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 466,560 1,294,917 2.7755
01 Jan 2013 07:16:05 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 440,640 1,225,258 2.7806
31 Dec 2012 10:23:47 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 414,720 1,155,898 2.7872
30 Dec 2012 13:35:29 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 388,800 1,086,362 2.7941
29 Dec 2012 15:57:17 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 362,880 1,014,434 2.7955
28 Dec 2012 16:56:18 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 336,960 938,591 2.7855
27 Dec 2012 18:12:45 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 311,040 863,147 2.7750
26 Dec 2012 19:38:55 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 285,120 788,551 2.7657
25 Dec 2012 21:10:40 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 259,200 714,404 2.7562
24 Dec 2012 23:05:14 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 233,280 640,929 2.7475
24 Dec 2012 02:29:53 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 207,360 570,973 2.7535
23 Dec 2012 06:02:29 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 181,440 501,717 2.7652
22 Dec 2012 09:24:30 1091586 15477307 hadcm3n_z8ac_1920_40_008245035_2 155,520 432,358 2.7801


©2024 climateprediction.net