Task 15713066

Name	hadcm3n_3ljc_1980_40_008319163_1
Workunit	8470298
Created	6 Apr 2013, 16:21:29 UTC
Sent	7 Apr 2013, 9:15:36 UTC
Report deadline	7 Jul 2013, 16:42:47 UTC
Received	14 Apr 2013, 4:23:53 UTC
Server state	Over
Outcome	Computation error
Client state	Done
Exit status	1073807364 (0x40010004) Unknown error code
Computer ID	330080
Run time	6 days 12 hours 0 min 37 sec
CPU time	6 days 12 hours 0 min 37 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	1.96 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>5.8.16</core_client_version> <![CDATA[ <message> - exit code 1073807364 (0x40010004) </message> <stderr_txt> 08:11:05 (5780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:06 (5780): No heartbeat from core client for 30 sec - exiting 08:42:49 (11200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:42 (13296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:15 (12124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:25 (10132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:35 (7944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:09 (12328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:09 (8172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:23 (7592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:24 (7592): No heartbeat from core client for 30 sec - exiting 12:17:12 (13336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:06 (2264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:37:30 (7584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:45:53 (9560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:02 (1700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:47:16 (1388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:47:18 (1388): No heartbeat from core client for 30 sec - exiting 12:20:39 (11524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:41 (11524): No heartbeat from core client for 30 sec - exiting 12:21:51 (9060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:09 (8252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:29:18 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:30:24 (9084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:30:25 (9084): No heartbeat from core client for 30 sec - exiting 14:34:42 (9268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:15 (13752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:35 (5400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:01:21 (8992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:09 (5500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:17 (2480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:18 (2480): No heartbeat from core client for 30 sec - exiting 06:38:10 (11804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:58 (12652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:48:49 (12996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:50:29 (11032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:08:06 (8104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:08:54 (9300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:07 (8972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:50:22 (10624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:20 (13000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:24 (7208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:23 (13340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:59:47 (9968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:27 (13252): No heartbeat from core client for 30 sec - exiting 08:00:28 (13252): No heartbeat from core client for 30 sec - exiting 08:00:29 (13252): No heartbeat from core client for 30 sec - exiting 08:00:30 (13252): No heartbeat from core client for 30 sec - exiting 08:00:31 (13252): No heartbeat from core client for 30 sec - exiting 08:00:32 (13252): No heartbeat from core client for 30 sec - exiting 08:00:33 (13252): No heartbeat from core client for 30 sec - exiting 08:00:34 (13252): No heartbeat from core client for 30 sec - exiting 08:00:35 (13252): No heartbeat from core client for 30 sec - exiting 08:00:36 (13252): No heartbeat from core client for 30 sec - exiting 08:00:37 (13252): No heartbeat from core client for 30 sec - exiting 08:00:38 (13252): No heartbeat from core client for 30 sec - exiting 08:00:39 (13252): No heartbeat from core client for 30 sec - exiting 08:00:40 (13252): No heartbeat from core client for 30 sec - exiting 08:00:41 (13252): No heartbeat from core client for 30 sec - exiting 08:00:42 (13252): No heartbeat from core client for 30 sec - exiting 08:00:43 (13252): No heartbeat from core client for 30 sec - exiting 08:00:44 (13252): No heartbeat from core client for 30 sec - exiting 08:00:45 (13252): No heartbeat from core client for 30 sec - exiting 08:00:46 (13252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:03:37 (10828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:04:42 (13816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:33 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:21 (11080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:21:37 (6892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:23:30 (8476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:34:34 (8384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:54 (13000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:05 (12040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:51 (10740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:09 (5924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:51 (9620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:59 (2740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:22 (13804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:02 (5924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:49 (10404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:59 (9300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:44:35 (1684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:53 (9820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:43 (13660): No heartbeat from core client for 30 sec - exiting 10:49:44 (13660): No heartbeat from core client for 30 sec - exiting 10:49:45 (13660): No heartbeat from core client for 30 sec - exiting 10:49:46 (13660): No heartbeat from core client for 30 sec - exiting 10:49:47 (13660): No heartbeat from core client for 30 sec - exiting 10:49:48 (13660): No heartbeat from core client for 30 sec - exiting 10:49:49 (13660): No heartbeat from core client for 30 sec - exiting 10:49:50 (13660): No heartbeat from core client for 30 sec - exiting 10:49:51 (13660): No heartbeat from core client for 30 sec - exiting 10:49:52 (13660): No heartbeat from core client for 30 sec - exiting 10:49:54 (13660): No heartbeat from core client for 30 sec - exiting 10:49:55 (13660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:55 (12472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:21 (8772): No heartbeat from core client for 30 sec - exiting 10:53:22 (8772): No heartbeat from core client for 30 sec - exiting 10:53:23 (8772): No heartbeat from core client for 30 sec - exiting 10:53:24 (8772): No heartbeat from core client for 30 sec - exiting 10:53:25 (8772): No heartbeat from core client for 30 sec - exiting 10:53:26 (8772): No heartbeat from core client for 30 sec - exiting 10:53:27 (8772): No heartbeat from core client for 30 sec - exiting 10:53:28 (8772): No heartbeat from core client for 30 sec - exiting 10:53:30 (8772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:04:20 (14148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:08 (8028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:28 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:23:06 (2364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:01:34 (12308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:01:35 (12308): No heartbeat from core client for 30 sec - exiting 12:06:12 (9312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:10:06 (9592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:12:57 (8096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:03 (13748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:05 (13748): No heartbeat from core client for 30 sec - exiting 12:28:06 (13396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:08 (13348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:59 (10064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13208, iMonCtr=1 Model crash detected, will try to restart... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Apr 2013 22:52:46	330080	15713066	hadcm3n_3ljc_1980_40_008319163_1	285,120	543,739	1.9071
13 Apr 2013 09:28:45	330080	15713066	hadcm3n_3ljc_1980_40_008319163_1	259,200	496,462	1.9154
12 Apr 2013 19:42:14	330080	15713066	hadcm3n_3ljc_1980_40_008319163_1	233,280	448,381	1.9221
12 Apr 2013 04:17:50	330080	15713066	hadcm3n_3ljc_1980_40_008319163_1	207,360	395,532	1.9075
11 Apr 2013 13:15:29	330080	15713066	hadcm3n_3ljc_1980_40_008319163_1	181,440	342,187	1.8860
10 Apr 2013 22:10:31	330080	15713066	hadcm3n_3ljc_1980_40_008319163_1	155,520	294,176	1.8916
10 Apr 2013 08:43:15	330080	15713066	hadcm3n_3ljc_1980_40_008319163_1	129,600	245,277	1.8926
09 Apr 2013 17:56:33	330080	15713066	hadcm3n_3ljc_1980_40_008319163_1	103,680	195,520	1.8858
09 Apr 2013 03:18:03	330080	15713066	hadcm3n_3ljc_1980_40_008319163_1	77,760	147,430	1.8960
08 Apr 2013 13:28:49	330080	15713066	hadcm3n_3ljc_1980_40_008319163_1	51,840	98,981	1.9094
07 Apr 2013 23:33:38	330080	15713066	hadcm3n_3ljc_1980_40_008319163_1	25,920	50,644	1.9539