climateprediction.net home page
Task 17770774

Task 17770774

Name hadam3pm2_k1m5_1959_10_009445520_0
Workunit 9527754
Created 12 Jan 2015, 20:41:31 UTC
Sent 13 Jan 2015, 23:15:55 UTC
Report deadline 27 Dec 2015, 4:35:55 UTC
Received 22 Mar 2015, 12:07:47 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1105896
Run time 15 days 3 hours 53 min 54 sec
CPU time 14 days 17 hours 41 min 59 sec
Validate state Invalid
Credit 10,064.32
Device peak FLOPS 3.73 GFLOPS
Application version UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:19:54 (18889): No heartbeat from client for 30 sec - exiting
02:19:54 (18889): timer handler: client dead, exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:41:45 (18141): No heartbeat from client for 30 sec - exiting
01:41:45 (18141): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:46:02 (1518): No heartbeat from client for 30 sec - exiting
01:46:02 (1518): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:51:21 (2457): No heartbeat from client for 30 sec - exiting
01:51:21 (2457): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:31:53 (3045): No heartbeat from client for 30 sec - exiting
00:31:53 (3045): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu: free(): invalid pointer: 0xf732d008 ***
======= Backtrace: =========
/lib/libc.so.6(+0x6fa14)[0xf7431a14]
/lib/libc.so.6(+0x71323)[0xf7433323]
/lib/libc.so.6(cfree+0x6d)[0xf74364cd]
../../projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu[0x80b0797]
[0xffffe400]
../../projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu[0x80d5200]
../../projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu[0x80c01a4]
/lib/libpthread.so.0(+0x6839)[0xf7672839]
/lib/libc.so.6(clone+0x5e)[0xf749d40e]
======= Memory map: ========
08048000-08107000 r-xp 00000000 08:51 11690025                           /home/boinc/projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu
08107000-08109000 rw-p 000bf000 08:51 11690025                           /home/boinc/projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu
08109000-081bb000 rw-p 00000000 00:00 0                                  [heap]
f7000000-f7021000 rw-p 00000000 00:00 0 
f7021000-f7100000 ---p 00000000 00:00 0 
f7196000-f73c0000 rw-s 00000000 08:51 11681834                           /home/boinc/slots/1/154040
f73c0000-f73c2000 rw-p 00000000 00:00 0 
f73c2000-f752c000 r-xp 00000000 08:51 100114987                          /lib/libc-2.11.3.so (deleted)
f752c000-f752d000 ---p 0016a000 08:51 100114987                          /lib/libc-2.11.3.so (deleted)
f752d000-f752f000 r--p 0016a000 08:51 100114987                          /lib/libc-2.11.3.so (deleted)
f752f000-f7530000 rw-p 0016c000 08:51 100114987                          /lib/libc-2.11.3.so (deleted)
f7530000-f7533000 rw-p 00000000 00:00 0 
f7533000-f754f000 r-xp 00000000 08:51 100115094                          /lib/libgcc_s.so.1 (deleted)
f754f000-f7550000 r--p 0001b000 08:51 100115094                          /lib/libgcc_s.so.1 (deleted)
f7550000-f7551000 rw-p 0001c000 08:51 100115094                          /lib/libgcc_s.so.1 (deleted)
f7551000-f7552000 rw-p 00000000 00:00 0 
f7552000-f7579000 r-xp 00000000 08:51 100114995                          /lib/libm-2.11.3.so (deleted)
f7579000-f757a000 r--p 00026000 08:51 100114995                          /lib/libm-2.11.3.so (deleted)
f757a000-f757b000 rw-p 00027000 08:51 100114995                          /lib/libm-2.11.3.so (deleted)
f757b000-f765b000 r-xp 00000000 08:51 10005359                           /usr/lib/libstdc++.so.6.0.17 (deleted)
f765b000-f765f000 r--p 000df000 08:51 10005359                           /usr/lib/libstdc++.so.6.0.17 (deleted)
f765f000-f7660000 rw-p 000e3000 08:51 10005359                           /usr/lib/libstdc++.so.6.0.17 (deleted)
f7660000-f7667000 rw-p 00000000 00:00 0 
f7667000-f766a000 r-xp 00000000 08:51 100114993                          /lib/libdl-2.11.3.so (deleted)
f766a000-f766b000 r--p 00002000 08:51 100114993                          /lib/libdl-2.11.3.so (deleted)
f766b000-f766c000 rw-p 00003000 08:51 100114993                          /lib/libdl-2.11.3.so (deleted)
f766c000-f7683000 r-xp 00000000 08:51 100115013                          /lib/libpthread-2.11.3.so (deleted)
f7683000-f7684000 r--p 00016000 08:51 100115013                          /lib/libpthread-2.11.3.so (deleted)
f7684000-f7685000 rw-p 00017000 08:51 100115013                          /lib/libpthread-2.11.3.so (deleted)
f7685000-f7687000 rw-p 00000000 00:00 0 
f7694000-f769b000 r--s 00000000 08:51 10159139                           /usr/lib/gconv/gconv-modules.cache (deleted)
f769b000-f76da000 r--p 00000000 08:51 10200653                           /usr/lib/locale/de_DE.utf8/LC_CTYPE (deleted)
f76da000-f76db000 rw-p 00000000 00:00 0 
f76db000-f76dc000 ---p 00000000 00:00 0 
f76dc000-f76e3000 rw-p 00000000 00:00 0 
f76e3000-f76e5000 rw-s 00000000 08:51 11681831                           /home/boinc/slots/1/boinc_mmap_file
f76e5000-f76e6000 rw-p 00000000 00:00 0 
f76e6000-f7705000 r-xp 00000000 08:51 100115096                          /lib/ld-2.11.3.so (deleted)
f7705000-f7706000 r--p 0001e000 08:51 100115096                          /lib/ld-2.11.3.so (deleted)
f7706000-f7707000 rw-p 0001f000 08:51 100115096                          /lib/ld-2.11.3.so (deleted)
ff9cd000-ff9ee000 rw-p 00000000 00:00 0                                  [stack]
ffffe000-fffff000 r-xp 00000000 00:00 0                                  [vdso]
Signal 15 received, exiting...
20:04:20 (7005): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6971, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu: free(): invalid pointer: 0xf73b7008 ***
Signal 15 received, exiting...
======= Backtrace: =========
09:59:08 (19664): called boinc_finish
/lib/libc.so.6(+0x6fa14)[0xf74bba14]
/lib/libc.so.6(+0x71323)[0xf74bd323]
/lib/libc.so.6(cfree+0x6d)[0xf74c04cd]
../../projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu[0x80b0797]
[0xffffe400]
../../projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu[0x80d5200]
../../projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu[0x80c01a4]
/lib/libpthread.so.0(+0x6839)[0xf76fc839]
/lib/libc.so.6(clone+0x5e)[0xf752759e]
======= Memory map: ========
08048000-08107000 r-xp 00000000 08:51 11690025                           /home/boinc/projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu
08107000-08109000 rw-p 000bf000 08:51 11690025                           /home/boinc/projects/climateprediction.net/hadam3pm2_7.03_i686-pc-linux-gnu
08109000-081bb000 rw-p 00000000 00:00 0                                  [heap]
f7100000-f7121000 rw-p 00000000 00:00 0 
f7121000-f7200000 ---p 00000000 00:00 0 
f7220000-f744a000 rw-s 00000000 08:51 11681834                           /home/boinc/slots/1/154040
f744a000-f744c000 rw-p 00000000 00:00 0 
f744c000-f75b6000 r-xp 00000000 08:51 100114986                          /lib/libc-2.11.3.so
f75b6000-f75b7000 ---p 0016a000 08:51 100114986                          /lib/libc-2.11.3.so
f75b7000-f75b9000 r--p 0016a000 08:51 100114986                          /lib/libc-2.11.3.so
f75b9000-f75ba000 rw-p 0016c000 08:51 100114986                          /lib/libc-2.11.3.so
f75ba000-f75bd000 rw-p 00000000 00:00 0 
f75bd000-f75d9000 r-xp 00000000 08:51 100115022                          /lib/libgcc_s.so.1
f75d9000-f75da000 r--p 0001b000 08:51 100115022                          /lib/libgcc_s.so.1
f75da000-f75db000 rw-p 0001c000 08:51 100115022                          /lib/libgcc_s.so.1
f75db000-f75dc000 rw-p 00000000 00:00 0 
f75dc000-f7603000 r-xp 00000000 08:51 100115369                          /lib/libm-2.11.3.so
f7603000-f7604000 r--p 00026000 08:51 100115369                          /lib/libm-2.11.3.so
f7604000-f7605000 rw-p 00027000 08:51 100115369                          /lib/libm-2.11.3.so
f7605000-f76e5000 r-xp 00000000 08:51 10005834                           /usr/lib/libstdc++.so.6.0.17
f76e5000-f76e9000 r--p 000df000 08:51 10005834                           /usr/lib/libstdc++.so.6.0.17
f76e9000-f76ea000 rw-p 000e3000 08:51 10005834                           /usr/lib/libstdc++.so.6.0.17
f76ea000-f76f1000 rw-p 00000000 00:00 0 
f76f1000-f76f4000 r-xp 00000000 08:51 100114992                          /lib/libdl-2.11.3.so
f76f4000-f76f5000 r--p 00002000 08:51 100114992                          /lib/libdl-2.11.3.so
f76f5000-f76f6000 rw-p 00003000 08:51 100114992                          /lib/libdl-2.11.3.so
f76f6000-f770d000 r-xp 00000000 08:51 100115012                          /lib/libpthread-2.11.3.so
f770d000-f770e000 r--p 00016000 08:51 100115012                          /lib/libpthread-2.11.3.so
f770e000-f770f000 rw-p 00017000 08:51 100115012                          /lib/libpthread-2.11.3.so
f770f000-f7711000 rw-p 00000000 00:00 0 
f771e000-f7725000 r--s 00000000 08:51 10159138                           /usr/lib/gconv/gconv-modules.cache
f7725000-f7764000 r--p 00000000 08:51 10200652                           /usr/lib/locale/de_DE.utf8/LC_CTYPE
f7764000-f7765000 rw-p 00000000 00:00 0 
f7765000-f7766000 ---p 00000000 00:00 0 
f7766000-f776d000 rw-p 00000000 00:00 0 
f776d000-f776f000 rw-s 00000000 08:51 11681831                           /home/boinc/slots/1/boinc_mmap_file
f776f000-f7770000 rw-p 00000000 00:00 0 
f7770000-f778f000 r-xp 00000000 08:51 100115014                          /lib/ld-2.11.3.so
f778f000-f7790000 r--p 0001e000 08:51 100115014                          /lib/ld-2.11.3.so
f7790000-f7791000 rw-p 0001f000 08:51 100115014                          /lib/ld-2.11.3.so
ff820000-ff841000 rw-p 00000000 00:00 0                                  [stack]
ffffe000-fffff000 r-xp 00000000 00:00 0                                  [vdso]
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19661, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
oa.pc|2dec.nc
oa.pc|3jan.nc
oa.pc|3feb.nc
oa.pc|3mar.nc
oa.pc|3apr.nc
oa.pc|3may.nc
oa.pc|3jun.nc
oa.pc|3jul.nc
oa.pc|3aug.nc
oa.pc|3sep.nc
oa.pc|3oct.nc
oa.pc|3nov.nc
oa.pe|2dec.nc
oa.pe|3jan.nc
oa.pe|3feb.nc
oa.pe|3mar.nc
oa.pe|3apr.nc
oa.pe|3may.nc
oa.pe|3jun.nc
oa.pe|3jul.nc
oa.pe|3aug.nc
oa.pe|3sep.nc
oa.pe|3oct.nc
oa.pe|3nov.nc
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
oa.pc|3dec.nc
oa.pc|4jan.nc
oa.pc|4feb.nc
oa.pc|4mar.nc
oa.pc|4apr.nc
oa.pc|4may.nc
oa.pc|4jun.nc
oa.pc|4jul.nc
oa.pc|4aug.nc
oa.pc|4sep.nc
oa.pc|4oct.nc
oa.pc|4nov.nc
oa.pe|3dec.nc
oa.pe|4jan.nc
oa.pe|4feb.nc
oa.pe|4mar.nc
oa.pe|4apr.nc
oa.pe|4may.nc
oa.pe|4jun.nc
oa.pe|4jul.nc
oa.pe|4aug.nc
oa.pe|4sep.nc
oa.pe|4oct.nc
oa.pe|4nov.nc
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
oa.pc|4dec.nc
oa.pc|5jan.nc
oa.pc|5feb.nc
oa.pc|5mar.nc
oa.pc|5apr.nc
oa.pc|5may.nc
oa.pc|5jun.nc
oa.pc|5jul.nc
oa.pc|5aug.nc
oa.pc|5sep.nc
oa.pc|5oct.nc
oa.pc|5nov.nc
oa.pe|4dec.nc
oa.pe|5jan.nc
oa.pe|5feb.nc
oa.pe|5mar.nc
oa.pe|5apr.nc
oa.pe|5may.nc
oa.pe|5jun.nc
oa.pe|5jul.nc
oa.pe|5aug.nc
oa.pe|5sep.nc
oa.pe|5oct.nc
oa.pe|5nov.nc
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
oa.pc|5dec.nc
oa.pc|6jan.nc
oa.pc|6feb.nc
oa.pc|6mar.nc
oa.pc|6apr.nc
oa.pc|6may.nc
oa.pc|6jun.nc
oa.pc|6jul.nc
oa.pc|6aug.nc
oa.pc|6sep.nc
oa.pc|6oct.nc
oa.pc|6nov.nc
oa.pe|5dec.nc
oa.pe|6jan.nc
oa.pe|6feb.nc
oa.pe|6mar.nc
oa.pe|6apr.nc
oa.pe|6may.nc
oa.pe|6jun.nc
oa.pe|6jul.nc
oa.pe|6aug.nc
oa.pe|6sep.nc
oa.pe|6oct.nc
oa.pe|6nov.nc
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
10:56:30 (8368): No heartbeat from client for 30 sec - exiting
10:56:30 (8368): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:56:31 (8368): No heartbeat from client for 30 sec - exiting
10:56:31 (8368): timer handler: client dead, exiting
10:56:32 (8368): No heartbeat from client for 30 sec - exiting
10:56:32 (8368): timer handler: client dead, exiting
10:56:33 (8368): No heartbeat from client for 30 sec - exiting
10:56:33 (8368): timer handler: client dead, exiting
10:56:34 (8368): No heartbeat from client for 30 sec - exiting
10:56:34 (8368): timer handler: client dead, exiting
10:56:35 (8368): No heartbeat from client for 30 sec - exiting
10:56:35 (8368): timer handler: client dead, exiting
10:56:36 (8368): No heartbeat from client for 30 sec - exiting
10:56:36 (8368): timer handler: client dead, exiting
10:56:37 (8368): No heartbeat from client for 30 sec - exiting
10:56:37 (8368): timer handler: client dead, exiting
10:56:38 (8368): No heartbeat from client for 30 sec - exiting
10:56:38 (8368): timer handler: client dead, exiting
10:56:39 (8368): No heartbeat from client for 30 sec - exiting
10:56:39 (8368): timer handler: client dead, exiting
10:56:40 (8368): No heartbeat from client for 30 sec - exiting
10:56:40 (8368): timer handler: client dead, exiting
10:56:41 (8368): No heartbeat from client for 30 sec - exiting
10:56:41 (8368): timer handler: client dead, exiting
10:56:42 (8368): No heartbeat from client for 30 sec - exiting
10:56:42 (8368): timer handler: client dead, exiting
10:56:43 (8368): No heartbeat from client for 30 sec - exiting
10:56:43 (8368): timer handler: client dead, exiting
10:56:44 (8368): No heartbeat from client for 30 sec - exiting
10:56:44 (8368): timer handler: client dead, exiting
10:56:45 (8368): No heartbeat from client for 30 sec - exiting
10:56:45 (8368): timer handler: client dead, exiting
10:56:46 (8368): No heartbeat from client for 30 sec - exiting
10:56:46 (8368): timer handler: client dead, exiting
10:56:47 (8368): No heartbeat from client for 30 sec - exiting
10:56:47 (8368): timer handler: client dead, exiting
10:56:48 (8368): No heartbeat from client for 30 sec - exiting
10:56:48 (8368): timer handler: client dead, exiting
10:56:49 (8368): No heartbeat from client for 30 sec - exiting
10:56:49 (8368): timer handler: client dead, exiting
10:56:50 (8368): No heartbeat from client for 30 sec - exiting
10:56:50 (8368): timer handler: client dead, exiting
10:56:51 (8368): No heartbeat from client for 30 sec - exiting
10:56:51 (8368): timer handler: client dead, exiting
10:56:52 (8368): No heartbeat from client for 30 sec - exiting
10:56:52 (8368): timer handler: client dead, exiting
10:56:53 (8368): No heartbeat from client for 30 sec - exiting
10:56:53 (8368): timer handler: client dead, exiting
11:20:04 (22514): No heartbeat from client for 30 sec - exiting
11:20:04 (22514): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:41:38 (22584): No heartbeat from client for 30 sec - exiting
11:41:38 (22584): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:26:07 (23744): No heartbeat from client for 30 sec - exiting
02:26:07 (23744): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:56:11 (27158): No heartbeat from client for 30 sec - exiting
19:56:11 (27158): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
04:09:25 (8613): No heartbeat from client for 30 sec - exiting
04:09:25 (8613): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:30:39 (17438): called boinc_finish

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>hadam3pm2_k1m5_1959_10_009445520_0_1.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3pm2_k1m5_1959_10_009445520_0_2.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3pm2_k1m5_1959_10_009445520_0_3.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3pm2_k1m5_1959_10_009445520_0_8.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3pm2_k1m5_1959_10_009445520_0_9.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3pm2_k1m5_1959_10_009445520_0_10.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 Mar 2015 08:31:47 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 348,548 1,292,350 3.7078
22 Mar 2015 02:26:05 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 342,788 1,270,933 3.7076
21 Mar 2015 23:19:11 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 339,908 1,259,780 3.7062
21 Mar 2015 20:08:31 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 337,028 1,248,444 3.7043
21 Mar 2015 16:57:51 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 334,148 1,237,282 3.7028
21 Mar 2015 13:52:13 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 331,268 1,226,234 3.7016
21 Mar 2015 10:51:32 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 328,388 1,215,509 3.7014
21 Mar 2015 07:50:48 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 325,508 1,204,784 3.7012
21 Mar 2015 04:44:34 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 322,628 1,193,682 3.6999
21 Mar 2015 01:34:47 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 319,748 1,182,443 3.6980
20 Mar 2015 22:28:03 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 316,868 1,171,450 3.6970
20 Mar 2015 20:57:35 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 313,988 1,160,277 3.6953
14 Mar 2015 01:17:09 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 282,308 1,037,333 3.6745
13 Mar 2015 23:06:18 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 279,428 1,028,209 3.6797
13 Mar 2015 08:50:42 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 265,028 981,018 3.7016
13 Mar 2015 05:47:56 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 262,148 970,418 3.7018
13 Mar 2015 02:18:11 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 259,268 959,491 3.7008
12 Mar 2015 21:56:11 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 256,388 948,541 3.6996
12 Mar 2015 17:14:45 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 253,508 937,618 3.6986
12 Mar 2015 12:38:07 1105896 17770774 hadam3pm2_k1m5_1959_10_009445520_0 250,628 926,807 3.6979


©2024 climateprediction.net