Task 21876683

Name	wah2_sam50_n11b_201312_28_859_011976438_2
Workunit	11976438
Created	17 Jan 2020, 16:32:36 UTC
Sent	17 Jan 2020, 16:32:46 UTC
Report deadline	29 Dec 2020, 21:52:46 UTC
Received	5 Jun 2020, 10:30:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1484388
Run time	13 days 15 hours 57 min 13 sec
CPU time	1 hours 23 min 34 sec
Validate state	Invalid
Credit	14,458.52
Device peak FLOPS	2.46 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	225.35 MB
Peak swap size	189.49 MB
Peak disk usage	96.77 MB
Stderr	<core_client_version>7.6.33</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5276, selfPID=3160, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3564, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3284, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4392, selfPID=3888, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1452, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4160, selfPID=4080, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3880, selfPID=3960, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3060, selfPID=3876, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2968, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3388, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4732, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4728, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3628, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4404, selfPID=3680, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4952, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4368, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4424, selfPID=1484, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3500, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5064, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3340, selfPID=1444, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3368, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5524, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4020, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4136, selfPID=3696, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5088, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5308, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5456, selfPID=3348, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3828, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5272, selfPID=3304, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4476, selfPID=4384, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3068, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4172, selfPID=3696, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5440, selfPID=3852, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3740, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4224, selfPID=3896, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4812, selfPID=4720, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3392, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3364, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3360, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3656, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4796, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4436, selfPID=3308, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3876, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4280, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5312, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4328, selfPID=3012, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4852, selfPID=3800, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4228, selfPID=3916, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4804, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5040, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4180, selfPID=3372, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4168, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=572, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4320, selfPID=3344, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2688, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3944, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2964, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3608, selfPID=4556, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=492, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4616, selfPID=1316, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4144, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4732, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4124, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5324, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5428, selfPID=3364, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6072, selfPID=4620, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4088, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4796, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4124, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1108, selfPID=4644, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4036, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5848, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5396, selfPID=1208, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3920, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3756, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5404, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5560, selfPID=3684, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4248, iMonCtr=2 GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4176, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2664, selfPID=3424, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4516, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4140, selfPID=3348, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4300, selfPID=1184, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3848, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3860, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1032, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3816, selfPID=3012, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4080, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5100, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3668, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1048, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3872, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4360, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4440, selfPID=1028, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3756, selfPID=3016, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4960, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3540, selfPID=3352, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4376, selfPID=3204, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5068, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4544, selfPID=4172, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4680, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5032, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1436, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5340, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3464, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3304, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6548, iMonCtr=2 Model crash detected, will try to restart... GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5860, selfPID=4424, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4352, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4948, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4100, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4712, iMonCtr=2 Model crash detected, will try to restart... GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4896, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5396, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4920, selfPID=4320, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4588, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4536, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4976, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4796, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4940, selfPID=4232, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=772, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4704, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5092, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3228, selfPID=4388, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5056, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4224, selfPID=4432, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5040, selfPID=4528, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4904, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4744, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4900, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4356, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4884, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4364, selfPID=4684, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4960, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1668, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4492, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4588, selfPID=3948, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=772, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1808, selfPID=4748, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5072, iMonCtr=2 GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4312, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4868, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3728, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3956, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5028, selfPID=4396, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1492, selfPID=4360, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4872, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3972, selfPID=3756, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3248, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3704, selfPID=4104, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 17:16:15 (4104): called boinc_finish(0) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4228, selfPID=1500, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3568, selfPID=4392, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam50_n11b_201312_28_859_011976438/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam50_n11b_201312_28_859_011976438/dataout/region_restart.day after 11 attempts Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xacxf.pipe_dummy 2048 Leaving CPDN_ain::Monitor... 11:30:07 (4408): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>wah2_sam50_n11b_201312_28_859_011976438_2_r889609325_20.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam50_n11b_201312_28_859_011976438_2_r889609325_21.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam50_n11b_201312_28_859_011976438_2_r889609325_22.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam50_n11b_201312_28_859_011976438_2_r889609325_23.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam50_n11b_201312_28_859_011976438_2_r889609325_24.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam50_n11b_201312_28_859_011976438_2_r889609325_25.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam50_n11b_201312_28_859_011976438_2_r889609325_26.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam50_n11b_201312_28_859_011976438_2_r889609325_27.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam50_n11b_201312_28_859_011976438_2_r889609325_28.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam50_n11b_201312_28_859_011976438_2_r889609325_restart.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 May 2020 18:45:41	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	219,179	1,150,450	5.2489
23 May 2020 09:49:59	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	207,659	1,103,447	5.3137
18 May 2020 15:47:36	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	196,139	1,054,644	5.3770
12 May 2020 10:33:49	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	184,619	1,005,845	5.4482
05 May 2020 10:51:00	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	173,099	956,217	5.5241
30 Apr 2020 16:00:03	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	161,579	903,769	5.5934
26 Apr 2020 12:38:52	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	150,059	852,848	5.6834
23 Apr 2020 08:03:31	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	138,539	802,039	5.7893
17 Apr 2020 16:20:48	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	127,019	754,721	5.9418
13 Apr 2020 18:00:31	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	115,499	704,761	6.1019
06 Apr 2020 13:32:21	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	103,979	643,828	6.1919
02 Apr 2020 12:24:19	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	92,459	585,459	6.3321
01 Apr 2020 09:20:24	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	80,939	526,030	6.4991
22 Mar 2020 10:40:54	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	69,419	463,365	6.6749
17 Mar 2020 08:50:12	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	57,899	393,097	6.7894
05 Mar 2020 15:57:16	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	46,379	315,848	6.8102
18 Feb 2020 17:24:35	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	34,859	234,747	6.7342
14 Feb 2020 12:05:23	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	23,339	156,316	6.6976
05 Feb 2020 10:59:52	1484388	21876683	wah2_sam50_n11b_201312_28_859_011976438_2	11,819	75,799	6.4133