|
Message boards :
News :
New study going out to volunteer's machines
Message board moderation
Author | Message |
---|---|
Send message Joined: 11 Feb 11 Posts: 14 Credit: 53,909 RAC: 0 |
STORMS: Investigating how low-pressure systems may change in the future (actual project name - “Quantifying controls on the intensity, variability and impacts of extreme European STORMS”) Victoria Sinclair, Clément Bouvier Institute for Atmospheric and Earth System Research, University of Helsinki, Finland Throughout the year, low-pressure systems regularly move across Europe, usually from west to east, bringing cloud, rain and windy weather. Sometimes these weather systems can become very intense, and the winds and rain associated with them can cause damage to buildings and infrastructure, flooding, and can disrupt electricity supply and travel. Although the short-term weather forecasts of these storms are now quite accurate, it still remains uncertain how these storms, and their impacts, are likely to change in the future as our climate changes. Some of this uncertainty is because our understanding of what controls the strength and impacts of these storms is incomplete. The aim of this project is to understand what controls the strength and structure of these low-pressure systems. We will quantify how the atmospheric state that the low-pressure systems develop in affects the strength and structure of these low-pressure systems. This atmospheric state can be described by various parameters, for example, the mean temperature, moisture content, and upper-level wind speeds (i.e. the strength and width of the jet stream). Since there are lots of different parameters we want to study (not just the ones described above), we want to do lots of experiments in a high controlled manner. Therefore, we will run a large ensemble of simulations of idealised low-pressure systems using the numerical weather prediction model OpenIFS. Although the simulations are idealised, the weather systems that develop look very like real weather systems that we observed in reality. Each ensemble member differs in its initial atmospheric state, and we choose these initial states to cover everything from the current climate to past pre-industrial climates to the most extreme future climate projections. This is exciting because although idealised simulations of low-pressure systems have been performed before, this is the first time that such an extensive exploration of the parameter space will be conducted. Once we have the results from the large ensemble, we will calculate different measures of the strength of the storms and then use machine learning techniques to see how these relate to the initial states. Our results will hopefully increase in confidence in how these storms and their impacts will change in the future. Technical information: Please ensure 'Leave non-GPU tasks in memory while suspended' is set in Disk/Memory options of boincmgr CPDN app-name: oifs_43r3_bl Run time: ~6 hrs/task on a modern CPU Max memory: ~7Gb Total number of files: 354 files Model output: 16Mb per output step (uncompressed) Total size of uploaded files: 1.5GB Checkpoint filesize: ~800Mb (these are periodically created & deleted in the slot dir and not uploaded)[/b] |
Send message Joined: 5 Aug 04 Posts: 1106 Credit: 17,025,459 RAC: 5,652 |
Technical information: Thank you for this very informative post, especially the part I quoted above. My machine (Computer 1511241) just got six of these tasks and I diddled my app_config.xml file to allow 5 to run at a time and five are currently running. Since this is a new task type, OpenIFS 43r3 Baroclinic Lifecycle 1.11 x86_64-pc-linux-gnu , my boinc manager expects them to take 08:47:45 to complete. Perhaps so, but we will see as it learns the truth, whatever that is. If the latest _ps tasks are anything to go by, the estimated time at the beginning was about double what my machine actually took (based on only two tasks of the _ps tasks) so far. Since these five all have less than an hour on them, the following RAM usage is probably not typical yet, but there seems to be plenty of RAM for these to run. The biggest one is taking about 4 GBytes with about 1/2 hour of execution time. $ free -hw total used free shared buffers cache available Mem: 62Gi 24Gi 1.9Gi 115Mi 509Mi 35Gi 37Gi Swap: 15Gi 127Mi 15Gi ![]() |
Send message Joined: 4 Oct 15 Posts: 34 Credit: 9,075,151 RAC: 374 |
Quick Note from my side, could it be possible, that you mixed some of the infos up? I have two WUs running, both have one zip after an hour of runtime. https://www.cpdn.org/workunit.php?wuid=12209606 has created an _0 Zip with 62,21MB of size https://www.cpdn.org/workunit.php?wuid=12209550 has created an _0 Zip with 57,37MB of size I will block the uploads an collect more data until completion. Greets Felix |
Send message Joined: 29 Oct 17 Posts: 944 Credit: 15,193,000 RAC: 23,306 |
Quick Note from my side, could it be possible, that you mixed some of the infos up?Felix, zipfiles are not guaranteed to produce the same size with different data. The compression achieved by zip depends on the patterns in the input files. The filesizes are estimates only. I suggest just let them finish, no need to block uploads. |
![]() Send message Joined: 22 Jan 05 Posts: 40 Credit: 4,390,001 RAC: 5,115 |
Good evening, just one more technical information I would like to see: What OS is required? Linux? Or would Windows work as well? Thanks! Friedrich |
Send message Joined: 5 Aug 04 Posts: 1106 Credit: 17,025,459 RAC: 5,652 |
Since these five all have less than an hour on them, the following RAM usage is probably not typical yet, but there seems to be plenty of RAM for these to run. The biggest one is taking about 4 GBytes with about 1/2 hour of execution time. The first five have finished now. Near the end, it was like this: localhost:jeandavid8[~]$ date; free -hw Mon Feb 13 14:46:01 EST 2023 total used free shared buffers cache available Mem: 62Gi 20Gi 10Gi 151Mi 509Mi 31Gi 41Gi Swap: 15Gi 141Mi 15Gi localhost:jeandavid8[~]$ date; free -hw Mon Feb 13 15:27:08 EST 2023 total used free shared buffers cache available Mem: 62Gi 18Gi 12Gi 147Mi 509Mi 30Gi 42Gi Swap: 15Gi 141Mi 15Gi localhost:jeandavid8[~]$ date; free -hw Mon Feb 13 16:06:48 EST 2023 total used free shared buffers cache available Mem: 62Gi 24Gi 4.9Gi 164Mi 509Mi 31Gi 36Gi Swap: 15Gi 141Mi 15Gi ![]() |
Send message Joined: 2 Jul 15 Posts: 19 Credit: 4,074,444 RAC: 2,161 |
Thank you, Andy. I have not seen any new tasks in the last several months. Posted information suggests they have all been LINUX tasks and I run only Windows 10. Are these new Storms tasks executable in Windows? I don't see the configuration element 'Leave non-GPU tasks in memory while suspended'. Please tell me where to find it. Thank you! - David Berg |
Send message Joined: 24 Sep 09 Posts: 4 Credit: 591,616 RAC: 865 |
Indeed! I have the same doubt, no new task for months and so far not being able to catch any of this new ones. |
Send message Joined: 29 Oct 17 Posts: 944 Credit: 15,193,000 RAC: 23,306 |
Thank you, Andy.The current batches are linux only. For Windows, running them under WSL (which is what I do), or a virtualbox setup works fine, but that's not for everyone. I do know that CPDN are preparing some more Windows batches though I don't have a timeline for when they will be ready. The 'leave non-GPU in memory' option can be found in the computing preferences in boincmgr. |
Send message Joined: 1 Jan 07 Posts: 1014 Credit: 35,788,735 RAC: 25,438 |
The 'leave non-GPU in memory' option can be found in the computing preferences in boincmgr.It can also be found on the Computing Preferences page of this website, https://www.cpdn.org/prefs.php?subset=global ('Memory' section). You can set preferences via the website, or via BOINC Manager, but you can't mix the two. If you already have some personal preferences set, use the same technique for this one as well. |
Send message Joined: 24 Sep 09 Posts: 4 Credit: 591,616 RAC: 865 |
Thanks for lettings us know! I will try to setup a virtual machine later down the line... but its a bummer that for example I cannot use my Ryzen 5 right now in the project because the Linux-only WUs. |
Send message Joined: 7 Dec 19 Posts: 1 Credit: 4,451,345 RAC: 12,087 |
The current batches are linux only. For Windows, running them under WSL (which is what I do), or a virtualbox setup works fine, but that's not for everyone. I do know that CPDN are preparing some more Windows batches though I don't have a timeline for when they will be ready. Do you have a write-up or a link to describing how to do this? Cheers |
Send message Joined: 6 Oct 06 Posts: 204 Credit: 7,608,986 RAC: 0 |
The current batches are linux only. For Windows, running them under WSL (which is what I do), or a virtualbox setup works fine, but that's not for everyone. I do know that CPDN are preparing some more Windows batches though I don't have a timeline for when they will be ready. https://www.windowscentral.com/how-install-wsl2-windows-10 |
Send message Joined: 9 Oct 20 Posts: 690 Credit: 4,391,754 RAC: 6,918 |
The current batches are linux only. For Windows, running them under WSL (which is what I do), or a virtualbox setup works fine, but that's not for everyone. I do know that CPDN are preparing some more Windows batches though I don't have a timeline for when they will be ready.How about doing what LHC does, send the VB wrapper out so anyone can run your Linux stuff? |
Send message Joined: 6 Oct 06 Posts: 204 Credit: 7,608,986 RAC: 0 |
The current batches are linux only. For Windows, running them under WSL (which is what I do), or a virtualbox setup works fine, but that's not for everyone. I do know that CPDN are preparing some more Windows batches though I don't have a timeline for when they will be ready.How about doing what LHC does, send the VB wrapper out so anyone can run your Linux stuff? If you want an older version, download it from the Boinc site. If you wish the current version as we all do, go to the VB site and download it. The flavour of Linux is your choice, go and download it from their site. |
Send message Joined: 9 Oct 20 Posts: 690 Credit: 4,391,754 RAC: 6,918 |
I may have a go at that. But it involves setting up another Boinc client within a virtual machine. I hate the linux interface, it took me 3 hours last time to work out how to install a program. The VB wrapper LHC uses means a task is downloaded from them and run in the Windows client along with other projects, easier to manage.The current batches are linux only. For Windows, running them under WSL (which is what I do), or a virtualbox setup works fine, but that's not for everyone. I do know that CPDN are preparing some more Windows batches though I don't have a timeline for when they will be ready.How about doing what LHC does, send the VB wrapper out so anyone can run your Linux stuff? Would I be able to access this Boinc client from Boinctasks in Windows? I currently use Boinctasks to view all my clients on Windows on other machines across the network. Hopefully the VBox environment has a unique IP I can access? |
Send message Joined: 9 Mar 22 Posts: 30 Credit: 1,065,239 RAC: 556 |
Hopefully the VBox environment has a unique IP... There's no need for hope. Just read the VirtualBox manual. https://www.virtualbox.org/manual/ch06.html#networkingmodes Hint1: Don't mix self created VMs with those created by vboxwrapper Hint2: Your use case requires a self created VM with Bridged networking |
Send message Joined: 9 Oct 20 Posts: 690 Credit: 4,391,754 RAC: 6,918 |
Thanks, I've got the network set up and it has a unique IP. But I can't find the thing to install stuff. I don't even have a dock and every Ubuntu manual keeps telling me to use it. Edit: nevermind, found the software downloader in the start menu. I'd prefer no dock anyway, this isn't a Mac. |
Send message Joined: 9 Oct 20 Posts: 690 Credit: 4,391,754 RAC: 6,918 |
No tasks? I thought CPDN had loads of Linux tasks. Gah! Finally found out how to login as root. Much easier to edit xml files when you're allowed to use your own machine! I mean seriously? There seems to be no way to change an xml file to change Boinc's settings if I'm not root! The mousepad program refuses to save, and I can't give myself permissions to edit the file! Gotta love the warning notices everywhere as though I'm about to start a nuclear war. Well I'm root on Windows and nothing has gone wrong in 32 years. |
Send message Joined: 24 Nov 12 Posts: 12 Credit: 1,890,996 RAC: 1,930 |
I would love to run some of these, but I haven't received any tasks from CP. in quite a while, My computer is more than capable of running these, How do I set up a virtual box, with detailed instructions? And yet my laptop has 3 CP programs running! |
©2024 climateprediction.net