Difference between revisions of "Rose-UKCA suites"
| Line 13: | Line 13: | ||
'''[https://code.metoffice.gov.uk/trac/roses-u/browser/d/a/9/4/0 u-da940]''' |
'''[https://code.metoffice.gov.uk/trac/roses-u/browser/d/a/9/4/0 u-da940]''' |
||
| − | '''Note:''' Running ''rose edit'' on this suite in Monsoon may lead to errors like ''cannot import cmp_to_key'' due to a new function being used by Rose that is not available on all systems. '' |
+ | '''Note:''' Running ''rose edit'' on this suite in Monsoon may lead to errors like ''cannot import cmp_to_key'' due to a new function being used by Rose that is not available on all systems. '''However, the error does not seem to affect building of the Rose panels, or running of the suite itself, so can be ignored for now'''. |
Instructions for using the suite (vn13+): [[Using_the_UM13_test_suites]] |
Instructions for using the suite (vn13+): [[Using_the_UM13_test_suites]] |
||
Revision as of 11:23, 10 November 2023
Rose UKCA suites on Met Office and MONsooN HPC
This page describes the Rose suites with UKCA that are available for testing
Disclaimer: The main purpose of these suites is for model development and testing with short runs. They should be considered as not suitable for Science applications.
Pre-requisites
Account on the Met Office Science Repository (MOSRS) for UM / Rose code and access to the Met Office Cray or the MONSooN HPC system.
Basic knowledge about Rose and its usage with UM.
For the initial Rose setup and instructions on using Rose on MONSooN, see this page.
UM13.4 (Test Suite)
Note: Running rose edit on this suite in Monsoon may lead to errors like cannot import cmp_to_key due to a new function being used by Rose that is not available on all systems. However, the error does not seem to affect building of the Rose panels, or running of the suite itself, so can be ignored for now.
Instructions for using the suite (vn13+): Using_the_UM13_test_suites
UM13.3 (Test Suite)
Instructions for using the suite (vn13+): Using_the_UM13_test_suites
UM13.2 (Test Suite)
Changes from vn13.1 version:: Support for running the suite on the Met Office EX1A system, which is the prototype for the replacement HPC expected later in 2023. Note that access to this system is currently only available to early users/ testers.
Instructions for using the suite (vn13+): Using_the_UM13_test_suites
UM13.1 (Test Suite)
Changes from vn13.0 version:: None
Instructions for using the suite (vn13+): Using_the_UM13_test_suites
UM13.0 (Test Suite)
Changes from vn12.2 version::
- UKCA code now sourced through its own repository: It might now be necessary to create branches on both UM and UKCA repositories, depending on which parts of the code are being modified.
Instructions for using the suite (vn13+): Using_the_UM13_test_suites
UM12.2 (Test Suite)
Changes from vn12.1 version::
- CRI-Strat configuration upgraded to CRI-Strat-v2
Instructions for using the suite (vn11.8+): Using_the_UM11.8_test_suite
UM12.1 (Test Suite)
UM12.0 (Test Suite)
Changes from vn11.9 version::
- It is now possible to specify the Monsoon project/ account name for HPC tasks. The default account used is that which appears as the (alphabetically) first project in the list from the `id $USER` command.
- CRI-Strat tests are now On by default since any code changes impacting this configuration need to be identified early.
UM11.9 (Test Suite)
Changes from vn11.8 version: None
Note: Monsoon use : There are usually some initial delays in required UM files being transferred across to Monsoon, so some operations may fail till this is complete.
UM11.8 (Test Suite)
Changes from vn11.7 version:
- Added a CRI-Strat+GLOMAP+RADAER+Activate configuration with Restartability (NRUN vs NRUN+CRUN), OpenMP (1 vs 2 threads), Rigorous build and CRI-Strat-Columnar with PE bit-reproducibility (16x8 vs 8x12 PEs) tests
UM11.7 (Test Suite)
This version runs the same configurations and is technically identical to the UM11.6 suite below. Monsoon users will need to select SITE = Monsoon in the Rose GUI.
All other instructions (for adding branches, namelist items, STASHmaster, etc) remain the same as for the UM11.6 suite.
UM11.6 (Test Suite)
This version reflects the science updates to the UKCA app in the UM Rose-stem. It still runs the following configurations at N96L85:
- StratTrop(CheST)+GLOMAP+RADAER+Activate with Restartability (NRUN vs NRUN+CRUN), OpenMP (1 vs 2 threads) and Rigorous build tests
- StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
- Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
Changes:
- HOUSEKEEPing is now a user-controlled step i.e. set HOUSEKEEP=False if you want to keep the model outputs even if all tests pass e.g. to look at diagnostics, print statements, timings, etc - The atmos_strat_rigorous task now runs much faster (few minutes rather than > 1 hour) as the writing of restart dump is replaced with a 3-hourly mean output file for comparison
As in previous version a trac.log file is now generated that contains basic information on the suite-run and status of each of the tasks.
UM11.5 (Test Suite)
This is an upgrade of the vn11.4 suite and runs the following configurations at N96L85:
- StratTrop(CheST)+GLOMAP+RADAER+Activate with Restartability (NRUN vs NRUN+CRUN), OpenMP (1 vs 2 threads) and Rigorous build tests
- StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
- Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
In addition, at the end (i.e. when suite finishes successfully or is stopped by user) a trac.log file is now generated that contains basic information on the suite-run and status of each of the tasks. The contents of the trac.log can be directly pasted into a trac page e.g. as additional testing evidence while lodging code.
The main configurations carry out a 2-day simulation that requires between 15 - 20 minutes to complete on the Cray.
UM11.4 (Test Suite)
This is an upgrade of the vn11.3 suite and runs the following configurations at N96L85:
- StratTrop(CheST)+GLOMAP+RADAER+Activate with Restartability (NRUN vs NRUN+CRUN), OpenMP (1 vs 2 threads) and Rigorous build tests
- StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
- Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
In addition, at the end (i.e. when suite finishes successfully or is stopped by user) a trac.log file is now generated that contains basic information on the suite-run and status of each of the tasks. The contents of the trac.log can be directly pasted into a trac page e.g. as additional testing evidence while lodging code.
The main configurations carry out a 2-day simulation that requires between 15 - 20 minutes to complete on the Cray.
UM11.3 (Test Suite)
This is an upgrade of the vn11.2 suite and runs the following configurations at N96L85:
- StratTrop(CheST)+GLOMAP+RADAER+Activate with Restartability (NRUN vs NRUN+CRUN), OpenMP (1 vs 2 threads) and Rigorous build tests
- StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
- Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
At vn11.3 an additional test with 'Rigorous for the Strattrop configuration has been introduced. This builds the executable with low optimisation, many compiler checks and runs a 3-hour simulation, compared against the reference.
The main configurations carry out a 2-day simulation that requires between 15 - 20 minutes to complete on the Cray.
UM11.2 (Test Suite)
This is an upgrade of the vn11.1 suite and continues to run the following configurations at N96L85:
- StratTrop(CheST)+GLOMAP+RADAER+Activate
- StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
- Offline oxidants+GLOMAP+RADAER+Activate
The Offline oxidants and Strattrop-Columnar jobs include a bit-reproducibility test (16x8 vs 8x12 PEs), while the Strat+trop job includes an OpenMP (1 thread vs 2 threads) and a Restartability (NRUN vs NRUN+CRUN) test
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.
UM11.1 (Test Suite)
This is an upgrade of the vn11.0 suite and continues to run the following configurations at N96L85:
- StratTrop(CheST)+GLOMAP+RADAER+Activate
- StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
- Offline oxidants+GLOMAP+RADAER+Activate
The Offline oxidants and Strattrop-Columnar jobs include a bit-reproducibility test (16x8 vs 8x12 PEs), while the Strat+trop job includes an OpenMP (1 thread vs 2 threads) and a Restartability (NRUN vs NRUN+CRUN) test
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.
UM11.0 (Test Suite)
This is an upgrade of the vn10.9 suite and continues to run the following configurations at N96L85:
- StratTrop(CheST)+GLOMAP+RADAER+Activate
- StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
- Offline oxidants+GLOMAP+RADAER+Activate
The Offline oxidants and Strattrop-Columnar jobs include a bit-reproducibility test (16x8 vs 8x12 PEs), while the Strat+trop job includes an OpenMP (1 thread vs 2 threads) and a Restartability (NRUN vs NRUN+CRUN) test
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.
UM10.9 (Test Suite)
This is an upgrade from previous versions of the suite and continues to run the following configurations at N96L85:
- StratTrop(CheST)+GLOMAP+RADAER+Activate
- StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
- Offline oxidants+GLOMAP+RADAER+Activate
The Offline oxidants and Strattrop-Columnar jobs include bit-reproducibility between 16x8 vs 8x12 PEs, while the Strat+trop job includes a NRUN vs NRUN+CRUN
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.
UM10.8 (Test Suite)
MONSooN: puma-aa438
MetO: mi-at557
This is an upgrade from previous versions of the suite and continues to run the following configurations at N96L85:
- StratTrop(CheST)+GLOMAP+RADAER+Activate
- Offline oxidants+GLOMAP+RADAER+Activate
The Offline oxidants job includes bit-reproducibility between 16x8 vs 8x12 PEs (TEST_PE), while the Strat+trop job includes a NRUN vs NRUN+CRUN (CRUN_TEST)
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.
UM10.7 (Test Suite)
MONSooN: puma-aa428
MetO: mi-ar330
This is an upgrade from the UM10.6 suite a test suite continues to run the following configurations at N96L85:
- StratTrop(CheST)+GLOMAP+RADAER+Activate
- Offline oxidants+GLOMAP+RADAER+Activate
The Offline oxidants job includes bit-reproducibility between 16x8 vs 8x12 PEs (TEST_PE), while the Strat+trop job includes a NRUN vs NRUN+CRUN (CRUN_TEST)
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.
UM10.6 (Test Suite)
MONSooN: puma-aa405
MetO: mi-ap240
This is an upgrade from the UM10.5 suite a test suite continues to run the following configurations at N96L85:
- StratTrop(CheST)+GLOMAP+RADAER+Activate
- Offline oxidants+GLOMAP+RADAER+Activate
The Offline oxidants job includes bit-reproducibility between 16x8 vs 8x12 PEs (TEST_PE), while the Strat+trop job includes a NRUN vs NRUN+CRUN (CRUN_TEST)
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.
