Difference between revisions of "Rose-UKCA suites"

Revision as of 13:13, 12 April 2024

Rose UKCA suites on Met Office and MONsooN HPC

This page describes the Rose suites with UKCA that are available for testing

Disclaimer: The main purpose of these suites is for model development and testing with short runs. They should be considered as not suitable for Science applications.

Pre-requisites

Account on the Met Office Science Repository (MOSRS) for UM / Rose code and access to the Met Office Cray or the MONSooN HPC system.
Basic knowledge about Rose and its usage with UM.

For the initial Rose setup and instructions on using Rose on MONSooN, see this page.

UM13.5 (Test Suite)

u-df325

UM13.4 (Test Suite)

u-da940

Instructions for using the suite (vn13+): Using_the_UM13_test_suites

UM13.3 (Test Suite)

u-cy079

Instructions for using the suite (vn13+): Using_the_UM13_test_suites

UM13.2 (Test Suite)

u-cv931

Changes from vn13.1 version:: Support for running the suite on the Met Office EX1A system, which is the prototype for the replacement HPC expected later in 2023. Note that access to this system is currently only available to early users/ testers.

Instructions for using the suite (vn13+): Using_the_UM13_test_suites

UM13.1 (Test Suite)

u-cs478

Changes from vn13.0 version:: None

Instructions for using the suite (vn13+): Using_the_UM13_test_suites

UM13.0 (Test Suite)

u-cp551

Changes from vn12.2 version::
- UKCA code now sourced through its own repository: It might now be necessary to create branches on both UM and UKCA repositories, depending on which parts of the code are being modified.

Instructions for using the suite (vn13+): Using_the_UM13_test_suites

UM12.2 (Test Suite)

u-cm128

Changes from vn12.1 version::
- CRI-Strat configuration upgraded to CRI-Strat-v2

Instructions for using the suite (vn11.8+): Using_the_UM11.8_test_suite

UM12.1 (Test Suite)

u-cj707

UM12.0 (Test Suite)

u-cg120

Changes from vn11.9 version::
- It is now possible to specify the Monsoon project/ account name for HPC tasks. The default account used is that which appears as the (alphabetically) first project in the list from the `id $USER` command.
- CRI-Strat tests are now On by default since any code changes impacting this configuration need to be identified early.

UM11.9 (Test Suite)

u-cc839

Changes from vn11.8 version: None

Note: Monsoon use : There are usually some initial delays in required UM files being transferred across to Monsoon, so some operations may fail till this is complete.

UM11.8 (Test Suite)

u-bz714

Changes from vn11.7 version:

Added a CRI-Strat+GLOMAP+RADAER+Activate configuration with Restartability (NRUN vs NRUN+CRUN), OpenMP (1 vs 2 threads), Rigorous build and CRI-Strat-Columnar with PE bit-reproducibility (16x8 vs 8x12 PEs) tests

Using the UM11.8 test suite

UM11.7 (Test Suite)

u-bw014

This version runs the same configurations and is technically identical to the UM11.6 suite below. Monsoon users will need to select SITE = Monsoon in the Rose GUI.

All other instructions (for adding branches, namelist items, STASHmaster, etc) remain the same as for the UM11.6 suite.

UM11.6 (Test Suite)

u-bs026

This version reflects the science updates to the UKCA app in the UM Rose-stem. It still runs the following configurations at N96L85:

StratTrop(CheST)+GLOMAP+RADAER+Activate with Restartability (NRUN vs NRUN+CRUN), OpenMP (1 vs 2 threads) and Rigorous build tests
StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test

Changes:

- HOUSEKEEPing is now a user-controlled step i.e. set HOUSEKEEP=False if you want to keep the model outputs even if all tests pass e.g. to look at diagnostics, print statements, timings, etc
- The atmos_strat_rigorous task now runs much faster (few minutes rather than > 1 hour) as the writing of restart dump is replaced with a 3-hourly mean output file for comparison

As in previous version a trac.log file is now generated that contains basic information on the suite-run and status of each of the tasks.

Using the UM11.6 test suite

UM11.5 (Test Suite)

u-bo375

This is an upgrade of the vn11.4 suite and runs the following configurations at N96L85:

StratTrop(CheST)+GLOMAP+RADAER+Activate with Restartability (NRUN vs NRUN+CRUN), OpenMP (1 vs 2 threads) and Rigorous build tests
StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test

In addition, at the end (i.e. when suite finishes successfully or is stopped by user) a trac.log file is now generated that contains basic information on the suite-run and status of each of the tasks. The contents of the trac.log can be directly pasted into a trac page e.g. as additional testing evidence while lodging code.

The main configurations carry out a 2-day simulation that requires between 15 - 20 minutes to complete on the Cray.

Using the UM11.5 test suite

UM11.4 (Test Suite)

u-bk021

This is an upgrade of the vn11.3 suite and runs the following configurations at N96L85:

StratTrop(CheST)+GLOMAP+RADAER+Activate with Restartability (NRUN vs NRUN+CRUN), OpenMP (1 vs 2 threads) and Rigorous build tests
StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test

In addition, at the end (i.e. when suite finishes successfully or is stopped by user) a trac.log file is now generated that contains basic information on the suite-run and status of each of the tasks. The contents of the trac.log can be directly pasted into a trac page e.g. as additional testing evidence while lodging code.

The main configurations carry out a 2-day simulation that requires between 15 - 20 minutes to complete on the Cray.

Using the UM11.4 test suite

UM11.3 (Test Suite)

u-bg563

This is an upgrade of the vn11.2 suite and runs the following configurations at N96L85:

StratTrop(CheST)+GLOMAP+RADAER+Activate with Restartability (NRUN vs NRUN+CRUN), OpenMP (1 vs 2 threads) and Rigorous build tests
StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test

At vn11.3 an additional test with 'Rigorous for the Strattrop configuration has been introduced. This builds the executable with low optimisation, many compiler checks and runs a 3-hour simulation, compared against the reference.

The main configurations carry out a 2-day simulation that requires between 15 - 20 minutes to complete on the Cray.

Using the UM11.3 test suite

UM11.2 (Test Suite)

u-be133

This is an upgrade of the vn11.1 suite and continues to run the following configurations at N96L85:

StratTrop(CheST)+GLOMAP+RADAER+Activate
StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
Offline oxidants+GLOMAP+RADAER+Activate

The Offline oxidants and Strattrop-Columnar jobs include a bit-reproducibility test (16x8 vs 8x12 PEs), while the Strat+trop job includes an OpenMP (1 thread vs 2 threads) and a Restartability (NRUN vs NRUN+CRUN) test
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.

Using the UM11.2 test suite

UM11.1 (Test Suite)

u-az274

This is an upgrade of the vn11.0 suite and continues to run the following configurations at N96L85:

StratTrop(CheST)+GLOMAP+RADAER+Activate
StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
Offline oxidants+GLOMAP+RADAER+Activate

The Offline oxidants and Strattrop-Columnar jobs include a bit-reproducibility test (16x8 vs 8x12 PEs), while the Strat+trop job includes an OpenMP (1 thread vs 2 threads) and a Restartability (NRUN vs NRUN+CRUN) test
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.

Using the UM11.1 test suite

UM11.0 (Test Suite)

u-av613

This is an upgrade of the vn10.9 suite and continues to run the following configurations at N96L85:

StratTrop(CheST)+GLOMAP+RADAER+Activate
StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
Offline oxidants+GLOMAP+RADAER+Activate

The Offline oxidants and Strattrop-Columnar jobs include a bit-reproducibility test (16x8 vs 8x12 PEs), while the Strat+trop job includes an OpenMP (1 thread vs 2 threads) and a Restartability (NRUN vs NRUN+CRUN) test
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.

Using the UM11.0 test suite

UM10.9 (Test Suite)

u-al223

This is an upgrade from previous versions of the suite and continues to run the following configurations at N96L85:

StratTrop(CheST)+GLOMAP+RADAER+Activate
StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
Offline oxidants+GLOMAP+RADAER+Activate

The Offline oxidants and Strattrop-Columnar jobs include bit-reproducibility between 16x8 vs 8x12 PEs, while the Strat+trop job includes a NRUN vs NRUN+CRUN
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.

Using the UM10.9 test suite

UM10.8 (Test Suite)

MONSooN: puma-aa438
MetO: mi-at557 This is an upgrade from previous versions of the suite and continues to run the following configurations at N96L85:

StratTrop(CheST)+GLOMAP+RADAER+Activate
Offline oxidants+GLOMAP+RADAER+Activate

The Offline oxidants job includes bit-reproducibility between 16x8 vs 8x12 PEs (TEST_PE), while the Strat+trop job includes a NRUN vs NRUN+CRUN (CRUN_TEST)
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.

Using the UM10.8 test suite

UM10.7 (Test Suite)

MONSooN: puma-aa428
MetO: mi-ar330 This is an upgrade from the UM10.6 suite a test suite continues to run the following configurations at N96L85:

StratTrop(CheST)+GLOMAP+RADAER+Activate
Offline oxidants+GLOMAP+RADAER+Activate

The Offline oxidants job includes bit-reproducibility between 16x8 vs 8x12 PEs (TEST_PE), while the Strat+trop job includes a NRUN vs NRUN+CRUN (CRUN_TEST)
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.

Using the UM10.7 test suite

UM10.6 (Test Suite)

MONSooN: puma-aa405
MetO: mi-ap240 This is an upgrade from the UM10.5 suite a test suite continues to run the following configurations at N96L85:

StratTrop(CheST)+GLOMAP+RADAER+Activate
Offline oxidants+GLOMAP+RADAER+Activate

The Offline oxidants job includes bit-reproducibility between 16x8 vs 8x12 PEs (TEST_PE), while the Strat+trop job includes a NRUN vs NRUN+CRUN (CRUN_TEST)
The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.

Using the UM10.6 test suite

@@ Line 1: / Line 1: @@
-=== Rose UKCA suites on MONsooN ===
+=== Rose UKCA suites on Met Office and MONsooN HPC===
 <br/>
-This page describes the Rose suites with UKCA that are installed on MONsooN.<br/>
+This page describes the Rose suites with UKCA that are available for testing<br/><br/>
-'''Disclaimer:''' The main purpose of these suites is for model development and overall assessment of performance. Until the suites are assessed properly and released via the [[UKCA Release Jobs]] page, they should be considered as '''not suitable for Science applications'''.
+'''Disclaimer:''' The main purpose of these suites is for model development and testing with short runs. They should be considered as '''not suitable for Science applications'''.
 ====Pre-requisites====
-Account for the PUMA [https://puma.nerc.ac.uk/trac/roses_puma/wiki Rose repository] and access to the [http://www.jwcrp.org.uk/infrastructure/monsoon.asp MONSooN] HPC system.<br/>
+Account on the Met Office Science Repository [https://code.metoffice.gov.uk (MOSRS)] for UM / Rose code and access to the Met Office Cray or the [http://www.jwcrp.org.uk/infrastructure/monsoon.asp MONSooN] HPC system.<br/>
-Basic knowledge about [http://metomi.github.io/rose/doc/rose.html Rose] and [https://code.metoffice.gov.uk/doc/um/vn10.2/um-training/index.html its usage with UM].<br/>
+Basic knowledge about [http://metomi.github.io/rose/doc/rose.html Rose] and [https://code.metoffice.gov.uk/doc/um/vn12.2/um-training/index.html its usage with UM].<br/>
-For the initial Rose setup and instructions on using Rose on MONSooN, see [http://collab.metoffice.gov.uk/twiki/bin/view/Support/MONSooNRose this] page (requires Collaboration Twiki login).
+For the initial Rose setup and instructions on using Rose on MONSooN, see [https://code.metoffice.gov.uk/doc/monsoon2/additionalServices.html#rose-and-cylc this] page.
-===== UM10.2 =====
+===== UM13.5 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/d/f/3/2/5 u-df325]'''
-'''[https://puma.nerc.ac.uk/trac/roses_puma/browser/a/a/2/3/7/trunk puma-aa237]:''' This is an UKCA StratTrop/CheST Chemistry +GLOMAP suite at N96L85 resolution. The suite is derived from the UM Global Atmosphere development suite [https://code.metoffice.gov.uk/trac/GA/wiki/ticket/136/mi-ah615 mi-ah615], but using the ''StraTrop or CheST'' scheme instead of ''Offline oxidants''.<br/>
-The suite is set up to archive model output (to the MASS tape drive) and submit the next segment, so it can be used for performing long simulations.
-===== UM10.3 =====
+===== UM13.4 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/d/a/9/4/0 u-da940]'''
-'''[https://puma.nerc.ac.uk/trac/roses_puma/browser/a/a/2/6/2/trunk puma-aa262]:''' This is a test suite based on the UKCA configurations in the UM trunk and can simultaneously run the following configurations at N96L85:<br/>
-* StratTrop(CheST)+GLOMAP+RADAER+Activate
-* Offline oxidants+GLOMAP+RADAER+Activate with two PE configurations
+Instructions for using the suite (vn13+): [[Using_the_UM13_test_suites]]
-Both the configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray. The CheST Configuration uses 16x8 PEs, while the Offline configuration uses 16x8 and 8x12 PEs.
-==== Using the Suite ====
+===== UM13.3 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/c/y/0/7/9 u-cy079]'''
-The following steps use the UM10.3 suite as an example. All Rose suites on MONsooN need to be executed from the special Rose server as described in the [http://collab.metoffice.gov.uk/twiki/bin/view/Support/MONSooNRose instructions] and '''not on the puma''' system.<br/>
+Instructions for using the suite (vn13+): [[Using_the_UM13_test_suites]]
-# Create a suitable folder for the suite. (default name ~/roses)
-# cd to the folder and create a copy of the Suite
-#: ~/roses $ ''rosie copy puma-aa262''
-#:This will create a copy of the suite as ''puma-aaNNN'' and check it out to the ~/roses folder.
-# To ensure that the base settings work for you:
-#::$ ''cd ~/roses/puma-aaNNN''
-#::puma-aaNNN $ ''rose suite-run''
-#:This will preprocess the configuration and launch the tasks in the background along with opening the gcylc window that displays the status of each task.
-#:Once all the tasks complete (Status = stopped with 'succeeded' or check output in Rose-bush), the Suite can now be modified to test your changes.
-# Execution options<br/>
-#:The suite can be executed as a combination of the following configurations, by setting values of the related variables in puma-aaNNN/rose-suite.conf:
-#::Compilation (Build) On/Off: ''BUILD=true/false''
-#::StratTrop Chemistry scheme: ''STRATTROP=true/false''
-#::Offline Oxidants Chemistry scheme: ''OFFLINE=true/false''
-#::PE Test for the Offline scheme: ''TEST_PE=true/false''
-#:
-#:Setting both Offline & StratTrop options to false will convert the suite to a compile-only job.
-#:
-#::''Additional Options:''
-#:
-#:::Change the length of the run(s): modify ''TASKEND='0,Months,Days,Hours,Minutes,0' '' (Note: Meaning is Off, so the apps can be run only upto one month)
-#:::Change the frequency of restart dumps: set ''DUMPFREQ=number-of-days''
-# Testing an UM10.3 branch
-#:If you are only making changes to the code and not modifying any namelists, the suite only needs to be pointed to the new branch:
-#::puma-aaNNN $ Edit ''app/fcm_make/rose-app.conf''  and add your branch at the line
-#:::''um_sources=branches/your-branch or um_sources=working-copy (full path)''
-#:Note that since suites use the mirror of the Ex-UM respository, it takes 5-10 minutes for any recently committed changes to be available to the suite.
-#:
-#:Now rerun the suite:
-#:::puma-aaNNN $ ''rose suite-run --new''
-#:The ''--new'' option forces the removal (and fresh creation) of the extracted source, build and working folders thus ensuring that all modifications to the source code made in your branch are included.
-#:
-#:If the code changes are expected to change results for this configuration, failure of the comparison (rose ana) tasks can be ignored. However, if no change is expected yet the comparison fails, this indicates a ''bug'' somewhere in the implementation which needs to be traced, corrected and re-tested.
-# Namelist changes
-#:If there are any modifications to the namelists e.g. addition or deletion of items, moving items between namelists, these need to be applied in
-#::''puma-aaNNN/app/um/rose-app.conf'' as well as ''puma-aaNNN/app/um_offl/rose-app.conf''.
-#:For adding the accompanying metadata changes:
-#:
-#::Checkout your branch to an universal location i.e. $HOME or $DATADIR.
-#::Modify the meta-data file : ''your-working-copy/rose-meta/um-atmos/HEAD/rose-meta.conf'' to reflect the namelist changes.
-#::Edit both ''puma-aaNNN/app/um/rose-app.conf'' and ''puma-aaNNN/app/um_offl/rose-app.conf'' and replace the line:
-#::''meta=um-atmos/vn10.3'' with ''meta=your working copy/rose-meta/um-atmos/HEAD''
-#:
-#:Open the apps with ''rose edit'' to ensure that the namelist changes are consistent with the metadata.
-#:Now rerun the suite to make sure the Rose namelist changes are consistent with the Fortran namelist changes.
+===== UM13.2 (Test Suite) =====
-'''Warning:''' If any of the tasks in the workflow fails, the corresponding ''housekeeping'' task will not be carried out and all the data generated will remain in ''$DATADIR/cylc-run/puma-aaNNN'' on the HPC. This may have to be cleaned manually after testing through the command:
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/c/v/9/3/1 u-cv931]'''
-:::puma-aaNNN $ rose suite-clean
+''Changes from vn13.1 version:'': Support for running the suite on the Met Office '''EX1A''' system, which is the prototype for the replacement HPC expected later in 2023. ''Note that access to this system is currently only available to early users/ testers.''
+Instructions for using the suite (vn13+): [[Using_the_UM13_test_suites]]
+===== UM13.1 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/c/s/4/7/8 u-cs478]'''
+''Changes from vn13.0 version:'': None
+Instructions for using the suite (vn13+): [[Using_the_UM13_test_suites]]
+===== UM13.0 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/c/p/5/5/1 u-cp551]'''
+''Changes from vn12.2 version:'':<br/>
+- '''UKCA code now sourced through its own repository''': It might now be necessary to create branches on both UM and UKCA repositories, depending on which parts of the code are being modified.
+Instructions for using the suite (vn13+): [[Using_the_UM13_test_suites]]
+===== UM12.2 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/c/m/1/2/8 u-cm128]'''
+''Changes from vn12.1 version:'':<br/>
+- ''CRI-Strat'' configuration upgraded to ''CRI-Strat-v2''
+Instructions for using the suite (vn11.8+): [[Using_the_UM11.8_test_suite]]
+===== UM12.1 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/c/j/7/0/7 u-cj707]'''
+===== UM12.0 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/c/g/1/2/0 u-cg120]'''
+''Changes from vn11.9 version:'':<br/>
+- It is now possible to specify the '''Monsoon project/ account''' name for HPC tasks. The default account used is that which appears as the (alphabetically) first project in the list from the  `id $USER` command.<br/>
+- '''CRI-Strat''' tests are now ''On'' by default since any code changes impacting this configuration need to be identified early.
+===== UM11.9 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/c/c/8/3/9 u-cc839]'''
+''Changes from vn11.8 version:'' '''None'''
+'''Note:''' ''Monsoon use'' : There are usually some initial delays in required UM files being transferred across to Monsoon, so some operations may fail till this is complete.
+===== UM11.8 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/b/z/7/1/4 u-bz714]'''
+''Changes from vn11.7 version:''
+* Added a CRI-Strat+GLOMAP+RADAER+Activate configuration with ''Restartability'' (NRUN vs NRUN+CRUN), ''OpenMP'' (1 vs 2 threads),  ''Rigorous build'' and CRI-Strat-Columnar with PE bit-reproducibility (16x8 vs 8x12 PEs) tests
+[[Using the UM11.8 test suite]]
+===== UM11.7 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/b/w/0/1/4 u-bw014]'''
+This version runs the same configurations and is technically identical to the UM11.6 suite below.
+Monsoon users will need to select ''SITE = Monsoon'' in the Rose GUI.
+All other instructions (for ''adding branches, namelist items, STASHmaster, etc'') remain the same as for the UM11.6 suite.
+===== UM11.6 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/b/s/0/2/6 u-bs026]'''
+This version reflects the science updates to the UKCA app in the UM Rose-stem. It still runs the following configurations at N96L85:<br/>
+* StratTrop(CheST)+GLOMAP+RADAER+Activate with ''Restartability'' (NRUN vs NRUN+CRUN), ''OpenMP'' (1 vs 2 threads) and ''Rigorous build'' tests
+* StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
+* Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
+''Changes:''
+ - HOUSEKEEPing is now a user-controlled step i.e. set HOUSEKEEP=False if you want to keep the model outputs ''even if all tests pass'' e.g. to look at diagnostics, print statements, timings, etc
+ - The ''atmos_strat_rigorous'' task now runs much faster (few minutes rather than > 1 hour) as the writing of restart dump is replaced with a 3-hourly mean output file for comparison
+As in previous version a '''trac.log''' file is now generated that contains basic information on the suite-run and status of each of the tasks.
+[[Using the UM11.6 test suite]]
+===== UM11.5 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/b/o/3/7/5 u-bo375]'''
+This is an upgrade of the vn11.4 suite and runs the following configurations at N96L85:<br/>
+* StratTrop(CheST)+GLOMAP+RADAER+Activate with ''Restartability'' (NRUN vs NRUN+CRUN), ''OpenMP'' (1 vs 2 threads) and ''Rigorous build'' tests
+* StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
+* Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
+In addition, at the end (i.e. when suite ''finishes successfully'' or is ''stopped by user'') a '''trac.log''' file is now generated that contains basic information on the suite-run and status of each of the tasks. The contents of the ''trac.log'' can be directly pasted into a trac page e.g. as additional testing evidence while lodging code.
+The main configurations carry out a 2-day simulation that requires between 15 - 20 minutes to complete on the Cray.<br/>
+[[Using the UM11.5 test suite]]
+===== UM11.4 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/b/k/0/2/1 u-bk021]'''
+This is an upgrade of the vn11.3 suite and runs the following configurations at N96L85:<br/>
+* StratTrop(CheST)+GLOMAP+RADAER+Activate with ''Restartability'' (NRUN vs NRUN+CRUN), ''OpenMP'' (1 vs 2 threads) and ''Rigorous build'' tests
+* StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
+* Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
+In addition, at the end (i.e. when suite ''finishes successfully'' or is ''stopped by user'') a '''trac.log''' file is now generated that contains basic information on the suite-run and status of each of the tasks. The contents of the ''trac.log'' can be directly pasted into a trac page e.g. as additional testing evidence while lodging code.
+The main configurations carry out a 2-day simulation that requires between 15 - 20 minutes to complete on the Cray.<br/>
+[[Using the UM11.4 test suite]]
+===== UM11.3 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/b/g/5/6/3 u-bg563]'''
+This is an upgrade of the vn11.2 suite and runs the following configurations at N96L85:<br/>
+* StratTrop(CheST)+GLOMAP+RADAER+Activate with ''Restartability'' (NRUN vs NRUN+CRUN), ''OpenMP'' (1 vs 2 threads) and ''Rigorous build'' tests
+* StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
+* Offline oxidants+GLOMAP+RADAER+Activate with PE bit-reproducibility (16x8 vs 8x12 PEs) test
+''At vn11.3 an additional test with '''Rigorous'' for the Strattrop configuration has been introduced. This builds the executable with low optimisation, many compiler checks and runs a 3-hour simulation, compared against the reference.''
+The main configurations carry out a 2-day simulation that requires between 15 - 20 minutes to complete on the Cray.<br/>
+[[Using the UM11.3 test suite]]
+===== UM11.2 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/b/e/1/3/3 u-be133]'''
+This is an upgrade of the vn11.1 suite and continues to run the following configurations at N96L85:<br/>
+* StratTrop(CheST)+GLOMAP+RADAER+Activate
+* StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
+* Offline oxidants+GLOMAP+RADAER+Activate
+The Offline oxidants and Strattrop-Columnar jobs include a bit-reproducibility test (16x8 vs 8x12 PEs), while the Strat+trop job includes an OpenMP (1 thread vs 2 threads) and a Restartability (NRUN vs NRUN+CRUN) test <br/>
+The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.<br/>
+[[Using the UM11.2 test suite]]
+===== UM11.1 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/a/z/2/7/4 u-az274]'''
+This is an upgrade of the vn11.0 suite and continues to run the following configurations at N96L85:<br/>
+* StratTrop(CheST)+GLOMAP+RADAER+Activate
+* StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
+* Offline oxidants+GLOMAP+RADAER+Activate
+The Offline oxidants and Strattrop-Columnar jobs include a bit-reproducibility test (16x8 vs 8x12 PEs), while the Strat+trop job includes an OpenMP (1 thread vs 2 threads) and a Restartability (NRUN vs NRUN+CRUN) test <br/>
+The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.<br/>
+[[Using the UM11.1 test suite]]
+===== UM11.0 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/a/v/6/1/3 u-av613]'''
+This is an upgrade of the vn10.9 suite and continues to run the following configurations at N96L85:<br/>
+* StratTrop(CheST)+GLOMAP+RADAER+Activate
+* StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
+* Offline oxidants+GLOMAP+RADAER+Activate
+The Offline oxidants and Strattrop-Columnar jobs include a bit-reproducibility test (16x8 vs 8x12 PEs), while the Strat+trop job includes an OpenMP (1 thread vs 2 threads) and a Restartability (NRUN vs NRUN+CRUN) test <br/>
+The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.<br/>
+[[Using the UM11.0 test suite]]
+===== UM10.9 (Test Suite) =====
+'''[https://code.metoffice.gov.uk/trac/roses-u/browser/a/l/2/2/3 u-al223]'''
+This is an upgrade from previous versions of the suite and continues to run the following configurations at N96L85:<br/>
+* StratTrop(CheST)+GLOMAP+RADAER+Activate
+* StratTrop(CheST)-Columnar+GLOMAP+RADAER+Activate
+* Offline oxidants+GLOMAP+RADAER+Activate
+The Offline oxidants and Strattrop-Columnar jobs include bit-reproducibility between 16x8 vs 8x12 PEs, while the Strat+trop job includes a NRUN vs NRUN+CRUN <br/>
+The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.<br/>
+[[Using the UM10.9 test suite]]
+===== UM10.8 (Test Suite) =====
+'''MONSooN: [https://puma.nerc.ac.uk/trac/roses_puma/browser/a/a/4/3/8/trunk puma-aa438]''' <br/>
+'''MetO: [http://fcm1/projects/roses_mi/intertrac/source:/a/t/5/5/7/trunk mi-at557]'''
+This is an upgrade from previous versions of the suite and continues to run the following configurations at N96L85:<br/>
+* StratTrop(CheST)+GLOMAP+RADAER+Activate
+* Offline oxidants+GLOMAP+RADAER+Activate
+The Offline oxidants job includes bit-reproducibility between 16x8 vs 8x12 PEs (TEST_PE), while the Strat+trop job includes a NRUN vs NRUN+CRUN (CRUN_TEST)<br/>
+The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.<br/>
+[[Using the UM10.8 test suite]]
+===== UM10.7 (Test Suite) =====
+'''MONSooN: [https://puma.nerc.ac.uk/trac/roses_puma/browser/a/a/4/2/8/trunk puma-aa428]''' <br/>
+'''MetO: [http://fcm1/projects/roses_mi/intertrac/source:/a/r/3/3/0/trunk mi-ar330]'''
+This is an upgrade from the UM10.6 suite a test suite continues to run the following configurations at N96L85:<br/>
+* StratTrop(CheST)+GLOMAP+RADAER+Activate
+* Offline oxidants+GLOMAP+RADAER+Activate
+The Offline oxidants job includes bit-reproducibility between 16x8 vs 8x12 PEs (TEST_PE), while the Strat+trop job includes a NRUN vs NRUN+CRUN (CRUN_TEST)<br/>
+The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.<br/>
+[[Using the UM10.7 test suite]]
+===== UM10.6 (Test Suite) =====
+'''MONSooN: [https://puma.nerc.ac.uk/trac/roses_puma/browser/a/a/4/0/5/trunk puma-aa405]''' <br/>
+'''MetO: [http://fcm1/projects/roses_mi/intertrac/source:/a/p/2/4/0/trunk mi-ap240]'''
+This is an upgrade from the UM10.5 suite a test suite continues to run the following configurations at N96L85:<br/>
+* StratTrop(CheST)+GLOMAP+RADAER+Activate
+* Offline oxidants+GLOMAP+RADAER+Activate
+The Offline oxidants job includes bit-reproducibility between 16x8 vs 8x12 PEs (TEST_PE), while the Strat+trop job includes a NRUN vs NRUN+CRUN (CRUN_TEST)<br/>
+The main configurations carry out a 2-day simulation that requires between 10 - 15 minutes to complete on the Cray.<br/>
+[[Using the UM10.6 test suite]]