Minutes of the code management group meeting 2019-04-01
Teleconference Details
Monday 1st April 2019, 10am - 11.30am GMT
- UK Landline: +44 (0)1223 761376 (x61376 from an internal University of Cambridge phone)
- Participant PIN: 166147
Present
Met Office: Mohit Dalvi (MD), Alan J Hewitt (AJH), Marc Stringer (MS), Lucy Neal (LN), John Hemmings (JH), Fiona O'Connor (FOC), Maff Glover (MG), Jane Mulcahy (JM), Adrian Hill (AH)
Cambridge: Luke Abraham (LA), Paul Griffiths (PTG)
Leeds: Mark Richardson (MR), Hamish Gordon (HG), Kirsty Pringle (KP), Dan Grosvenor (DG), Masaru Yoshioka (MY), Chris Dearden (CD)
Reading:
Lancaster: Ewa Bednarz (EB)
Edinburgh:
UEA:
NIWA: Olaf Morgenstern (OM)
CSIRO: Ashok Luhar (AL)
Apologies: NB, SAN
Actions from this meeting
One-off actions
- (ongoing) LA to migrate PUMA UM tickets to MOSRS - see table below.
- (ongoing) LA to open tickets for all changes that still require a ticket.
- (ongoing) MD to collate all UKCA parameters into
ukca_constants
in advance of removing duplicates already available in the UM and circulate details and progress for vn11.4 - (ongoing) LA to put
C_SPECIES
definitions in the Redundant Code table (short-term), and switch to useM_SPECIES
instead. Talk with JH about AQUM tests and requirements. Note that there will be problems with exoplanets and >100km top configs where M_air not constant. LA to make a branch and progress for vn11.4. - (ongoing) NLA/MD make script for perpetual nudging (symbolic linking to existing files).
- (ongoing) LA to create Wiki page on UKCA website for users to add details of configurations and input files.
- (new) LA to discuss with Leeds plans for a separate repository.
- (ongoing) FOC to see what action can be taken from MASS, then put out an email for POCs from institutes. FOC/AH/MD to develop a strategy on MASS for discussion at next CMG as a data clear-out is required.
- (ongoing) CH working on ticket/bugfix for SO2 deposition. Will need to be on a switch for UKESM
- (ongoing) LA to contact AS/AJH and ask how best to proceed with removing the depreciated NetCDF attribute options.
- (new) FOC to encourage Garry Hayman to start lodging JULES code piecemeal.
- (new) LA to progress bug #87 on a switch.
- (new) JM to find someone to progress bug #104.
- (new) ALL to read API document and send comments to JH.
- (new) AH to talk to UM Systems Team.
- (new) LA to email UKCA vn11.4 developers regarding potential vn11.5 UKCA release and ask for feedback.
- (new) ALL to send any comments regarding proposed emissions changes to FOC within next 3 weeks before work will start.
- (new) JM to approach SW regarding model dust
- (new) FOC to approach AJ regarding stratospheric aerosol updates
- (new) LA to email GM and ask how GLOMAP would differ from how it is in other models (e.g. CTM, IFS etc.)
- (new) LA to send list to UKCA SMG
- UKCA API
- Review UKCA tests to cover all requirements
- Bug #87 (YSTORE/H2SO4)
- Updates/fixes to GLOMAP routines
- Standalone UKCA configurations
- Emissions flexibility
- Separare UKCA repository
- Chunking of chemistry solver
- ACTIVATE optimisation
- FastJX-GLOMAP coupling
- NaNs found with new schemes turned on (bug #106)
- CSIRO dry-deposition work
- Fixes for chemistry rates and ASAD (bugs #101 & #103)
- Rc fixes for water (bug #104)
- UKCA STASHmaster PP-codes
- Removal of redundant code
- (new) LA to circulate details of rose-stem ticket
- (new) LA to send round Doodle poll for first 2 weeks of June.
- (new) AJH and MD to chase up issues with ukca_bugs mailing list.
Standing actions
- (ongoing - standing item) CMG to monitor list of bugs and circulate between group for owners.
- (ongoing - standing item) At CMG future meetings there should be included an appendix listing the open bugs. If a ticket is included it is not an open bug (as the owner of ticket is person doing lodging).
- (ongoing - standing item) ALL with access to keep monitoring ukca_bugs email list.
- (ongoing - standing item) ALL to think about if code changes will change KGO and let systems team know in good time, and remember to include the UKCA & SC0138 keywords to all UKCA tickets. This should be a standard part of our working practice. Note also the required keywords.
- (ongoing - standing item) ALL to note, review, and remove obsolete/redundant code
- (ongoing - standing item) ALL closed ticket owners to produce a summary of their change for the UKCA newsletter
- (ongoing - standing item) Code Owner to produce draft newsletter for CMG to approve.
Minutes
Actions from the Last Meeting (LA)
Minutes of the code management group meeting 2019-01-25
- (ongoing) MY to check GLOMAP-mode code and report any missing bug fixes on the bugfixes page.
- closed
- (ongoing) GM/MY to arrange telecon with LA when MY starts.
- closed
- (ongoing) LA to migrate PUMA UM tickets to MOSRS - see table below.
- ongoing
- (ongoing) LA to open tickets for all changes that still require a ticket.
- ongoing
- (ongoing) FOC to recommend at next Exec meeting a policy of allowing only CMG to (certify and) distribute any UKCA configurations for science purpose.
- closed
- (ongoing) MD to collate all UKCA parameters into
ukca_constants
in advance of removing duplicates already available in the UM and circulate details and progress for vn11.4- ongoing
- (ongoing) LA to put
C_SPECIES
definitions in the Redundant Code table (short-term), and switch to useM_SPECIES
instead. Talk with JH about AQUM tests and requirements. Note that there will be problems with exoplanets and >100km top configs where M_air not constant. LA to make a branch and progress for vn11.4.- ongoing
- (ongoing) AJH to open ticket and assign to himself regarding loops over imode+n and imode-n UM:#4284. Currently code is inflexible when adding modes. AJH to discuss with GM offline.
- closed
- (ongoing) LA to make instructions as to make UM11.0 release job transient.
- closed - MD created and will link on Wiki.
- (ongoing) NLA/MD make script for perpetual nudging (symbolic linking to existing files).
- ongoing - LA to check MD script
- (new )HG to send MD suite-id for L70 job that has nudging errors.
- closed
- (ongoing) LA to create Wiki page on UKCA website for users to add details of configurations and input files.
- ongoing
- (new) LA to discuss with Leeds plans for a separate repository.
- ongoing
- (ongoing) NLA to contact CEJ (cc JM) about trace-gas convective plume scavenging and how this will be impacted (or impact) the repository work, and LA to forward proposal to CEJ/JM
- closed - JH and CEJ to consider offline.
- (ongoing) FOC to see what action can be taken from MASS, then put out an email for POCs from institutes. FOC/AH/MD to develop a strategy on MASS for discussion at next CMG as a data clear-out is required.
- ongoing - FOC & AH have agreed on split of institutes
- (ongoing) JM to take make a UM ticket for redundant code item #6 (Wet oxidation of SO2 in GLOMAP). Keep GM/MY in the loop.
- closed
- (new) LA to make a separate telecon to consider actions to link various GLOMAP actions as a whole
- (ongoing) LN to l_fix_nh4no3_equilibrium in rose-stem and jobs and remove if necessary. AJH to Sci/Tech.
- closed
- (ongoing) CH working on ticket/bugfix for SO2 deposition. Hopes to lodge vn11.4, will need to be on a switch for UKESM
- ongoing - won't make vn11.4
- (ongoing) LA, JM, CEJ, SAN to discuss rate fixes offline and keep GM in loop.
- closed
- (ongoing) LA to contact AS/AJH and ask how best to proceed with removing the depreciated NetCDF attribute options.
- ongoing - will also need to consider LFRic at some point as well
- (new) ALL to check whether unused functions, subroutines, modules listed under redundant code 19 are still required, see vn11.3_remove_redundant_UKCA_code
- closed - AJH to send to SciTech ASAP
- (new) ALL to give feedback within 1 month on proposed PPFC changes.
- closed - set to 0 for new STASH items
- (new) LA to send round Doodle poll for March/April.
Standing actions
- (ongoing - standing item) CMG to monitor list of bugs and circulate between group for owners.
- (ongoing - standing item) At CMG future meetings there should be included an appendix listing the open bugs. If a ticket is included it is not an open bug (as the owner of ticket is person doing lodging).
- (ongoing - standing item) ALL with access to keep monitoring ukca_bugs email list.
- (ongoing - standing item) ALL to think about if code changes will change KGO and let systems team know in good time, and remember to include the UKCA & SC0138 keywords to all UKCA tickets. This should be a standard part of our working practice. Note also the required keywords.
- (ongoing - standing item) ALL to note, review, and remove obsolete/redundant code
- (ongoing - standing item) ALL closed ticket owners to produce a summary of their change for the UKCA newsletter
- (ongoing - standing item) Code Owner to produce draft newsletter for CMG to approve.
Bugs/Bugfixes (LA)
Open Bugs
# | Description | Ticket | Owner | Status/ Updates | Comments from previous meetings | Comments from this meeting |
---|---|---|---|---|---|---|
35 | Error in labelling: Surface resistance <--> stomatal resistance ? | UM:#1409 | Fiona O'Connor | Leave open. Garry Hayman started work in offline JULES. Still ongoing. JM found bug in SO2 deposition, where there is an inconsistency when changing tiles. Making progress. |
Leave open. GH gave update, has done a lot of work. Concerned it might not be bit-reproducable, but could be solvable. Encouraging to lodge existing. Resistances done as metadata. Not clear as to timescales. ACTION: FOC to encourage Garry Hayman to start lodging JULES code piecemeal. | |
87 | Possible issues with YSTORE in UKCA_CHEMISTRY_CTL. This may mean than there is no H2SO4 because of this, with impacts on GLOMAP aerosols. Need to also select the correct products in chemistry_ctl. Combination of two different bugs - see r61958_vn10.8_cos_mmr_value_so2_2 | UM:#3245 | Luke Abraham | Leave open. NLA to have another look. MS may have changed things with OMP changes. Original fix didn't consider everything. LA to progress for vn11.4, Catherine Hardacre to do for vn11.0/vn11.1. Test for AerChemMIP. Leeds have vn11.2 branch. Use versioning system and apply for column. |
ACTION: LA to progress bug #87 on a switch. | |
101 | Errors in reaction rates and diagnostics | UM:#4466 | Luke Abraham / Scott Archer-Nicolls | There is a need to conserve science config for UKESM1, so changes need to be on a flag. Colin has been looking at DMSO, as this is not currently used in StratTrop but is in Offline. Might be able to merge the rate with CEJ changes, but best to leave the diagnostic issues as a separate change. LA, JM, CEJ, SAN to discuss offline and keep GM in loop. Use versioning system. Talk about further offline. |
Keep ongoing. | |
103 | Incorrect indexing of tmprc array: ASAD_SPIMPMJP | UM:#4562 | Scott Archer-Nicolls | Breaks KGO - affects solver convergence. In practice doesn’t make a huge difference, but should go into vn11.4, but does change KGO. UKESM1 - small change might be OK - get in touch for advice - might be able to test with UKESM1 AMIP only. Check with Oliver Wild | Could be rolled-up with #101 | |
104 | Incorrect value for Rc for SO_2 deposition to open water | UM:#4635 | Catherine Hardacre | See above, covered already. | Got to be separate to #35, unless there is an idea of timelines. ACTION: JM to find someone to progress bug #104. | |
106 | NaNs appearing when new UKCA science is turned on | UM:#4397 | Luke Abraham | in progress |
Redundant Code (LA)
Code for deletion
PLEASE REMEMBER TO EDIT THE ORIGINAL REDUNDANT CODE TABLE AND NOT THIS PAGE
# | Description | Ticket | Remarks | Status | Timeframe | Owner | Comments from previous meetings | Comments from this meeting |
---|---|---|---|---|---|---|---|---|
2 | Old dry deposition scheme | UM:#2356 | None | PROPOSED | Medium-term | Nick Savage | ||
4 | ukca_strat_update.F90 - relax_ozone | UM:#1505 | None | PROPOSED | Medium-term | Luke Abraham | ||
5 | Backward Euler Standard Tropospheric Chemistry | UM:#1507 | None | PROPOSED | Medium-term | Fiona O'Connor | ||
6 | Wet oxidation of SO2 in GLOMAP | UM:#4475 | None | PROPOSED | Medium-term | Colin Johnson | JM to look at this re: UKESM1 c.f. offline GLOMAP. JM to take ownership. | |
7 | Updraft velocity - l_conv_tke | UM:#3668 | Proposed in December 2017. Approval being sought for GA series (likely GA8). | PROPOSED | Medium-term | Alan J Hewitt / Ian Boutle | ||
8 | All backward Euler chemistry schemes | None | Note that this is only for the “hard-coded” BE schemes. Quite a lot of work would be involved, but good as a longer-term aim. Note that problems for AQUM would need to be addressed first. | PROPOSED | Long-term | Luke Abraham | ||
9 | Deprecated UKCA netcdf attribute options | UM:#2513 | 'emission_type', string type attributes no longer recommeneded. Need some time for most new code to adopt these. Still used in AQUM files. | DEPRECATED | Medium-term | Nick Savage | AQUM are addressing the files. Have gone from operational jobs, have ticket to remove from rose-stem. LN to document. These have been removed from AQUM. AQUM work has been done. |
|
10 | ASAD families chemistry | None | Families chemistry has not been used for many years (since at least UM6.1. It is likely that it no longer works if turned on, and it complicates the code making other developments harder | DEPRECATED | Short-term | Luke Abraham | ||
11 | Dry deposition 9 PFT option | None | The 13 PFT option has been adopted for UKESM1. The 9 PFT option is possibly not being used at all. Proposed in June 2018. |
PROPOSED | Long-term | Alan J Hewitt | ||
12 | Remove explicit C_SPECIES constants and calculate these from M_SPECIES and the mass of air |
None | Will have wide-ranging rose-stem KGO breakages | PROPOSED | Short-term | Luke Abraham | ||
13 | Remove temporary logical l_fix_nacl_density Introduced at UM:#2405 |
UM:#3490 | Requires AMIP testing and a GMED ticket Could be accepted to GA9 |
PROPOSED | Medium-term | Jane Mulcahy | See JM GMED action | |
15 | Remove temporary logical l_fix_ukca_impscav Introduced at UM:#1421 |
UM:#4145 | Approval being sought for GA series (likely GA9) GMED:#402 |
PROPOSED | Medium-term | Alan J Hewitt | See JM GMED action | |
16 | Remove temporary logical l_fix_improve_drydep Introduced at UM:#1250 |
UM:#3997 | Approval being sought for GA series (likely GA9) GMED:#393 |
PROPOSED | Medium-term | Alan J Hewitt | See JM GMED action | |
17 | Remove temporary logical l_fix_ukca_h2dd_x Introduced at UM:#4157 |
UM:#4245 | Approval being sought for GA series (likely GA9) GMED:#410 |
PROPOSED | Medium-term | Alan J Hewitt | See JM GMED action | |
18 | Remove temporary logical l_fix_neg_pvol_wat Introduced at UM:#4383 |
UM:#4416 | Approval being sought for GA series (likely GA9) GMED:#421 |
PROPOSED | Medium-term | Alan J Hewitt | ||
19 | Remove MODULEs/SUBROUTINEs/FUNCTIONs within UKCA not called within the UM: SUBROUTINE asad_dealloc_chemdiag FUNCTION cd_findspeciesloc SUBROUTINE asad_lin_diagnostic MODULE asad_emissn_mod and SUBROUTINE asad_emissn FUNCTION prcount MODULE asad_inemit_mod and SUBROUTINE asad_inemit MODULE asad_inhet_mod and SUBROUTINE asad_inhet MODULE asad_inphot_mod and SUBROUTINE asad_inphot SUBROUTINE asad_mod_final MODULE asad_ycn_mod and SUBROUTINE asad_ycn MODULE quanto1d_mod and SUBROUTINE quanto1d SUBROUTINE activmkpdf MODULE ukca_fixedsb_mod and SUBROUTINE ukca_fixedsb SUBROUTINE deallocate_radaer_struct SUBROUTINE ukca_relax_ozone |
UM:#4512 | Not called within UM Need to decide whether any should be kept vn11.3_remove_redundant_UKCA_code |
DEPRECATED | Short-term | Alan J Hewitt | All to look at subroutines not being called. |
UKCA API redesign
JH has been working on redesigning the UM-UKCA interface to remove the model specific coupling. His proposed design document can be found here:
JH described where this was heading in terms of design. It would allow UKCA to couple to other models independent of the UM. There is a provisional list of tickets in the appendix of above document. The first “standalone” code version hopefully by UM11.6. Diagnostics more problematic, similarly with plume scavenging. Some initialisations taken outside of UKCA main. All bit-compares and shouldn’t affect results. Yet to hear back from UM Sys.
ACTION: ALL to read API document and send comments to JH.
Potential closed release for vn11.5.
ACTION: AH to talk to UM Systems Team.
ACTION: LA to email UKCA vn11.4 developers regarding potential vn11.5 UKCA release and ask for feedback.
Emissions
The minutes of the UKCA emissions discussion can be found here:
Please see the document for further details.
The aim is to remove restrictions, and implement tracking_id and add a pop-up warning to remove prescribed files. This should also improve functionality for vertical profiles/emissions.
ACTION: ALL to send any comments regarding proposed emissions changes to FOC within next 3 weeks before work will start.
GLOMAP telecon
on 2019-03-12 LA, JH, GM, & MY met and discussed various GLOMAP actions. MY has made great progress in creating vn11.0 branches of developments made at earlier versions, and work has been ongoing to validate the changes at vn11.0 with the equivalent functionality at earlier versions.
There was one action:
- GM and MY to share technical document on vn11.0 work done for 1st April UKCA CMG - see below:
It was suggested to lodge changes separately, and also to check with Cat Scott to check whether code is up-to-date with latest literature (e.g. with SOA). MY is now working on something else, so cannot work on this further. We could ask Steph Woodward to look at Dust and perhaps Andy Jones could look at Stratospheric aerosol.
ACTION: JM to approach SW
ACTION: FOC to approach AJ
ACTION: LA to email GM and ask how GLOMAP would differ from how it is in other models (e.g. CTM, IFS etc.)
Priorities for the next year
Following the first meeting of the UKCA Science and Management Group on 2019-03-22 at the Met Office, this group has been asked to supply a list of priorities for the next year. The provisional list below could serve as a prompt for the discussion.
- UKCA API
- Review UKCA tests to cover all requirements
- Bug #87 (YSTORE/H2SO4)
- Updates/fixes to GLOMAP routines
- Standalone UKCA configurations
- Emissions flexibility
- Separare UKCA repository
- Chunking of chemistry solver
- ACTIVATE optimisation
- FastJX-GLOMAP coupling
- NaNs found with new schemes turned on (bug #106)
- CSIRO dry-deposition work
- Fixes for chemistry rates and ASAD (bugs #101 & #103)
- Rc fixes for water (bug #104)
- UKCA STASHmaster PP-codes
- Removal of redundant code
ACTION: LA to send list to UKCA SMG
ACTION: LA to circulate details of rose-stem ticket: um:#4397
Use of PP codes in UKCA STASHmaster_A entries
Update from Jamie Kettleborough:
[W]e met last week – and one of the meeting attendee’s thinks that UKCA pp codes are used in the MO verification system. We’re following up to try to understand. I think this doesn’t affect the policy of assigning new UKCA diagnostics pp codes a value of 0, but it could mean we should leave current diagnostics as is.
UKCA Suites (LA/MD)
- GA7.1 release notes: Release Job UM11.0
- List of suites (all versions/platforms): GA7.1 StratTrop suites
- Testing suites (all versions): Rose-UKCA_suites
Targets for vn11.4 (and beyond) (LA)
See details of the 7th March UM Developers and Owner's Group.
PLEASE REMEMBER TO:
- INCLUDE THE KEYWORDS: UKCA & SC0138.
- ASSIGN THE TICKET AFTER ITS CREATION. NO TICKETS SHOULD BE LEFT AS NEW.
If you do not think that you will make the vn11.4 deadline please bump your ticket to vn11.5 or hopefully.
UM vn11.4 code review submission deadline is 31st May 2019 for ALL ticket types.
AOB/DNM (LA)
Date of next meeting (LA)
ACTION: LA to send round Doodle poll for first 2 weeks of June.