MONSooN IBM to Cray Transition

From UKCA

This page details porting efforts of various UKCA configurations from the MONSooN ibm02 system to the xcml00 system.

Some central information can be found here: http://collab.metoffice.gov.uk/twiki/bin/view/Support/CrayUMInstall

vn8.4 GA4.0 UKCA CheST+GLOMAP-mode RJ4.0

As this job is already configured to run on ARCHER, there were no code changes required. 

Job xlsjc Title cp w: RJ4.0 MONSooN xcm GA4.0 vn8.4 UKCA CheST+GLOMAP-mode TS2000
Job xlsjw Title RJ4.0 MONSooN ibm02 GA4.0 vn8.4 UKCA CheST+GLOMAP-mode TS2000
Difference in window personal_gen
 -> Model Selection
   -> User Information and Submit Method
     -> General details
Radio button: Account
 Job xlsjc: Entry is set to 'External'
 Job xlsjw: Entry is inactive
Entry box: Account name:
 Job xlsjc: Entry is set to 'ukca-cam'
 Job xlsjw: Entry is inactive
Check box: Override Met Office user's default IBM Account Group
 Job xlsjc: Entry is set to 'ON'
 Job xlsjw: Entry is set to 'OFF'
Entry box: Mail-id for notification of end-of-run
 Job xlsjc: Entry is set to 'nla27@cam.ac.uk'
 Job xlsjw: Entry is set to 'nomail'
Entry box: Target Machine user-id:
 Job xlsjc: Entry is set to 'nlabra'
 Job xlsjw: Entry is set to 'USERID'

Difference in window subindep_SubmitMethod
 -> Model Selection
   -> User Information and Submit Method
     -> Job submission method
Entry box: Host name
 Job xlsjc: Entry is set to 'xcml00'
 Job xlsjw: Entry is set to 'ibm02'
Radio button: Define submission method
 Job xlsjc: Entry is set to qsub' for PBS Pro (Cray XC40)'
 Job xlsjw: Entry is set to 'LoadLeveler'

Difference in window subindep_FileDir
 -> Model Selection
   -> Input/Output Control and Resources
     -> Time Convention and SCRIPT Environment Variables.
Differences in Table Defined Environment Variables for Directories
 5,8c5,6
<  UKCA_DIR /projects/ukca-admin/inputs
<  UKCA_EMISS $UKCA_DIR/ancil/N96L85/emiss
<  UKCA_INIT $UKCA_DIR/initial
<  DATADIR /projects/ukca-cam/nlabra
---
>  UKCA_EMISS /projects/ukca/inputs/ancil/N96L85/emiss
>  UKCA_INIT /projects/ukca/inputs/initial

Difference in window subindep_HandEdit
 -> Model Selection
   -> Input/Output Control and Resources
     -> User hand edit files
Differences in Table Hand edits
 5c5
<  ~ukca/hand_edits/VN8.4/raderv2.0_vn84_MONSooN_XC40.ed Y
---
>  ~ukca/hand_edits/VN8.4/raderv2.1_vn84_MONSooN.ed Y

Difference in window subindep_FCM_Gen
 -> Model Selection
   -> FCM Configuration
     -> FCM Extract directories and Output levels
Entry box: Target machine root extract directory (UM_ROUTDIR)
 Job xlsjc: Entry is set to '/projects/ukca-cam/$USERID'
 Job xlsjw: Entry is set to '/projects/ukca/$USERID'

Difference in window subindep_FCM_UM_Opt
 -> Model Selection
   -> FCM Configuration
     -> FCM Options for Atmosphere and Reconfiguration
Check box: Use precompiled build
 Job xlsjc: Entry is set to 'OFF'
 Job xlsjw: Entry is set to 'ON'
Entry box: Container file name and location (UM_CONTAINER)
 Job xlsjc: Entry is set to '$UM_SVN_BIND/container.cfg@vn8.4_cfg'
 Job xlsjw: Entry is set to '$UM_SVN_BIND/container.cfg'
Entry box: Bindings location (UM_SVN_BIND)
 Job xlsjc: Entry is set to 'fcm:um_br/dev/um/vn8.4_machine_cfg/src/configs/bindings'
 Job xlsjw: Entry is set to '$UM_SVN_URL/src/configs/bindings'

Difference in window subindep_Compile
 -> Model Selection
   -> Compilation and Run Options
     -> Compile and run options for Atmosphere and Reconfiguration
Check box: Compile Reconfiguration executable
 Job xlsjc: Entry is set to 'ON'
 Job xlsjw: Entry is set to 'OFF'
Entry box: Directory for the Reconfiguration executable
 Job xlsjc: Entry is set to '$DATAW/bin'
 Job xlsjw: Entry is set to '/projects/ukca/Tutorial/vn8.4/prebuilds/Base/bin'

Difference in window subindep_Compile_User
 -> Model Selection
   -> Compilation and Run Options
     -> UM User Override Files
Differences in Table User file overrides
 1c1
<  ~luke/overrides/vn8.4/ARCHER_cce_vn804_acumps Y
---
>  ~luke/overrides/vn8.4/ibm_xlf_vn804_acumps Y

Difference in window atmos_Science_Section_UKCA_Rad
 -> Model Selection
   -> Atmosphere
     -> Scientific Parameters and Sections
       -> Section by section choices
         -> Section 34: UKCA Chemistry and Aerosols
           -> UKCA Chemistry Coupling
             -> MODE Aerosols in Radiation Scheme
Entry box: Directory path to UKCA_RADAER input files:
 Job xlsjc: Entry is set to '$UKCA_DIR/spectral/radv2.1'
 Job xlsjw: Entry is set to '/projects/ukca/inputs/spectral/radv2.1'
Entry box: Look-up table for accumulation-mode aerosols in the longwave:
 Job xlsjc: Entry is set to 'nml_ac_lw_new'
 Job xlsjw: Entry is set to 'nml_ac_lw'
Entry box: Look-up table for accumulation-mode aerosols in the shortwave:
 Job xlsjc: Entry is set to 'nml_ac_sw_new'
 Job xlsjw: Entry is set to 'nml_ac_sw'
Entry box: Look-up table for coarse-mode aerosols in the longwave:
 Job xlsjc: Entry is set to 'nml_cr_lw_new'
 Job xlsjw: Entry is set to 'nml_cr_lw'
Entry box: Look-up table for coarse-mode aerosols in the shortwave:
 Job xlsjc: Entry is set to 'nml_cr_sw_new'
 Job xlsjw: Entry is set to 'nml_cr_sw'

Difference in window atmos_InFiles_Start
 -> Model Selection
   -> Atmosphere
     -> Ancillary and input data files
       -> Start dump
Entry box: Directory name or DATAW
 Job xlsjc: Entry is set to '$UKCA_INIT'
 Job xlsjw: Entry is set to '/projects/ukca/inputs/initial'

Difference in window atmos_InFiles_PAncil_SST
 -> Model Selection
   -> Atmosphere
     -> Ancillary and input data files
       -> Climatologies & potential climatologies
         -> Sea surface temperatures
Entry box: Directory name or Environment Variable
 Job xlsjc: Entry is set to '$UKCA_DIR/ancil/surf'
 Job xlsjw: Entry is set to '/projects/ukca/inputs/ancil/surf'

Difference in window atmos_InFiles_PAncil_Seaice
 -> Model Selection
   -> Atmosphere
     -> Ancillary and input data files
       -> Climatologies & potential climatologies
         -> Sea ice fields
Entry box: Enter directory or Environment Variable
 Job xlsjc: Entry is set to '$UKCA_DIR/ancil/surf'
 Job xlsjw: Entry is set to '/projects/ukca/inputs/ancil/surf'

Difference in window atmos_InFiles_PAncil_SulpEmis
 -> Model Selection
   -> Atmosphere
     -> Ancillary and input data files
       -> Climatologies & potential climatologies
         -> Sulphur-Cycle Emissions (2D)
Entry box: Enter directory or Environment Variable
 Job xlsjc: Entry is set to '$UKCA_DIR/ancil/surf'
 Job xlsjw: Entry is set to '/projects/ukca/inputs/ancil/surf'

Difference in window subindep_ResQsub
Path to subindep_ResQsub not in navigation tree
Difference in variable CJTLIM2
 Job xlsjc: 10800
 Job xlsjw: Entry is inactive
Check box: Use Hyperthreads
 Job xlsjc: Entry is set to 'ON'
 Job xlsjw: Entry is inactive
Radio button: Class name
 Job xlsjc: Entry is set to 'normal'
 Job xlsjw: Entry is inactive

Additional changes to note are:

  • DATADIR currently needs to be manually set
  • Note the move to site based directories: e.g. /projects/ukca-cam/nlabra
  • The shared inputs directory is now under ukca-admin: /projects/ukca-admin/inputs
  • Pre-compiled builds should be turned off, and the location of the reconfiguration executable needs to be set.

Due to time constraints, no scaling testing or other NRUN/CRUN etc. tests have been performed. This will be remedied in several weeks time. Until then, a copy of the xcm job will not be copied to the xlav central experiment under the ukca UMUI user.

Retrieved from "http://www.ukca.ac.uk/wiki/index.php?title=MONSooN_IBM_to_Cray_Transition&oldid=4787"
Powered by MediaWiki