Recommendations for migration to new systems

From CC Doc
Jump to: navigation, search

Other languages:

Parent page: Migration to National Systems

Legacy system operations

Compute Canada has replaced most of its legacy systems with new national systems that consolidate resources and centralize services. Some of the legacy systems may continue in operation at the discretion of the institution or region which manages each system. Please ask the relevant institution or region if you want to know the plans for a specific system. A list of regional contacts can be found here.

2017/2018 and 2018/2019 mix of systems

The 2017/2018 and 2018/2019 resource allocation years are transition years with a mix of legacy and new systems available for use. Users on systems scheduled for decommissioning will have to choose which of the new or remaining legacy systems to move to.

  • New systems have better performance than old systems, but how much better depends strongly on the application. See "Specific software" below for available data.
  • Some legacy systems, though not yet decommissioned, will operate with limited vendor support and may suffer decreased reliability. Capacity (that is, the number of cores) is expected to decrease gradually as nodes fail and cannot be repaired. Contact regional support for the outlook for specific systems.
  • Cloud resources are available for users with very specific and customized software requirements, and for platforms and portals.

Cedar and Graham are very similar, general purpose, large systems. There is no particular difference which would recommend one over the other.

  • Hardware: There are different proportions of small- and large-memory nodes, and nodes with GPUs.
    • The high-performance interconnect is Intel OmniPath at Cedar and Infiniband at Graham. Performance is expected to be very similar.
    • For more details see the Cedar and Graham pages.
  • Software will be made available through a universal, standardized process. There will be minimal differences between the software available on each machine.

Niagara is aimed at large parallel jobs. It is most suited for jobs distributed across nodes using such tools as MPIMessage Passing Interface.

General migration recommendations

  • If you have a RAC allocation then your allocation letter indicated which systems you were allocated. We recommend that you move to your allocated system or systems as soon as possible.
    • Compute Canada is open to requests for migration to other machines if the allocated system is unsuitable in some way.
  • If you do not have a RAC allocation and your current system is being defunded/deactivated, then we recommend that you move to one of the new systems Cedar (GP2) or Graham (GP3) as soon as they become available.
    • Every user will be able to acquire a Rapid Access Service (RAS) account on any national system.
    • As a rule-of-thumb those users in western Canada (Saskatchewan to BC) should choose Cedar (GP2), and the rest should choose Graham (GP3). This has no particular technical justification; we merely hope this guidance will roughly balance the demand for these two systems.
    • You may also move to a different legacy system. This will be easiest if you are already familiar the legacy system. Please contact your regional support for details.
    • We encourage you to use the Rapid Access Service (RAS) to test your application's performance on new systems as early as possible.

You are encouraged to send trouble reports and requests for adjustments to as soon as you detect a problem. Compute Canada will provide in-depth consultation and support for migration issues.