From CC Doc
Jump to: navigation, search
Other languages:
English • ‎français

Data and Storage Migration[edit]

Why are some legacy systems being replaced?[edit]

The systems slated for replacement are mostly built from aging hardware that can no longer be maintained, or maintained at reasonable cost. Replacing these legacy systems with new national systems will consolidate resources and centralize services, leading to more efficient use of taxpayer money and addressing urgent and pressing needs of Canadian researchers for new and expanded capabilities.

If I am told I have to migrate off a legacy system, when will I need to move my data?[edit]

Dates vary by system. The support teams for the specific systems you use will contact you to ensure you receive ample advance notice of any action you must take. Please ensure the contact information we have for you is up to date. You can confirm or update your details by logging into the Compute Canada DataBase (CCDB), clicking on "My Account", and clicking “Change Contact Information”.

I would be interested in voluntarily moving to one of the new systems. What should I do?[edit]

Many users are eager to migrate to one of the National systems as soon as possible. We will make a major announcement when each new system becomes available for general use. Please refer to our Best practices for data migration page and if you require assistance, please contact support@computecanada.ca or your local support team.

How will I move my files off a legacy system and onto a new system?[edit]

We recommend using Compute Canada’s Globus service to move your files. See also Transferring data for related documentation, including alternatives to Globus.

What files should I move?[edit]

Prior to migrating your data, we strongly encourage you to clean up your files and directories by removing any duplicate or non-essential data. Moving less data will take less time, resulting in less disruption to your research work. Please refer to the General Directives for Migration page for documentation as to how to clean and prepare your files.

How long will it take to move my data?[edit]

Depending on how much data you have and how much load there is on the machines and network, it can range from hours to days to complete your file transfers. Expect hundreds of gigabytes to take hours to transfer, but give yourself days in case there is a problem. Expect terabytes to take days.

Am I at risk of losing any data during this migration process?[edit]

Compute Canada's priority throughout this process is to ensure that your data is transferred safely and securely. Hands-on technical assistance is available if needed through our support team. Please contact support@computecanada.ca if you have specific questions about your data.

Who can I contact if I have questions about migration?[edit]

If you cannot find an answer to your questions here, you can contact support@computecanada.ca or the local support teams listed here.

New Systems[edit]

Where do I find descriptions of the new systems?[edit]

The new general-purpose clusters are described here, and new cloud resources here.

Will the software I need be available on the new systems?[edit]

The Research Support National Team has developed a comprehensive list of software to be installed on the new general-purpose systems.

A detailed list of configured software can be found here. This list is automatically updated as packages are installed or updated.

  • Free applications supported by one of Compute Canada’s regional partners will probably have their latest version available on Cedar and Graham.
  • Packages governed by a paid license will be made available on a case-by-case basis. Requests for additional software should be directed to support@computecanada.ca.

When can I start testing the new systems?[edit]

The cloud systems (east.cloud and west.cloud) are available now. The general purpose machines Cedar and Graham are scheduled for general availability in May, 2017. They may be available for testing earlier. Please contact support@computecanada.ca or your local support team for more details.

How do I log in to the new systems?[edit]

Please see Getting started.

How do I ask for special software on the new systems?[edit]

Send email to support@computecanada.ca

Will my username or password change?[edit]

Your username and password on the new systems will be the same username and password you use to log into CCDB.

See User Accounts and Groups for more information.

What will the new National Data Storage Infrastructure look like?[edit]

See National Data Cyberinfrastructure.

When can I access the new Object Storage System?[edit]

The WOS solution is currently under development by our provider DDN. Availability to users is planned for mid-2017

Legacy Systems[edit]

How long will the legacy systems (or my favourite legacy system) be available?[edit]

Specific dates vary by system, and not all decommissioning dates have been fixed yet. Please ask the local support team for the legacy system in question. For an overall picture of the national platform technology renewal schedule, please refer to Compute Canada's Technology Briefing shared in November 2016.

I use Hungabee for large shared memory jobs. What are my options on the new national systems?[edit]

Hungabee was a special purpose, large shared memory system which is not being replaced as part of this latest technology renewal. Cedar and Graham will include a few nodes of up to 3 TB in memory which will serve most users with large memory requirements. In the few months before Cedar and Graham are available other regions in Compute Canada maybe able to offer some relief. For example the Centre for Advanced Computing (Ontario) has some 2 TB nodes available. If you have very large shared memory requirements then please contact support@westgrid.ca.

Compute Canada Data Base

Globus is a file transfer service