cc_staff
172
edits
AI and Machine Learning: Difference between revisions
Jump to navigation
Jump to search
m
no edit summary
(remove Compute Canada ref) |
mNo edit summary |
||
| Line 11: | Line 11: | ||
<!--T:26--> | <!--T:26--> | ||
If you are ready to port your program for using on a | If you are ready to port your program for using on a Alliance cluster, please follow [[Tutoriel_Apprentissage_machine/en|our tutorial]]. | ||
<!--T:36--> | <!--T:36--> | ||
A user-made tutorial showing all the steps necessary for setting up your local and | A user-made tutorial showing all the steps necessary for setting up your local and Alliance environments for deep learning in Python is available [https://prashp.gitlab.io/post/compute-canada-tut/ here] | ||
== Python == <!--T:3--> | == Python == <!--T:3--> | ||
| Line 64: | Line 64: | ||
<!--T:13--> | <!--T:13--> | ||
* Filesystem [[Storage and file management#Filesystem_quotas_and_policies|quotas]] on | * Filesystem [[Storage and file management#Filesystem_quotas_and_policies|quotas]] on Alliance clusters limit the number of filesystem objects; | ||
* Your software could be significantly slowed down from streaming lots of small files from <tt>/project</tt> (or <tt>/scratch</tt>) to a compute node. | * Your software could be significantly slowed down from streaming lots of small files from <tt>/project</tt> (or <tt>/scratch</tt>) to a compute node. | ||