cc_staff
353
edits
AI and Machine Learning: Difference between revisions
Jump to navigation
Jump to search
Avoid Anaconda
No edit summary |
(Avoid Anaconda) |
||
| Line 11: | Line 11: | ||
<!--T:4--> | <!--T:4--> | ||
Python is very popular in the field of machine learning. If you (plan to) use it on our clusters, please refer to [[Python|our documentation about Python]] to get important information about Python versions, virtual environments on login or on compute nodes, <tt>multiprocessing</tt>, Anaconda, Jupyter, etc. | Python is very popular in the field of machine learning. If you (plan to) use it on our clusters, please refer to [[Python|our documentation about Python]] to get important information about Python versions, virtual environments on login or on compute nodes, <tt>multiprocessing</tt>, Anaconda, Jupyter, etc. | ||
== Avoid Anaconda == | |||
We ask our users to avoid using Anaconda, and use virtualenv instead. Here are the reasons: | |||
* Tries to handle library management that should be reserved to staff | |||
** Ships binaries unoptimized for specific CPU architecture | |||
** Makes wrong assumptions about library locations | |||
* Installs in /home by default, where it puts a large number of files (Virtual envs should be installed on compute node as much as possible) | |||
* Slower to install packages | |||
* Modifies bashrc, which can cause conflicts | |||
'''Switching to virtualenv is easy in most cases. Just install all the same packages, except CUDA, CuDNN and other low level libraries, which are already installed on our clusters.''' | |||
= Useful information about software packages = <!--T:5--> | = Useful information about software packages = <!--T:5--> | ||