Visualization/fr: Difference between revisions

Jump to navigation Jump to search
Updating to match new version of source page
No edit summary
(Updating to match new version of source page)
Line 27: Line 27:


= Nouvelles grappes de Calcul Canada =
= Nouvelles grappes de Calcul Canada =
== Start a remote desktop via VNC ==
Frequently, it may be useful to start up graphical user interfaces for various software packages like Matlab. Doing so over X-forwarding can result in a very slow connection to the server, one useful alternative to X-forwarding is using VNC to start and connect to a remote desktop.
For more information, please see the article on [[VNC]].


==Mode client-serveur ParaView avec GPU sur Cedar et Graham==
==Mode client-serveur ParaView avec GPU sur Cedar et Graham==
Line 141: Line 147:
Si le rendu doit s'effectuer sur un nœud de calcul, le temps d'attente peut être plus long.
Si le rendu doit s'effectuer sur un nœud de calcul, le temps d'attente peut être plus long.
Une fois que le jeu de données est affiché dans ''Active source'' de VisIt, le moteur fonctionne et vous pouvez commencer à travailler sur votre graphe.
Une fois que le jeu de données est affiché dans ''Active source'' de VisIt, le moteur fonctionne et vous pouvez commencer à travailler sur votre graphe.
== Visualization on Niagara ==
=== Software Available ===
We have installed the latest versions of the open source visualization suites: VMD, VisIt and ParaView.
Notice that for using ParaView you need to explicitly specify one of the mesa flags in order to avoid trying to use openGL, i.e.,
after loading the paraview module, use the following command:
  paraview --mesa-swr
Notice that Niagara does not have specialized nodes nor specially designated hardware for visualization, so if you want to perform interactive visualization or exploration of your data you will need to submit an interactive job (debug job, see [[https://docs.scinet.utoronto.ca/index.php/Niagara_Quickstart#Testing]]).
For the same reason you won't be able to request or use GPUs for rendering as there are none!
=== Interactive Visualization ===
Runtime is limited on the login nodes, so you will need to request a testing job in order to have more time for exploring and visualizing your data.
Additionally by doing so, you will have access to the 40 cores of each of the nodes requested.
For performing an interactive visualization session in this way please follow these steps:
<ol>
<li> ssh into niagara.scinet.utoronto.ca with the -X/-Y flag for x-forwarding
<li> request an interactive job, ie.</li>
  debugjob
this will connect you to a node, let's say for the argument "niaXYZW"
<li> run your favourite visualization program, eg. VisIt/ParaView </li>
  module load visit
  visit
  module load paraview
  paraview --mesa-swr
<li> exit the debug session.
</ol>
=== Remote Visualization -- Client-Server Mode ===
You can use any of the remote visualization protocols supported for both VisIt and ParaView.
Both, VisIt and ParaView, support "remote visualization" protocols.
This includes:
<ul>
<li>  accessing data remotely, ie. stored on the cluster
<li> rendering visualizations using the compute nodes as rendering engines
<li> or both
</ul>
==== VisIt Client-Server Configuration ====
For allowing VisIt connect to the Niagara cluster you need to set up a "Host Configuration".
Choose *one* of the methods bellow:
====Niagara Host Configuration File====
You can just download the Niagara host file, right click on the following link [https://support.scinet.utoronto.ca/~mponce/viz/host_niagara.xml host_niagara.xml] and select save as...
Depending on the OS you are using on your local machine:
<ul>
<li> on a Linux/Mac OS place this file in <code>~/.visit/hosts/</code>
<li> on a Windows machine, place the file in  <code>My Documents\VisIt 2.13.0\hosts\</code>
</ul>
Restart VisIt and check that the niagara profile should be available in your hosts.
====Manual Niagara Host Configuration====
If you prefer to set up the verser yourself, instead of the configuration file from the previous section, just follow along these steps.
Open VisIt in your computer, go to the 'Options' menu, and click on "Host profiles..."
Then click on 'New Host' and select:
Host nickname = niagara
Remote host name = niagara.scinet.utoronto.ca
Username = Enter_Your_OWN_username_HERE
Path to VisIt installation = /scinet/niagara/software/2018a/opt/base/visit/2.13.1
Click on the "<code>Tunnel data connections through SSH</code>", and then hit Apply!
{| align="center"
| [[File:Visit_niagara-01.png|480px|]]
|}
Now on the top of the window click on 'Launch Profiles' tab.
You will have to create two profiles:
<ol>
<li> <code>login</code>: for connecting through the login nodes and accessing data </li>
<li> <code>slurm</code>: for using compute nodes as rendering engines </li>
</ol>
For doing so, click on 'New Profile', set the corresponding profile name, ie. login/slurm.
Then click on the Parallel tab and set the "Launch parallel engine"
For the slurm profile, you will need to set the parameters as seen below:
<br style="clear:both" />
{| align="center"
| [[File:Visit_niagara-02.png|400px|]]
| [[File:Visit_niagara-03.png|400px|]]
|}
<br style="clear:both" />
Finally, after you are done with these changes, go to the "Options" menu and select "Save settings", so that your changes are saved and available next time you relaunch VisIt.
==== ParaView Client-Server Configuration ====
Similarly to VisIt you will need to start a <code>debugjob</code> in order to use a compute node to files and compute resources.
Here are the steps to follow:
<ol>
<li> Launch an interactive job (debugjob) on Niagara,</li>
  debugjob
<li> After getting a compute node, let's say niaXYZW, load the ParaView module and start a ParaView server,</li>
  module load paraview
  pvserver --mesa-swr-ax2
The <code>--mesa-swr-avx2</code> flag has been reported to offer faster software rendering using the OpenSWR library.
<li> Now, you have to wait a few seconds for the server to be ready to accept client connections.</li>
  Waiting for client...
  Connection URL: cs://niaXYZW.scinet.local:11111
  Accepting connection(s): niaXYZW.scinet.local:11111
<li> Open a new terminal without closing your debugjob, and ssh into Niagara using the following command,</li>
  ssh YOURusername@niagara.scinet.utoronto.ca -L11111:niaXYZW:11111 -N
this will establish a tunnel mapping the port 11111 in your computer (<code>localhost</code>) to the port 11111 on the Niagara's compute node, <code>niaXYZW</code>, where the ParaView server will be waiting for connections.
<li> Start ParaView on your local computer, go to "File -> Connect" and click on 'Add Server'.
You will need to point ParaView to your local port <code>11111</code>, so you can do something like</li>
name = niagara
server type = Client/Server
host = localhost
port = 11111
then click Configure, select <code>Manual</code> and click Save.
<li> Once the remote server is added to the configuration, simply select the server from the list and click Connect.
The first terminal window that read <code>Accepting connection...</code> will now read <code>Client connected</code>.
<li> Open a file in ParaView (it will point you to the remote filesystem) and visualize it as usual.
</ol>
====Multiple CPUs====
For performing parallel rendering using multiple CPUs, <code>pvserver</code> should be run using <code>srun</code>, ie. either submit a job script or request a job using
<source lang="bash"> salloc --ntasks=N*40 --nodes=N --time=1:00:00</source>
  module load paraview
  srun pvserver --mesa
==== Final Considerations ====
Usually both VisIt and ParaView require to use the same version between the local client and the remote host, please try to stick to that to avoid having incompatibility issues, which might result in potential problems during the connections.
=== Other Versions ===
Alternatively you can try to use the visualization modules available on the CCEnv stack, for doing so just load the CCEnv module and select your favourite visualization module.


== Mode client-serveur sur une instance infonuagique ==
== Mode client-serveur sur une instance infonuagique ==
Line 244: Line 403:
En ouvrant un fichier (''File -> Open file... -> Host = Cloud West''), vous devriez voir le système de fichiers de l’instance. Chargez et visualisez un fichier. Le traitement des données et le rendu devraient s’effectuer sur l’instance alors que le résultat et les contrôles de l’interface utilisateur seront affichés sur le poste de travail.
En ouvrant un fichier (''File -> Open file... -> Host = Cloud West''), vous devriez voir le système de fichiers de l’instance. Chargez et visualisez un fichier. Le traitement des données et le rendu devraient s’effectuer sur l’instance alors que le résultat et les contrôles de l’interface utilisateur seront affichés sur le poste de travail.


<div class="mw-translate-fuzzy">
= Formation =  
= Formation =  
* 2018-01-24 : ''Advanced Techniques for Visualization of Very Large Datasets'', Université de la Colombie-Britannique, campus Okanagan (Kelowna)
* 2018-01-24 : ''Advanced Techniques for Visualization of Very Large Datasets'', Université de la Colombie-Britannique, campus Okanagan (Kelowna)
* 2018-01-31 : séminaire web ''Novel visualization techniques from the Visualize This competition''
* 2018-01-31 : séminaire web ''Novel visualization techniques from the Visualize This competition''
* 2018-05-16 : ''Scientific visualization with ParaView'', Université de Northern British Columbia, Prince George
* 2018-05-16 : ''Scientific visualization with ParaView'', Université de Northern British Columbia, Prince George
</div>
Please let us know if you would like to see a visualization workshop at your institution.


= Documentation de Calcul Canada =
= Documentation de Calcul Canada =
35,412

edits

Navigation menu