Month: May 2018

Exercising Nvidia Volta V100 with POWER / Barreleye G2 – GPU burn

Leave a comment

At Open Compute and OpenPOWER conferences, we announced that we are building GPU configurations with our POWER9 Barreleye G2 server. This includes PCIe Volta V100 support and first of a kind SXM2 Volta V100 Support.

 

Image result for sxm2 barreleye g2

Part of support and validation process for these servers is to exercise or “burn” the GPUs to see the system level, power and thermal implications.

There are variety of tools to do this:  More open one , for ex: GPU burn utility, and bit more closed off Nvidia Validation Suite (NVVS) which part of their Data center GPU manager (DCGM) suite.

We are starting our validation with GPU Burn utility. The source we are using is here on github: https://github.com/wilicc/gpu-burn

We

So what is the GPU Burn utility doing ?

It forks one process for each GPU on the machine, one process for keeping track of the GPU temperatures if available (e.g. Fermi Teslas don’t have temp. sensors), and one process for reporting the progress. The GPU processes each allocate 90% of the free GPU memory, initialize 2 random 2048*2048 matrices, and continuously perform efficient CUBLAS matrix-matrix multiplication routines on them and store the results across the allocated memory.

So How do you compile and run GPU-BURN on POWER9 / Volta V100 ? What is the sample output like ? 

a) Install the correct NVIDIA Driver for your OS (In my case GV100 / Ubuntu 16.04, version 396.26 ): (Skip if already done)

  1. wget http://us.download.nvidia.com/tesla/396.26/nvidia-driver-local-repo-ubuntu1604-396.26_1.0-1_ppc64el.deb
  2. dpkg -i nvidia-driver-local-repo-ubuntu1604-396.26_1.0-1_ppc64el.deb

b) Install the correct NVIDIA CUDA Version ( CUDA 9.2 for POWER9 + Volta V100)  (Skip if already done)

  1. wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1604/ppc64el/cuda-repo-ubuntu1604_9.2.88-1_ppc64el.deb
  2. `sudo dpkg -i cuda-repo-ubuntu1604_9.2.88-1_ppc64el.deb`
  3. `sudo apt-key adv –fetch-keys http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1604/ppc64el/7fa2af80.pub`
  4. `sudo apt-get update`
  5.  sudo apt-get install cuda

c)  Get all the environment variables set and ready to go 

  1. export PATH=/usr/local/cuda-9.2/bin${PATH:+:${PATH}}
  2. export LD_LIBRARY_PATH=/usr/local/cuda-9.2/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}

d) REBOOT (Do NOT forget to reboot, Nvidia’s environment setup requires a proper reboot for all to be well)

e) Check all is well by listing your GPUs (Command 1 below) and checking the properties of GPUs ( Command 2 below) , and checking nvcc is setup (Command 3 below). If you don’t get a meaningful response, most likely something is off with your environment variables or worst case your driver / CUDA version

  1. nvidia-smi
  2. nvidia-smi -q
  3. nvcc -V

e) Compiling GPU Burn

  1. git clone https://github.com/wilicc/gpu-burn
  2. cd gpu-burn/
  3. make

f) Running GPU Burn (Few example commands below)

  1.  ./gpu_burn  (Single precision GPU burn for 10 seconds)
  2. ./gpu_burn -d ( Double precision GPU burn for 10 seconds)
  3. ./gpu_burn 120 (Single precision GPU burn for 120 seconds)

 

Sample output:

root@aprilmin6:/home/ubuntu/gpu-burn/gpu-burn# ./gpu_burnroot@aprilmin6:/home/ubuntu/gpu-burn/gpu-burn# ./gpu_burnRun length not specified in the command line.  Burning for 10 secsGPU 0: Tesla P100-SXM2-16GB (UUID: GPU-b882028f-aa4d-fcab-7d05-704f51bc5e9e)GPU 1: Tesla P100-SXM2-16GB (UUID: GPU-ad3b392e-1ce8-72a2-8398-36939294a238)GPU 2: Tesla P100-SXM2-16GB (UUID: GPU-6feba197-41fe-1c59-8201-8ba34411e69f)GPU 3: Tesla P100-SXM2-16GB (UUID: GPU-6f6dc5df-481f-f711-f0f9-94fca1bade2f)Initialized device 0 with 16280 MB of memory (15955 MB available, using 14360 MB of it), using FLOATSInitialized device 1 with 16280 MB of memory (15955 MB available, using 14360 MB of it), using FLOATSInitialized device 3 with 16280 MB of memory (15955 MB available, using 14360 MB of it), using FLOATSInitialized device 2 with 16280 MB of memory (15955 MB available, using 14360 MB of it), using FLOATS20.0%  proc’d: 895 (6482 Gflop/s) – 0 (0 Gflop/s) – 0 (0 Gflop/s) – 0 (0 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C – 39 C – 39 C – 39 C Summary at:   Wed May 23 13:27:53 CDT 2018
30.0%  proc’d: 895 (6482 Gflop/s) – 895 (6203 Gflop/s) – 0 (0 Gflop/s) – 0 (0 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C – 39 C – 39 C – 39 C Summary at:   Wed May 23 13:27:54 CDT 2018
30.0%  proc’d: 895 (6482 Gflop/s) – 895 (6203 Gflop/s) – 895 (5989 Gflop/s) – 0 (0 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C – 39 C -30.0%  proc’d: 895 (6482 Gflop/s) – 895 (6203 Gflop/s) – 895 (5989 Gflop/s) – 895 (5411 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C – 340.0%  proc’d: 1790 (8941 Gflop/s) – 895 (6203 Gflop/s) – 895 (5989 Gflop/s) – 895 (5411 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C – 40.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 895 (5989 Gflop/s) – 895 (5411 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C -40.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 895 (5411 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C 50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C – 39 C – 39 C – 39 C Summary at:   Wed May 23 13:27:56 CDT 2018
50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C60.0%  proc’d: 2685 (8912 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C – 52 C – 49 C – 52 C Summary at:   Wed May 23 13:27:57 CDT 2018
60.0%  proc’d: 2685 (8912 Gflop/s) – 2685 (8931 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C60.0%  proc’d: 2685 (8912 Gflop/s) – 2685 (8931 Gflop/s) – 2685 (8912 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C60.0%  proc’d: 2685 (8912 Gflop/s) – 2685 (8931 Gflop/s) – 2685 (8912 Gflop/s) – 2685 (8921 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C80.0%  proc’d: 3580 (8916 Gflop/s) – 2685 (8931 Gflop/s) – 2685 (8912 Gflop/s) – 2685 (8921 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C – 52 C – 49 C – 52 C Summary at:   Wed May 23 13:27:59 CDT 2018
80.0%  proc’d: 3580 (8916 Gflop/s) – 3580 (8931 Gflop/s) – 2685 (8912 Gflop/s) – 2685 (8921 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C80.0%  proc’d: 3580 (8916 Gflop/s) – 3580 (8931 Gflop/s) – 3580 (8909 Gflop/s) – 2685 (8921 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C80.0%  proc’d: 3580 (8916 Gflop/s) – 3580 (8931 Gflop/s) – 3580 (8909 Gflop/s) – 3580 (8922 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C90.0%  proc’d: 4475 (8917 Gflop/s) – 3580 (8931 Gflop/s) – 3580 (8909 Gflop/s) – 3580 (8922 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C90.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 3580 (8909 Gflop/s) – 3580 (8922 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 3580 (8922 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C – 52 C – 49 C – 52 C Summary at:   Wed May 23 13:28:01 CDT 2018
100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 5370 (8909 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 C – 56 C – 52 C – 56 CKilling processes.. done
Tested 4 GPUs: GPU 0: OK GPU 1: OK GPU 2: OK GPU 3: OK30.0%  proc’d: 895 (6482 Gflop/s) – 895 (6203 Gflop/s) – 0 (0 Gflop/s) – 0 (0 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C – 39 C – 39 C – 39 C Summary at:   Wed May 23 13:27:54 CDT 2018
30.0%  proc’d: 895 (6482 Gflop/s) – 895 (6203 Gflop/s) – 895 (5989 Gflop/s) – 0 (0 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C – 39 C -30.0%  proc’d: 895 (6482 Gflop/s) – 895 (6203 Gflop/s) – 895 (5989 Gflop/s) – 895 (5411 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C – 340.0%  proc’d: 1790 (8941 Gflop/s) – 895 (6203 Gflop/s) – 895 (5989 Gflop/s) – 895 (5411 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C – 40.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 895 (5989 Gflop/s) – 895 (5411 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C -40.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 895 (5411 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C 50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C – 39 C – 39 C – 39 C Summary at:   Wed May 23 13:27:56 CDT 2018
50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 39 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C50.0%  proc’d: 1790 (8941 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C60.0%  proc’d: 2685 (8912 Gflop/s) – 1790 (8928 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C – 52 C – 49 C – 52 C Summary at:   Wed May 23 13:27:57 CDT 2018
60.0%  proc’d: 2685 (8912 Gflop/s) – 2685 (8931 Gflop/s) – 1790 (8916 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C60.0%  proc’d: 2685 (8912 Gflop/s) – 2685 (8931 Gflop/s) – 2685 (8912 Gflop/s) – 1790 (8875 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C60.0%  proc’d: 2685 (8912 Gflop/s) – 2685 (8931 Gflop/s) – 2685 (8912 Gflop/s) – 2685 (8921 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C80.0%  proc’d: 3580 (8916 Gflop/s) – 2685 (8931 Gflop/s) – 2685 (8912 Gflop/s) – 2685 (8921 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C – 52 C – 49 C – 52 C Summary at:   Wed May 23 13:27:59 CDT 2018
80.0%  proc’d: 3580 (8916 Gflop/s) – 3580 (8931 Gflop/s) – 2685 (8912 Gflop/s) – 2685 (8921 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C80.0%  proc’d: 3580 (8916 Gflop/s) – 3580 (8931 Gflop/s) – 3580 (8909 Gflop/s) – 2685 (8921 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C80.0%  proc’d: 3580 (8916 Gflop/s) – 3580 (8931 Gflop/s) – 3580 (8909 Gflop/s) – 3580 (8922 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C90.0%  proc’d: 4475 (8917 Gflop/s) – 3580 (8931 Gflop/s) – 3580 (8909 Gflop/s) – 3580 (8922 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C90.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 3580 (8909 Gflop/s) – 3580 (8922 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 3580 (8922 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 C – 52 C – 49 C – 52 C Summary at:   Wed May 23 13:28:01 CDT 2018
100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 50 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 4475 (8917 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 100.0%  proc’d: 5370 (8909 Gflop/s) – 4475 (8923 Gflop/s) – 4475 (8911 Gflop/s) – 4475 (8895 Gflop/s)   errors: 0 – 0 – 0 – 0   temps: 54 C – 56 C – 52 C – 56 CKilling processes.. done
Tested 4 GPUs: GPU 0: OK GPU 1: OK GPU 2: OK GPU 3: OK

 

Advertisement