Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Palma provides a variety of tools to support statistical and machine learning based data analysis on both CPU or accelerated by one or more GPUs.

Below you can find some commonly used frameworks for different application domains that are currently supported by Palma.

Note

For the sake of simplicity, these pages focus on the frameworks and techniques based on the Python programming language. Keep in mind that there are alternative solution in other languages such as R, MatLab or Julia which are not mentioned here.

Available Frameworks

For documentation on how to use the module system, see here.

For a comprehensive list of available software on the different queues, see here.

Panel
borderStylesolid
titleNormal Queue (CPU)

For simpler (image-) classification tasks with very small images or simple numerical features, training and inference does not necessarily benefit from being executed on a GPU.

In these cases, Palma provides framework installation that can be used on a default compute node in the normal queue

Toolchainscikit-learnTensorFlowPyTorch
palma/2019b → foss0.21.3-Python-3.7.42.1.0-Python-3.7.4

1.4.0-Python-3.7.4

1.6.0-Python-3.7.4

palma/2020a → foss0.23.1-Python-3.8.22.3.1-Python-3.8.21.7.1-Python-3.8.2
palma/2020b → fossTBATBA

1.7.1

1.9.0



Panel
borderStylesolid
titleGPU Queue

For larger deep learning tasks with larger images or huge feature vectors it is recommended to execute training with accelerator devices like a GPU.

Therefore, the TensorFlow and PyTorch mentioned above are also available with CUDA support on Palma's GPU queues:

ToolchainTensorFlowPyTorchQueue
palma/2019b → fosscudaTensorFlow 1.13.1/1.14.0/2.2.0

1.4.0-Python-3.7.4

1.6.0-Python-3.7.4

gpuv100, gpu2080, gputitanrtx
palma/2020a → fosscudaTensorFlow 2.3.11.7.1-Python-3.8.2

gpuv100

palma/2020b → fosscudaTensorFlow 2.4.11.9.0gpuv100