Course: Introduction to High-Throughput-Computing: SnakeMake

Europe/Ljubljana
Predavalnica P.02 (Faculty of Mathematics and Physics)

Predavalnica P.02

Faculty of Mathematics and Physics

Jadranska 21, 1000 Ljubljana
Luka Leskovec (IJS)
Description

Description: In this workshop we will get acquainted with the basics of SnakeMake, which is an open-source tool that allows users to describe complex workflows with a hybrid of Python and shell scripting. We will learn how to translate a basic workflow, which is partly trivially parallelizable and in parts not, into SnakeMake, and how to utilize HPC resources in conjunction with SnakeMake. We will take a look at a generic workflow, consisting of a set of tasks, with varying interdependencies; we will learn how to identify these interdependencies between our tasks and how to design a workflow diagram around them.

Initial development of our workflow in SnakeMake will be in a terminal setup, as we do generically in our day-to-day lives, however we will then learn how to scale up and perform these tasks on a local supercomputing cluster.

Difficulty: Basic

Language: English

Prerequisite knowledgeBasic knowledge of Linux, the Terminal, and Python

Target audience: Beginners and more experienced people interested in optimizing and automating their workflows and ultimately transferring them to High-Performance Computing machines.

Skills to be gained:

  • workflow design, identification of interdependencies
  • basics of SnakeMake
  • transfering a generic workflow into SnakeMake
  • testing our SnakeMake in an interactive environment, and upscaling it for use on a supercomputing cluster

Maximum number of participants: 30

Workflow: The training is live, in the afternoon. Part of the training will be in the form of a lecture and part will be a practical session, where we will make use of the NSC Cluster at the Jožef Stefan Institute (as an educational member of SLING).

Location: Faculty of Mathematics and Physics (predavalnica P.02) Jadranska 21, 1000 Ljubljana, Slovenia

Organizator/ Organizer

Faculty of Mathematics and Physics


Lecturers:

Name:Luka Leskovec
Description:Scientist and educationalist involved in theoretical physics and supercomputing
E-mail:luka.leskovec@fmf.uni-lj.si

Surveys
Survey