- https://www.esiwace.eu/events/hpda-training-2020/hpda-training-2020
- Training on High Performance Data Analytics and Visualisation in October 2020
- 2020-10-06T15:00:00+02:00
- 2020-11-03T16:00:00+01:00
- This is the first 8-hour online training course on High Performance Data Analytics (HPDA) and visualisation organised by ESiWACE2.
Oct 06, 2020
03:00 PM
to
Nov 03, 2020
04:00 PM
(Europe/Berlin / UTC200)
online
This online training course aims to increase scientists’ expertise on data analysis and visualisation applied to climate and weather domains, using high-performance data analytics and visualisation tools available from the open source market (i.e., Ophidia and ParaView).
The training covers topics from simple analytics tasks to workflows and applications (e.g., Python-based) and provides best practices and guidelines on dealing with massive scientific datasets on HPC architectures.
Examples of real applications of Ophidia for data analytics and ParaView for visualisation in the climate and weather domain will be presented. Demos and hands-on concerning the tools will also be carried out during the training.
This course is organised in the context of the “Centre of Excellence in Simulation of Weather and Climate in Europe” (ESiWACE) phase 2 project.
Topics:
-
Introduction to scientific data management and analytics
-
Big Data in HPC: High-performance data management
-
Analytics workflows for eScience
-
Open-source High Performance Data Analytics (HPDA) tools
-
Data Processing using CDO
-
Introduction to data visualisation using ParaView
-
Discussion of visualisation workflows, from post to in-situ
Audience:
The training targets an audience in the field of weather and climate research with different backgrounds, from computer to Earth system scientists. Basic knowledge of the following is expected to fully take advantage of the training: Python, Linux, general aspects concerning climate/weather data.
Agenda:
The training ran over four weeks in October and beginning of November, with 2 hours of work per week required from the participants. Training sessions combined presentations and hands-on and were scheduled as follows:
- Session 1: CMCC "Introduction to Ophidia"
[PDF slides] [Recording] - Session 2: DKRZ "Introduction to ParaView (mainly 2D)"
[PDF slides] [Instructions for Paraview] [Recording] - Session 3: CMCC "Ophidia advanced concepts"
[PDF slides] [Recording] - Session 4: DKRZ "Advanced ParaView use"
[Instructions] [Recording]
The training has been successfully completed. Read more about it in our Stories section. The video recordings are available as a playlist on the ESiWACE2 YouTube channel!