2018 Workshop on developing Python frameworks for earth system sciences

ECMWF | Reading | 30-31 October 2018

Python-WS-group-photo

Full size photo

Workshop description

Python has become increasingly popular in processing environmental data, including the handling of weather forecast, climate and oceanographic data. In recent years the Python eco-system has greatly improved its handling of large multi-dimensional data with the development of pandas, xarray, dask and links to machine learning frameworks. Jupyter notebooks are now a popular interface for scientists to exchange their work in Python. The continuing challenge is to apply these technologies with new sources of big earth science data sets, such as the Copernicus Climate Data Store.  

After the success of last year's workshop, ECMWF invited developers of Python frameworks in the field of environment data to another two day workshop. The workshop assessed the current status of Python packages around the world through presentations of developments. Participants were able to join discussions on how interoperability between different packages can be achieved and how efforts between different developments can be harmonised.

Presentations

One year on … where are we?
Stephan Siemen (ECMWF)

PDF icon

Python in the Copernicus Climate Change Service
Gionata Biavati (ECMWF)

PDF icon

CFGRIB: easy and efficient GRIB file access in xarray
Alessandro Amici (B-Open)

PDF icon

Metview's new Python interface
Iain Russell (ECMWF)

PDF icon

Easy visualisation with Magics
Sylvie Lamy-Thepaut (ECMWF)

PDF icon

Improving integration of XArray into MetPy
Ryan May (UCAR / Unidata)

External link icon

CDO's python bindings
Ralf Müller (MPI for Meteorology)

PDF icon

The Open Data Cube (ODC) - A tool to increase the value and impact of global Earth observation satellite data
Dan Wicks (Satellite Applications Catapult)

PDF icon

The WRF4G Python Framework for regional climate simulations with WRF model
Antonio S. Cofiño (University of Cantabria)

PDF icon

Parallel Python Tools for Handling Big Climate Data
Sheri Mickelson (NCAR)

PDF icon

The Pangeo ecosystem for data proximate analytics
Joseph Hamman (NCAR)

PDF icon

Dask: Scaling Analytics in Python
Matthew Rocklin (Anaconda)

External link icon

Why Pangeo? What is it and why we need it geoscience
Theo McCaie (Informatics Lab, UK Met Office)

PDF icon

GLOFRIM 2.0: coupling hydrologic and hydrodynamic models across scales for improved flood simulations
Dirk Eilander (Institute for Environmental Studies (IVM), Vrije Universiteit Amsterdam)

PDF icon

Rainymotion and RainNet: optical flow and deep learning models for radar-based precipitation nowcasting
Georgy Ayzel (University of Potsdam)

PDF icon

Python frameworks for the integration of a real-time data hub for meteorological and hydrological forecasting – benchmarks and design decisions
Alberto Sabater Morales, Jackie Leng (Kisters)

PDF icon

Open radar science for fun and, yes, even profit
Scott Collis (Argonne National Laboratory)

PDF icon

METplus - a Python-Wrapped Verification Capability Unifying the US Verification and Validation Community
Tara Jensen (NCAR & DTC)

PDF icon

Heterogeneous computing with Python: why we need it?
Javier Vegas-Regidor (Barcelona Supercomputing Center)

PDF icon