DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Cloud Segmentation and Classification from All-Sky Images Using Deep Learning

Fabel, Yann (2020) Cloud Segmentation and Classification from All-Sky Images Using Deep Learning. Master's, TU München.

[img] PDF


For transforming the energy sector towards renewable energies, solar power is regarded as one of the major resources. However, it is not uniformly available all the time, leading to fluctuations in power generation. Clouds have the highest impact on short-term temporal and spatial variability. Thus, forecasting solar irradiance strongly depends on current cloudiness conditions. As the share of solar energy in the electrical grid is increasing, so-called nowcasts (intra-minute to intra-hour forecasts) are beneficial for grid control and for reducing required storage capacities. Furthermore, the operation of concentrating solar power (CSP) plants can be optimized with high resolution spatial solar irradiance data. A common nowcast approach is to analyze ground-based sky images from All-Sky Imagers. Clouds within these images are detected and tracked to estimate current and immediate future irradiance, whereas the accuracy of these forecasts depends primarily on the quality of pixel-level cloud recognition. State-of-the-art methods are commonly restricted to binary segmentation, distinguishing between cloudy and cloudless pixels. Thereby the optical properties of different cloud types are ignored. Also, most techniques rely on threshold-based detection showing difficulties under certain atmospheric conditions. In this thesis, two deep learning approaches are presented to automatically determine cloud conditions. To identify cloudiness characteristics like a free sun disk, a multi-label classifier was implemented assigning respective labels to images. In addition, a segmentation model was developed, classifying images pixel-wise into three cloud types and cloud-free sky. For supervised training, a new dataset of 770 images was created containing ground truth labels and segmentation masks. Moreover, to take advantage of large amounts of raw data, self-supervised pretraining was applied. By defining suitable pretext tasks, representations of image data can be learned facilitating the distinction of cloud types. Two successful techniques were chosen for self-supervised learning: Inpainting- uperresolution and DeepCluster. Afterwards, the pretrained models were fine-tuned on the annotated dataset. To assess the effectiveness of self-supervision, a comparison with random initialization and pretrained ImageNet weights was conducted. Evaluation shows that segmentation in particular benefits from self-supervised learning, improving accuracy and IoU about 3% points compared to ImageNet pretraining. The best segmentation model was also evaluated on binary segmentation. Achieving an overall accuracy of 95.15%, a state-of-the art Clear-Sky-Library (CSL) is outperformed significantly by over 7% points.

Item URL in elib:https://elib.dlr.de/136767/
Document Type:Thesis (Master's)
Title:Cloud Segmentation and Classification from All-Sky Images Using Deep Learning
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Fabel, YannUNSPECIFIEDhttps://orcid.org/0000-0002-1892-5701UNSPECIFIED
Date:14 July 2020
Refereed publication:No
Open Access:Yes
Number of Pages:94
Keywords:All Sky Imagers, deep learning, nowcasting,
Institution:TU München
Department:Department of Informatics
HGF - Research field:Energy
HGF - Program:Renewable Energies
HGF - Program Themes:Concentrating Solar Thermal Technology
DLR - Research area:Energy
DLR - Program:E SW - Solar and Wind Energy
DLR - Research theme (Project):E - Impact of Desert Environment (old)
Location: Köln-Porz
Institutes and Institutions:Institute of Solar Research > Qualifizierung
Deposited By: Kruschinski, Anja
Deposited On:20 Oct 2020 08:03
Last Modified:28 Mar 2023 23:57

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.