elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Impressum | Datenschutz | Kontakt | English
Schriftgröße: [-] Text [+]

DataFinder: A Python Application for Scientific Data Management

Schreiber, Andreas (2008) DataFinder: A Python Application for Scientific Data Management. EuroPython 2008, 2008-07-07 - 2008-07-12, Vilnius, Litauen. (nicht veröffentlicht)

Dieses Archiv kann nicht den Volltext zur Verfügung stellen.

Kurzfassung

The DataFinder is a data management client developed in Python that primarily targets the management of scientific technical data. Data can be attached with individual meta data that is based on a free-definable data model to achieve data structuring and ordering. Moreover, the system is able to handle large amounts of data and can be easily integrated in existing working environments. The system is based upon a client-server-architecture and uses open, stable standards. One of its main features is extensibility using Python scripts. The server side consists of the meta data server that stores the meta data as well as the system configuration. The server is accessed with the standardised protocol WebDAV by the client side. Data can be stored on the same server as the meta data or separated from it. The concept of separated meta data and data storage allows the flexible usage of heterogeneous storage resources (for example, FTP, GridFTP, operating system data interfaces, or WebDAV). On the client side, graphical user interfaces for the administration of the whole system (e.g., for configuration of storage resources or meta data modelling) and for the usage of the provided data management functionalities (e.g., storing and retrieving data, searching for data, or executing scripts on data) exist. The user interfaces are implemented in Python and the Qt GUI toolkit (using PyQt). Furthermore, the basic functionality is accessible through a Python-API so that these functionalities can be easily extended or used within other software systems. For example, typical usage scenarios include the automatic migration of existing data archives into the DataFinder-based data storage by provision of specific Python scripts. The talk is to gives an overview about the basic concepts of the DataFinder and demonstration of typical usage scenarios. Additionally, we want to present our experiences developing such a system using the Python programming language as well as on overview over the used Python modules, for example the Open Source Python WebDAV library developed at DLR. It also presents advantages for using Python in science and engineering, both in research and industry.

elib-URL des Eintrags:https://elib.dlr.de/56434/
Dokumentart:Konferenzbeitrag (Vortrag)
Titel:DataFinder: A Python Application for Scientific Data Management
Autoren:
AutorenInstitution oder E-Mail-AdresseAutoren-ORCID-iDORCID Put Code
Schreiber, AndreasNICHT SPEZIFIZIERTNICHT SPEZIFIZIERTNICHT SPEZIFIZIERT
Datum:9 Juli 2008
Open Access:Nein
Gold Open Access:Nein
In SCOPUS:Nein
In ISI Web of Science:Nein
Status:nicht veröffentlicht
Stichwörter:DataFinder, Data management, Python
Veranstaltungstitel:EuroPython 2008
Veranstaltungsort:Vilnius, Litauen
Veranstaltungsart:internationale Konferenz
Veranstaltungsbeginn:7 Juli 2008
Veranstaltungsende:12 Juli 2008
HGF - Forschungsbereich:keine Zuordnung
HGF - Programm:keine Zuordnung
HGF - Programmthema:keine Zuordnung
DLR - Schwerpunkt:keine Zuordnung
DLR - Forschungsgebiet:keine Zuordnung
DLR - Teilgebiet (Projekt, Vorhaben):keine Zuordnung
Standort: Köln-Porz , Braunschweig
Institute & Einrichtungen:Institut für Simulations- und Softwaretechnik > Verteilte Systeme und Komponentensoftware
Hinterlegt von: Schreiber, Andreas
Hinterlegt am:01 Dez 2008
Letzte Änderung:24 Apr 2024 19:20

Nur für Mitarbeiter des Archivs: Kontrollseite des Eintrags

Blättern
Suchen
Hilfe & Kontakt
Informationen
electronic library verwendet EPrints 3.3.12
Gestaltung Webseite und Datenbank: Copyright © Deutsches Zentrum für Luft- und Raumfahrt (DLR). Alle Rechte vorbehalten.