STELLA: a modular framework for SpatioTemporal Event-based Lagrangian particLe trAcking

Kurzfassung

Event-based cameras have emerged as a powerful tool for object detection and tracking in autonomous driving, robotics, and experimental physics. In particular, they facilitate the study of complex turbulent fluid flows by enabling the tracking of numerous tiny tracer particles, while benefiting from the superior temporal resolution, high dynamic range, and low data rate of the asynchronous event stream. However, exploiting the sparse event stream requires precise and efficient data processing pipelines that either accumulate events into a dense representation or process them directly by clustering algorithms. In this study, we present a modular framework for SpatioTemporal Event-based Lagrangian particLe trAcking (STELLA), which integrates detection and tracking strategies from both pipelines into a unified tracking system. To benchmark the proposed framework, we introduce demanding synthetic and experimental datasets covering the motion of numerous particles, which are made publicly available. Leveraging the rich ground truth of these datasets, established recurrent vision transformer and heat conduction-based detection architectures are trained and applied to particle tracking in fluid flows for the first time. Using STELLA, robust and reliable particle tracking is demonstrated, achieving subpixel-accurate tracks and a mean absolute error in the predicted velocity down to 1.9 % of the peak velocity. Which is the best-performing processing pipeline strongly depends on the dynamics and composition of the considered dataset. In particular, approaches based on dense representations yield accurate tracks for high-frequency periodic particle motions. Conversely, direct processing of the event stream enables simultaneous tracking of more than 900 particles in the wake of a cylinder, with uncertainties comparable to state-of-the-art particle tracking velocimetry (PTV) using a high-speed camera. Despite significant spatial and temporal velocity gradients, slow- and fast-moving particles are precisely tracked in the event stream, challenging conventional approaches using frame-based cameras. Hence, the openly available framework STELLA paves the way for a versatile and easily accessible application of event-based cameras for flow diagnostics.