Event-Based Background-Oriented Schlieren

Shintaro Shiba, Friedhelm Hamann, Yoshimitsu Aoki, Guillermo Gallego

研究成果: Article査読


Schlieren imaging is an optical technique to observe the flow of transparent media, such as air or water, without any particle seeding. However, conventional frame-based techniques require both high spatial and temporal resolution cameras, which impose bright illumination and expensive computation limitations. Event cameras offer potential advantages (high dynamic range, high temporal resolution, and data efficiency) to overcome such limitations due to their bio-inspired sensing principle. This article presents a novel technique for perceiving air convection using events and frames by providing the first theoretical analysis that connects event data and schlieren. We formulate the problem as a variational optimization one combining the linearized event generation model with a physically-motivated parameterization that estimates the temporal derivative of the air density. The experiments with accurately aligned frame- and event camera data reveal that the proposed method enables event cameras to obtain on par results with existing frame-based optical flow techniques. Moreover, the proposed method works under dark conditions where frame-based schlieren fails, and also enables slow-motion analysis by leveraging the event camera's advantages. Our work pioneers and opens a new stack of event camera applications, as we publish the source code as well as the first schlieren dataset with high-quality frame and event data.

ジャーナルIEEE Transactions on Pattern Analysis and Machine Intelligence
出版ステータスPublished - 2024 4月 1

ASJC Scopus subject areas

  • ソフトウェア
  • コンピュータ ビジョンおよびパターン認識
  • 計算理論と計算数学
  • 人工知能
  • 応用数学


「Event-Based Background-Oriented Schlieren」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。