RESEARCHES

Smart Vision & Robotic Sensing

Professor, Robotics Laboratory
Smart Innovation Program, Graduate School of Advanced Science and Engineering
Hiroshima University
Idaku ISHII
>> Research Contents
In order to establish high-speed robot senses that are much faster than human senses, we are conducting research and development of information systems and devices that can achieve real-time image processing at 1000 frames/s or greater. As well as integrated algorithms to accelerate sensor information processing, we are also studying new sensing methodologies based on vibration and flow dynamics; they are too fast for humans to sense.

HFR 3D Imaging Using Spatiotemporal Selection Coded Structured Light

In this study, we propose a spatiotemporal selection type coded structured light projection method to make the best of both merits in measurement; high accuracy to a static object, and robustness to a moving object.

Our proposed concept has the following features: (a) projection of multiple coded structured light patterns that enable both encoding along the time axis and encoding in spatial neighborhood, (b) adaptive selection of encoding types in every local image region by calculating image features those are dependent of measured objects’ motion. These features of the coded pattern enable spatio-temporal selection type encoding that can select not only encoding along the time axis, but also encoding in the spatial domain. As a result, encoding along the time axis is selected in the region where is no motion, while encoding in spatial neighborhood is selected in the region where the brightness changes dynamically.

To demonstrate the effectiveness of our proposed algorithm using an off-line high-speed camera and a high-speed DLP projector, we show three-dimensional shape measurement results for three types of moving objects; (a) a rotating plane, (b) a waving piece of paper, and (c) a moving human hand.

waving paper
Normal
(MPEG 1.0MB)
waving paper
3D Slow
(MPEG 2.7MB)
human hand motion
Normal
(MPEG 1.0MB)
human hand motion
3D Slow
(MPEG 3.5MB)
rotating plate
Normal
(MPEG 2.5MB)
rotating plate
3D Slow
(MPEG 2.2MB)