RESEARCHES
Smart Vision & Robotic Sensing
Professor, Robotics Laboratory
Smart Innovation Program, Graduate School of Advanced Science and Engineering
Hiroshima University
Smart Innovation Program, Graduate School of Advanced Science and Engineering
Hiroshima University
Idaku ISHII
- >> Research Contents
- In order to establish high-speed robot senses that are much faster than human senses, we are conducting research and development of information systems and devices that can achieve real-time image processing at 1000 frames/s or greater. As well as integrated algorithms to accelerate sensor information processing, we are also studying new sensing methodologies based on vibration and flow dynamics; they are too fast for humans to sense.
Compact High-Speed Vision Platform – IDP Express
This study introduces a compact high-speed vision platform called IDP Express, which can execute real-time image processingand high-frame-rate video recording. In IDP Express, a dedicated FPGA board processes 512×512 pixel images from two camera heads; the input images andprocessed results are transferred to standard PC memory at a rate of 2000 fpsor more. Owing to the simultaneous high-frame-rate video processing and recording, IDP Express can be used as an intelligent video logger for long-term high-speed phenomenon analysis.
IDP Express consists of two compactly designed camera heads, a dedicated FPGA image processing board (IDP Expressboard) with two camera inputs, and a PC. Images captured by the camera headsare transferred to the IDP Express board at a high speed. The IDP Express boardexecutes arbitrary image processing, which is hardware-implemented by the user. The input images and processing results are transferred to a standard PC memory through a PCI-express bus. By executing simultaneous video processing and recording functions at a high frame rate, IDP Express can function as anintelligent high-speed video logger.
The camera head can capture and transfer color/gray 8-bit images at 2000 fps for 512×512 pixels and 10000 fps for 512×96 pixels. The camera head was also compactly designed for mounting on movable objects; the dimensions and weight were 35x35x34mm and 90g, respectively. The IDP Express board dedicated to IDP Express was designed for high-speed video processing and recording of two 512×512 pixel images transferred at rates as high as 2000 fps. This board consists of an FPGA (Xilinx XCVFX60) for camera I/O and PCI express bus controls, an FPGA (Xilinx XC3S5000) for hardware implementation of the algorithms by the user, serial-to-parallel converters for camera inputs, FIFOs for data transfer between the FPGAs, and configuration PROMs for the FPGAs.
Owing to the simultaneous high-frame-rate video processing and recording, IDP Express can be used as an intelligent video logger for long-term high-speed phenomenon analysis even when the measured objects move quickly in a wide area. We applied IDP Express to a mechanical target tracking system to record a high-frame-rate video at high resolution for a crucial moment, which is magnified by tracking the measured objects with visual feedback control. Several experiments on moving objects that undergo sudden shape deformation were performed.
IDP Express consists of two compactly designed camera heads, a dedicated FPGA image processing board (IDP Expressboard) with two camera inputs, and a PC. Images captured by the camera headsare transferred to the IDP Express board at a high speed. The IDP Express boardexecutes arbitrary image processing, which is hardware-implemented by the user. The input images and processing results are transferred to a standard PC memory through a PCI-express bus. By executing simultaneous video processing and recording functions at a high frame rate, IDP Express can function as anintelligent high-speed video logger.
The camera head can capture and transfer color/gray 8-bit images at 2000 fps for 512×512 pixels and 10000 fps for 512×96 pixels. The camera head was also compactly designed for mounting on movable objects; the dimensions and weight were 35x35x34mm and 90g, respectively. The IDP Express board dedicated to IDP Express was designed for high-speed video processing and recording of two 512×512 pixel images transferred at rates as high as 2000 fps. This board consists of an FPGA (Xilinx XCVFX60) for camera I/O and PCI express bus controls, an FPGA (Xilinx XC3S5000) for hardware implementation of the algorithms by the user, serial-to-parallel converters for camera inputs, FIFOs for data transfer between the FPGAs, and configuration PROMs for the FPGAs.
Owing to the simultaneous high-frame-rate video processing and recording, IDP Express can be used as an intelligent video logger for long-term high-speed phenomenon analysis even when the measured objects move quickly in a wide area. We applied IDP Express to a mechanical target tracking system to record a high-frame-rate video at high resolution for a crucial moment, which is magnified by tracking the measured objects with visual feedback control. Several experiments on moving objects that undergo sudden shape deformation were performed.
Reference
- Yao-Dong Wang, Idaku Ishii, Takeshi Takaki, and Kenji Tajima : An Intelligent High-Frame-Rate Video Logging System for Abnormal Behavior Analysis, Journal of Robotics and Mechatronics, Vol.23, No.1, pp.53-65 (2011)
- Idaku Ishii, Tetsuro Tatebe, Qingyi Gu, Yuta Moriue, Takeshi Takaki, and Kenji Tajima : 2000 fps Real-time Vision System with High-frame-rate Video Recording, Proc. IEEE Int. Conf. on Robotics and Automation, pp. 1536-1541, 2010.