RESEARCHES
Smart Vision & Robotic Sensing
![](https://robotics.hiroshima-u.ac.jp/wp/wp-content/uploads/2020/04/img_idaku_ishii.jpg)
Professor, Robotics Laboratory
Smart Innovation Program, Graduate School of Advanced Science and Engineering
Hiroshima University
Smart Innovation Program, Graduate School of Advanced Science and Engineering
Hiroshima University
Idaku ISHII
- >> Research Contents
- In order to establish high-speed robot senses that are much faster than human senses, we are conducting research and development of information systems and devices that can achieve real-time image processing at 1000 frames/s or greater. As well as integrated algorithms to accelerate sensor information processing, we are also studying new sensing methodologies based on vibration and flow dynamics; they are too fast for humans to sense.
Compact High-Speed Vision Platform – IDP Express
![IDP Express](https://robotics.hiroshima-u.ac.jp/wp/assets/images/vision_sensing/IDP_Express/IDP_photo.jpg)
![IDP Express](https://robotics.hiroshima-u.ac.jp/wp/assets/images/vision_sensing/IDP_Express/IDP_config.jpg)
The camera head can capture and transfer color/gray 8-bit images at 2000 fps for 512×512 pixels and 10000 fps for 512×96 pixels. The camera head was also compactly designed for mounting on movable objects; the dimensions and weight were 35x35x34mm and 90g, respectively. The IDP Express board dedicated to IDP Express was designed for high-speed video processing and recording of two 512×512 pixel images transferred at rates as high as 2000 fps. This board consists of an FPGA (Xilinx XCVFX60) for camera I/O and PCI express bus controls, an FPGA (Xilinx XC3S5000) for hardware implementation of the algorithms by the user, serial-to-parallel converters for camera inputs, FIFOs for data transfer between the FPGAs, and configuration PROMs for the FPGAs.
Owing to the simultaneous high-frame-rate video processing and recording, IDP Express can be used as an intelligent video logger for long-term high-speed phenomenon analysis even when the measured objects move quickly in a wide area. We applied IDP Express to a mechanical target tracking system to record a high-frame-rate video at high resolution for a crucial moment, which is magnified by tracking the measured objects with visual feedback control. Several experiments on moving objects that undergo sudden shape deformation were performed.
Reference
- Yao-Dong Wang, Idaku Ishii, Takeshi Takaki, and Kenji Tajima : An Intelligent High-Frame-Rate Video Logging System for Abnormal Behavior Analysis, Journal of Robotics and Mechatronics, Vol.23, No.1, pp.53-65 (2011)
- Idaku Ishii, Tetsuro Tatebe, Qingyi Gu, Yuta Moriue, Takeshi Takaki, and Kenji Tajima : 2000 fps Real-time Vision System with High-frame-rate Video Recording, Proc. IEEE Int. Conf. on Robotics and Automation, pp. 1536-1541, 2010.