于合龙, 黄 浦, 苏红宏, 张 超, 丁民权, 韩志远, 冯 雪. 基于双目视觉的植物叶片三维形态与光照度同步测量[J]. 农业工程学报, 2016, 32(10): 149-156. DOI: 10.11975/j.issn.1002-6819.2016.10.021
    引用本文: 于合龙, 黄 浦, 苏红宏, 张 超, 丁民权, 韩志远, 冯 雪. 基于双目视觉的植物叶片三维形态与光照度同步测量[J]. 农业工程学报, 2016, 32(10): 149-156. DOI: 10.11975/j.issn.1002-6819.2016.10.021
    Yu Helong, Huang Pu, Su Honghong, Zhang Chao, Ding Minquan, Han Zhiyuan, Feng Xue. Synchronous measurement of 3D morphology and illuminance of plant leaves based on binocular vision[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2016, 32(10): 149-156. DOI: 10.11975/j.issn.1002-6819.2016.10.021
    Citation: Yu Helong, Huang Pu, Su Honghong, Zhang Chao, Ding Minquan, Han Zhiyuan, Feng Xue. Synchronous measurement of 3D morphology and illuminance of plant leaves based on binocular vision[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2016, 32(10): 149-156. DOI: 10.11975/j.issn.1002-6819.2016.10.021

    基于双目视觉的植物叶片三维形态与光照度同步测量

    Synchronous measurement of 3D morphology and illuminance of plant leaves based on binocular vision

    • 摘要: 植物叶片的生长与光照度密切相关,尤其在温室大棚内,对光照度的控制要求更高。为同时获取叶片的三维形态与光照分布,该文提出了一种基于双目视觉的纹理植物叶片三维形态与光照度同步测量方法。利用双目视觉原理结合数字图像相关技术,实现叶片三维形态测量;通过植物叶片光照度与图像灰度关系推导,实现三维光照分布测量。该文以网纹草为例,对上述方法进行验证。试验表明:参考子区半径为57 pixels、计算间隔7 pixels时三维形态测量效果最佳;对叶片实施均匀光照,照度仪测量值与图像测量平均值相对误差在6%以内;对叶片实施非均匀光照,测量的光照分布真实反映了叶片光照分布。该方法具有非接触、方便、快捷等优点,为植物叶片的三维形态与光照度测量提供了一种方法,为温室大棚的智能光控提供了数据支撑。

       

      Abstract: Plant leaf is an important organ for photosynthesis and transpiration, and it has a significant effect on plant growth, yield and quality of crops. It is necessary to measure the three dimensional(3D) morphology(3D coordinates of each point on the surface of plant leaves) and illuminance distribution of leaves are important for the study of plant growth. Therefore, in this paper, we proposed a method of measuring the leaf 3D morphology and illuminance distribution synchronization of texture plants based on binocular vision. Firstly, according to the pinhole imaging principle, there is a one-to-one correspondence between 3D spatial coordinate points and image points. The camera calibration is a necessary process when the recovery of information such as angles and distance of spatial points and image points is required. So the intrinsic and external parameters and distortion parameters of the camera were obtained by improved Zhang’s Calibration. For obtaining the 3D spatial coordinate points,two cameras was used to capture the left and right image by the binocular vision principle. To find out the same texture image points of leaves, the digital image correlation technique was used. From the above work we can measure 3D coordinate points of leaf and calculate distance that surface point of leaf to the left camera optical center. For improving the accuracy of 3D coordinate points measurement, the left and right raw format images of chessboard calibration target and leaf were captured by using two same type of color COMS cameras with high resolution and unpacked it to RGB 3-channel images. G channel image brightness was still highest when the illuminance was much lower, so chosen G channel image for calculation. Secondly, in order to achieve the illuminance distribution, according to the applied optics theory and lambert′s law, the image gray values and the illuminance were positively correlated. So an image illuminance measurement equation was developed. Leaf surface illuminance was only related to the distance and image gray values when the camera system parameters were invariant for diffuse reflectance plant leaves. Therefore, when the image gray values and the distance were obtained, the illuminance calculation of plant leaves can be realized. For improving the accuracy of 3D illuminance distribution measurement, converted the RGB format image to HSV format image and segmentation based on hue of image and smoothed. Thirdly, in order to verify the reliability and accuracy of the synchronous measurement method, in this paper, we took Fittonia arundinacea as experiment object. We needed to calibrate before experiment. So 16 left and right chessboard calibration target images under the different postures were captured and used to calculate the intrinsic, external parameters and distortion parameters, and irradiated it with uniform light. One hundred leaf left and right images and the corresponding illuminance data were collected synchronously, then the size of 30×20 pixels of leaf area were selected to calibrate the camera system parameters. For verifying the illuminance equation, captured 120 left and right images of different light intensity and measured illuminance,the illuminance sensor was used to measure the corresponding illuminance. Through the comparative analysis of the illuminance sensor measurement values and the image measurement average values, we found that the correlation was 0.996, the average relative error was less than 6%, which can meet the basic requirements of the application of agricultural information monitoring in intelligent light control. Besides that, it was irradiated with non-uniform light and the image was collected. The original G channel image for 3D morphology measurement was used. The results showed that it was the best when the sub region radius was 57 pixels and the interval of sub region was seven pixels. The illuminance equation was used to measure illuminance distribution of the original G channel image and the hue segmentation and smooth G channel image of leaf synchronously, the latter was better. The experimental results showed that the method can satisfy the synchronous measurement of 3D morphology and illuminance distribution of the leaf.

       

    /

    返回文章
    返回