翟志强, 朱忠祥, 杜岳峰, 李臻, 毛恩荣. 基于虚拟现实的拖拉机双目视觉导航试验[J]. 农业工程学报, 2017, 33(23): 56-65. DOI: 10.11975/j.issn.1002-6819.2017.23.008
    引用本文: 翟志强, 朱忠祥, 杜岳峰, 李臻, 毛恩荣. 基于虚拟现实的拖拉机双目视觉导航试验[J]. 农业工程学报, 2017, 33(23): 56-65. DOI: 10.11975/j.issn.1002-6819.2017.23.008
    Zhai Zhiqiang, Zhu Zhongxiang, Du Yuefeng, Li Zhen, Mao Enrong. Test of binocular vision-based guidance for tractor based on virtual reality[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2017, 33(23): 56-65. DOI: 10.11975/j.issn.1002-6819.2017.23.008
    Citation: Zhai Zhiqiang, Zhu Zhongxiang, Du Yuefeng, Li Zhen, Mao Enrong. Test of binocular vision-based guidance for tractor based on virtual reality[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2017, 33(23): 56-65. DOI: 10.11975/j.issn.1002-6819.2017.23.008

    基于虚拟现实的拖拉机双目视觉导航试验

    Test of binocular vision-based guidance for tractor based on virtual reality

    • 摘要: 针对农机导航系统的传统田间试验方式受作物生长状态的约束性较强,错过适当的作物生长时期将直接导致开发周期延长、成本增加等问题,该文提出了一种基于虚拟现实技术的拖拉机双目视觉导航试验方法。该方法以拖拉机为作业机械,苗期棉花为目标作物,在虚拟现实环境下建立田间作物行场景的三维几何模型,用于模拟田间试验场景;建立虚拟现实环境下的拖拉机物理引擎,根据实车参数及试验场景信息快速、准确地解算拖拉机的动力学参数,并且根据解算所得的状态参数在虚拟试验场景中实时渲染拖拉机的位姿状态;设计路径跟踪控制器,以经过双目视觉方法识别的田间路径为目标路径,根据拖拉机当前行驶路径与目标路径的相对位置关系解算并控制拖拉机前轮转向角度。以某型拖拉机参数为实车参数,采用大小行距方式布置5行曲线形态的苗期棉花作物行场景开展虚拟导航试验。拖拉机以不大于2 m/s的车速跟踪作物行时,平均位置偏差的绝对值不大于0.072 m、位置偏差的标准差不大于0.141 m;平均航向偏差的绝对值不大于2.622°、航向偏差的标准差不大于4.462°。结果表明:该文设计的拖拉机虚拟试验系统能够在虚拟现实环境下,模拟田间作物行环境开展基于双目视觉的导航试验,可为导航控制系统的测试及改进提供理论依据和试验数据。

       

      Abstract: Abstract: Machine vision-based guidance of agricultural machinery operates flexibly in complex field. The classical test methods for agricultural guidance systems are based on real field test. There are many problems for the classical test methods, such as high test cost, strong dependence on crop growing period, long test period, and being easy to damage crops. To solve those problems, a novel test method based on virtual reality for binocular vision based guidance system was presented. A virtual system was built with this method. The virtual test system is composed of the modules of test scene, physics engine of tractor, and control of path tracking. The test scene module consists of crop rows, road and four-wheel tractor, which provides image data for pathway detection and road roughness for the tractor. Models of the test scene were created with 3ds Max and Multigen-Creator as modeling tools and with Vege Prime as visual simulation tool. The physics engine of tractor was used to simulate the dynamics of tractor accurately and quickly according to the real tractor parameters and the information of the test scene. The position and attitude of the tractor were solved and rendered in Vega Prime. A simplified model was used to solve the dynamics of the tractor, including the vehicle model, tire model, and road solution model. To reduce the computational cost, the vehicle model was simplified to a model of 11 degrees of freedom, which are 6 degrees of freedom for the attitude of tractor body, 4 degrees of freedom for wheel rolling, and 1 degree of freedom for front wheel steering. The tire model was built based on the model of Dugoff-I to obtain the parameters of tire easily. The road model was built based on the modules of vpGroundClamp and tripod for collision detection, which solves the road roughness of each wheel. The control of path tracking consists of pathway determination, computation of turning angle of front wheel, and control of turning angle of front wheel. A reported and validated crop row detection method based on binocular vision was used to detect centerlines of crop rows. The initial alignment of tractor is located in the middle of the crop rows. Thus the centerline of that middle crop row would be the pathway during the path tracking. A computational model of the front wheel angle was built based on the pure pursuit method. The control of front wheel angle was designed based on the classical increment proportion-integral-derivative (PID) algorithm. Parameters of the PID controller were optimized with the genetic algorithm. Results of tracking a sinusoidal signal with the time of 5 s and 5° amplitude show that the control system responses quickly and overshoot is small. The software of the virtual test system was developed based on the C++ language in Visual Studio 2008. A tractor with the systems of front steering, rear driving and rear braking was used as the operation machine, the cotton at seedling stage was used as the target crop, and the crop row field was taken as the test scene. Virtual tests of tracking the curved crop rows at the tractor speed of 0.5, 1, 1.5, 2, 2.5, and 3 m/s were conducted. Results show that, the virtual test system simulates the crop field and tractor well in the virtual reality environment and can conduct the tests of tractor guidance based on binocular vision. The proposed method could provide theoretical basis and experimental data for the experiment and improvement of the guidance system. Results of path tracking are satisfying for the tractor speed within 2 m/s, and the amplitude, absolute average value and standard deviation of the position deviation are less than 0.347, 0.072, and 0.141 m, respectively; the amplitude, absolute average value and standard deviation of the direction deviation are less than 11.570°, 2.622°, and 4.462°, respectively.

       

    /

    返回文章
    返回