煤炭工程 ›› 2022, Vol. 54 ›› Issue (2): 160-165.doi: 10.11799/ce202202028

• 研究探讨 • 上一篇    下一篇

基于YOLO的井下人员速度测量方法研究

付燕1,窦晓熠2,叶鸥1   

  1. 1. 西安科技大学计算机科学与技术学院
    2. 西安科技大学
  • 收稿日期:2021-02-21 修回日期:2021-04-16 出版日期:2022-02-14 发布日期:2022-07-06
  • 通讯作者: 窦晓熠 E-mail:823962874@qq.com

A MEASUREMENT METHOD OF UNDERGROUND WORKERS SPEED BASED ON YOLOv3

  • Received:2021-02-21 Revised:2021-04-16 Online:2022-02-14 Published:2022-07-06
  • Contact: DOU XIAOYI E-mail:823962874@qq.com

摘要: 由于井下环境复杂、背景单一、参照物不够明显的视频数据特征,较难直接通过视觉计算的标定方式实现井下运动目标的测速。论文提出一种不依赖场景标定的速度检测方法,通过自主学习的方式,智能化监测井下工作人员的作业规范。该方法首先基于YOLOv3对巡检人员进行持续的检测跟踪,在此过程中通过视频相邻帧间的目标边界框特征点,确定图像消失点|其次,利用图像消失点建立三角形模型测量实时速度|最后,利用测量出的速度趋势智能判断井下工作人员是否存在漏检行为。在煤矿数据集上的实验结果表明,该方法能够有效度量井下运动目标的速度,用于判断井下工作人员巡检时是否存在漏检行为,比标定方法更适合井下场景的应用。

关键词: 井下视频, YOLO, 目标边界框特征点, 图像消失点, 三角形模型, 不安全行为

Abstract: At present, the unsafe behavior of underground workers such as omission of inspection is one of the factors that affect the safety of coal mine enterprises. Aiming at the video data features of complex underground environment, single background and not obvious reference, it is difficult to measure the velocity of moving target directly by visual calculation. In order to solve the above problems, a speed detection method that does not rely on scene calibration is proposed, and the operation specifications of underground workers can be intelligently monitored through independent learning. The method is based on YOLOv3 to continuously detect and track the inspectors. In this process, the design uses the target boundary box feature points in the adjacent frames of the video to determine the image vanishing point; secondly, it uses the image vanishing point measurement real-time speed; finally, use the measured speed trend to intelligently judge whether underground workers have unsafe operation behaviors. The experimental results on coal mine data sets show that the proposed method can effectively measure the velocity of moving targets in the mine, and is used to judge whether there is missing detection behavior when underground workers patrol, which is more suitable for application in the underground scene than the calibration method.

中图分类号: