Deep learning for image-based detection of weeds from emergence to maturity in wheat fields


Guzel M., Turan B., Kadioglu I., BAŞTÜRK A., Sin B., Sadeghpour A.

Smart Agricultural Technology, cilt.9, 2024 (Scopus) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 9
  • Basım Tarihi: 2024
  • Doi Numarası: 10.1016/j.atech.2024.100552
  • Dergi Adı: Smart Agricultural Technology
  • Derginin Tarandığı İndeksler: Scopus
  • Anahtar Kelimeler: Deep learning, Growing stages, Weed detection, Wheat, YOLOv5
  • Erciyes Üniversitesi Adresli: Evet

Özet

Effective weed control in wheat (Triticum aestivum L.) fields is crucial for optimizing production and ensuring food security in semi-arid regions. The implementation of deep learning for weed detection could enable precise weed management, leading to enhanced wheat yield, increased income for growers through targeted herbicide use, and a reduced environmental footprint associated with herbicide application. Charlock mustard (Sinapis arvensis L.) [CM], creeping thistle (Cirsium arvense (L.) Scop) [CT], and forking larkspur (Consolida regalis Gray) [FL]) are among the most invasive weed species in wheat fields. Effective management of these weeds is essential to ensure optimal wheat productivity in the semi-arid regions. To detect weeds, an unmanned arial vehicle was used to collect images and videos from 185 wheat fields in Tokat, Turkey. The images were collected from five phenological periods of each species including seedling, rosette, vegetative, flowering, and fruiting (in total 15 classification process). These stages are either important for timely weed control or essential for understanding weed pressure threshold, the potential for increasing weed seedbank increase, and identifying herbicide resistant weeds. A total of 145,792 objects were labeled in the images to create the dataset, divided into 80 % for training + validation and 20 % for testing. The dataset was used with the YOLOv5 (You Only Look Once) deep learning architecture. The YOLOv5 was the newest YOLO model during this study carried out. All neural networks provided by YOLOv5 (nano, small, medium, large, and xlarge) were trained and the Precision, Recall, F-1 Score, and AUC (Area under the Curve) performances of the neural networks were evaluated. The YOLOv5s (small) was the most precise neural network in detecting weeds regardless of the species. In contrast, nano was the least precise neural network in detecting each weed species. For CT, when small neural network was used, precision of detection ranged from 0.87 (fruit stage) to 0.96 (rosette and vegetative stages). For, forking larkspur, the best neural network was achieved with YOLOv5 small and the precision ranged from 0.45 (fruit stage) to 0.93 (vegetative stage). Using YOLOv5 small in Charlock mustard, the most precise detection occurred at seedling, rosette, and vegetative stages (with precision of 0.96) and the least precise detection was recorded at the fruit stage (0.81). Other performance evaluations (Recall, F-1 Score, and AUC) were in agreement with those of Precision. Our results indicated that by using YOLOv5 small neural network, all three weed species could be detected at all growth stages with the precision of 0.86 with the exception of fruit stage. Future research should (1) focus on assessing YOLOv5 small neural network with the newest versions of YOLO and also (2) evaluate this neural network for detecting weed species in wheat fields to allow for improved weed control and future recommendations.