Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

You may be wondering, ‘why create several models to count grape clusters?’ Good question. With so many varieties, locations, trellis systems, etc. it is hard to accurately represent all variations of clusters in a single model. We also tested model training at night with artificial lights and during the day. We captured images in New York, California, and Washington. As we refine our models, we may add more options to choose from or we may consolidate some of them. Either way, you will have to consider which model will best reflect the conditions that you are capturing images in in your vineyards. Are you collecting at night? Then perhaps our nighttime model is the best fit.

Getting Started

To start off, you’ll You’ll need a few things to get started:

...

Data collectors are used in myEV to collect data using mobile devices in the field. As part of this project, we have built a computer vision integration with Roboflow that lets you leverage any open and available model on the Roboflow Universe, a —a collection of publicly available datasets and models. We make our models available there as well. In this tutorial we will be using ‘nighttime-grape-flower-clusters/1’ which is a nighttime cluster counting model and performed in our trials with the highest levels of accuracy. You can explore our other cluster counting models, leverage any Roboflow Universe models, or even train your own model.

Tip

Credit: The data used to train nighttime‘nighttime-grape-flower-clusters/1 1’ was originally captured and trained by Jonathan Jaramillo as part of his PHD research which motivated the creation of this guide. Read the original paper >>

To setup the data collector:

  1. Login to your myEV farm. We recommend doing configuration on a desktop computer, though you can set this up on your phone as well.

  2. Select the ‘Collect Data’ button. Then click ‘New Data Collector’.

    Screenshot 2024-04-29 at 5.24.13 AM.pngImage Added
  3. Give your collector a name and then select ‘Add a Header’.

    Image of create data collector screenImage Added
  4. Give your new header a label and select ‘Computer Vision’ under the ‘Header Type’ field. Enter your Roboflow API Key and the Model URL as shown in the images below. Our nighttime cluster counting model’s URL is https://detect.roboflow.com/nighttime-grape-flower-clusters/1.

    Screenshot 2024-04-29 at 7.35.22 AM.pngImage AddedScreenshot 2024-04-29 at 7.18.21 AM.pngImage Added

    Screenshot 2024-04-29 at 7.32.23 AM.pngImage Added

  5. Once you’ve updated these details, click ‘Add Header’ and then ‘Save’ the data collector. You are now ready to use this data collector to take images and count clusters in the field!

Use your Cluster Counter in the Field

Note

Note: ‘nighttime-grape-flower-clusters/1’ is a nighttime-only model. This means you’ll need to capture vine images at night using a lighting source. We recommend placing light sources a few feet above and/or below your camera as in the figure below:

fagro-03-648080-g001.jpgImage Added

Here is an example image that we will be using in this tutorial to count clusters:

row_1_west 139.jpgImage Added

You now have a handy way to take pictures of vines and automatically count visible clusters. Be sure to install myEV on your phone and head out to the field. Once in front of a vine that you’d like to count clusters on follow these steps:

  1. Open myEV and tap the ‘Collect Data’ icon in the lower-right.

    IMG_EA227B36012D-1.jpegImage Added

  2. Select your cluster counting collector.

    IMG_8A29349CFC26-1.jpegImage Added

  3. Select ‘Choose file’ under your cluster counter header. This will prompt you to either choose a photo or use your camera to take an image.

    IMG_B15AA04F3EEF-1.jpegImage Added

  4. The resulting image will upload, process, and resolve with a cluster count and marked annotations of clusters.

    Screenshot 2024-04-29 at 8.18.33 AM.pngImage Added

  5. Remember to tap ‘Submit’ to finalize the datapoint. You can repeat this process to collect counts across a spatial area. The resulting dataset can be visualized and analyzed within myEV. See our tutorials for more information on mapping in myEV.

Note

Always test and check the accuracy of these tools! We recommend dedicating time to ground-truthing the results of these computer vision tools by manually counting clusters and comparing the model’s inferences vs the actual cluster count. This ratio can be used to make better predictions of clusters in the field.

Next Steps

...