How well does Zabble Zero™ AI perform?

‍

Zabble Zero™ Mobile Tagging makes waste level and contaminant monitoring easy using just a mobile device. Zabble Zero™ AI also makes it faster and learns over time: When a user snaps a photo of a bin using a phone or a tablet, Zabble Zero™ AI suggests fullness levels and contamination items, and automatically alerts supervisors of any issues. 

In this post, we take a deeper look into the performance of the suggested fullness algorithm. How often does a user need to modify the AI suggestion? Does it really work?

For this evaluation, we focused on dumpster tags from April and May. We looked at two different metrics:

1. The difference between the suggested fullness and what the user ultimately saved as the fullness
2. The difference between the suggested fullness and a human estimation from looking at photos‍

‍

‍Difference between AI-predicted fullness % and user-selected fullness %

‍

Zabble Zero™ customers used the app’s AI to predict the fullness of dumpsters 735 times over two months. In 719 cases, users accepted the suggested fullness without making any changes. Only in a handful cases did they change the suggested fullness, and those changes were typically within 25%. (Zabble Zero™ AI predicts fullness in 25% increments.) This evaluation method suggests a 98% accuracy.

As users may not always review the suggested fullness, we conducted a photo evaluation as well. We took a random sample of 30 dumpster photos and, without looking at the suggested fullness results, entered our own estimation of the fullness %. And repeated this experiment 10 times.

Difference between AI-predicted fullness % and human-estimated fullness % based on photo

In this one sample, in 68% of cases, the human estimation matched the AI suggestion exactly. In 89% of cases, the difference was close, or within 25%. (Note, estimating fullness by looking at a photo is not always accurate, as photo usability can vary.) 

The average difference was 0%, meaning that differences will even out over many tags. 

We repeated this evaluation multiple times, examining 10 samples of 30 entries each, to see if our results were consistent across different sets of photos.
‍

Photo evaluation results over 10 samples

Our photo evaluation results proved to be fairly consistent. Across the samples, the AI suggestions and human estimations matched 63% of the time, and were close 94% of the time. These are great results that show how Zabble Zero™ AI can help make zero waste campaign tracking fast and easy. 

‍

Concluding Results

• A large sample size of 735 reported dumpster occurrences showed a 98% accuracy in Zabble Zero™ AI receptacle fullness recommendations
• 10 experiments of 300 photo evaluations to determine AI-predicted fullness % versus human-estimated fullness % resulted in 94% of estimations being within the 25% tiered Zabble Zero™ AI receptacle fullness recommendation

‍

To learn more about Zabble Zero™ AI, please contact the Zabble team.