Robot Vacuums

What changed in the rankingsChangelog 12.18 · updated as needed

12.18Removed dual brushes as a ranking factor, removed auto-carpet avoidance from the features scoring algorithm, reduced the score for self-cleaning bins from 13 to 5, added coffee mop test scores to the mopping algorithm, reduced score points for regular stain mop test and water penalty, reduced the obstacle avoidance score by 25%, and removed “minutes to map” and “map score” from the navigation algorithm.

12.17Slightly reduced the minimum number of reviews required to count 1-star reviews.

12.16Increased the weight of the mop stain test.

12.15Increased the weight of 1-star review scores and Obstacle Avoidance scores.

12.14Increased the weight of the App score.

12.13We reduced the weight of the mop-switching dock feature score.

12.12Increased review scores & a few miscellaneous demerits for navigation problems and QC issues.

12.11We’ve updated how battery efficiency and navigation efficiency is calculated in our testing. Previously, battery efficiency averages incorporated results from multiple power modes, but after reviewing the data, we determined that including the maximum power run introduced unnecessary variability. As a result, we have removed the maximum power run from the battery efficiency calculation and now base battery efficiency solely on results from our standard “best settings” test run. Navigation efficiency averages incorporated results from multiple navigation runs, including tests performed with and without the mop attached. We have simplified this methodology using only the navigation run performed with the mop attached when that capability is available. For models without a mopping function, navigation efficiency continues to be based on the standard non-mopping navigation run.

12.10Reduced the impact of overall reviews and 1-star reviews.

12.9Reduced the minimum required reviews to 66, further increased the penalty for excessive water usage, & lowered the bonus for a mop-switching station to 10 points (down from 15).

12.8Increase in 1-star reviews for the majority of the vacuums, with few exceptions such as the Ecovacs X5 Pro Omni which had decreased 1-star reviews

12.7Decreased 1-star review impact by 25%, slightly increased overall review impact, & further reduced water penalty.

12.6Increase in 1-star reviews for most of the vacuums, with few exceptions such as the Roborock Qrevo CurvX and Mova V50 Ultra Complete which had decreased 1-star reviews.

12.5Added multi-mop category, further decreased water penalty impact and stain test impact.

12.4Decreased mop stain test score impact & decreased water penalty impact.

12.3Reduced number of minimum reviews to 100, increased weight for Amazon 1-star reviews, lowered the weight for main Amazon review, & capped Amazon review points.

12.2Updated the navigation efficiency score to include more test runs for better clarity & awarded additional points for bagless bins.

12.1Increased the minimum number of reviews needed for 1-star review scores.