We test all vacuums on both hardwood flooring and carpet.
How we test robot vacuums
Our method for evaluating robot vacuums is straightforward, yet grueling. There are two types of tests we run. The first trial is to figure out how well a robot covers the floor while it’s cleaning. We built an industry-standard testing room as specified by the International Electrotechnical Commission just for this purpose. The IEC is an international standards body responsible for managing robot vacuum testing procedures, among other things, for vacuum manufacturers.
More of our robot vacuum testing setup.
We control for the specific nozzle width of each vacuum, too. We constructed an adjustable tool to soil our test floors. It lets us lay down a strip of a precise area of soil to match the nozzle dimensions for every robot. The mass of soil isn’t chosen at random either. We measure a proportional amount that’s related to the flooring material, type of debris, plus each vacuum’s nozzle width.
We conduct three cleaning runs (at minimum) on each floor type. We also perform cleaning tests with sand and rice separately. That comes to at least 18 tests per robot vac. We weigh the robot’s dust bin both before and after each run. From there we can calculate the percentage of debris pickup for every cleaning run and the average amount of soil a machine manages to remove. Additionally we run anecdotal (visual) pet hair tests for each robot, on all three floor types.
Our rice-based, medium-size particle test didn’t show enough differentiation between each cleaner, which says they can all handle larger particles without trouble. For fur removal for pet owners, we judged anecdotally.
How we test cordless vacuums
We tested a vacuum’s ability to clean up sand and rice.