Methodology
How We Pick
A research-led method you can check, instead of testing you would have to take on faith. Here is every step, including the parts that cost us money.
By Brijon M. - Published October 2, 2026
What this site is, stated plainly
Penny & Pick is a research-led buying guide. We do not run a test lab. We do not have a decibel booth, a wear-test rig or a fleet of loaner units, and we have not personally owned every product we write about.
That is an unusual thing for a review site to volunteer, so here is why we volunteer it. The phrase "in our testing" is the single most common lie in this industry - it takes four words to type, it is nearly impossible for a reader to verify, and it is the first thing a competitor or a search quality rater will check. We would rather compete on a method you can reproduce than on a claim you have to trust.
Everything below is that method. If you follow the same five steps on a product we have not covered, you should reach roughly the same conclusion we would - and if you do not, we want to hear about it.
The method
Five steps, in this order
Step four and step five are the ones that cost us money, which is why they are the ones we are most careful to keep.
Start from the price, not the product
Every roundup begins with a ceiling a real person decided to spend - $50, $100, $200 or $500 - taken from what people actually search for. A product that is only under the ceiling during a sale that ended does not qualify. If a category has no honest answer at that ceiling, the page says so in the first paragraph instead of padding the list.
Read the specification against the price
We identify the two or three specs that decide outcomes in that category - suction in pascals and brush type for vacuums, movement and water-resistance rating for watches, panel type and refresh rate for monitors - and ignore the dozen that exist to fill a box on a retail page. Then we check whether the budget product actually has them or merely implies it.
Read what owners report after six months
New-product reviews measure first impressions; budget products fail later. We look for the repeated six-to-twelve-month complaints: battery capacity loss, hinge and connector failure, an app that stopped getting updates, a motor that lost power. A product nobody has owned long enough to report on is too new for us to recommend.
Compare against the tier above and below
A $100 pick is only a good pick if it beats the $50 option by enough to matter and loses to the $200 option by little enough to accept. Where the cheaper tier is genuinely good enough, we link you down rather than up - which costs us commission and is the entire point of the method.
Name the tradeoff, every time
No pick ships without a stated tradeoff: the specific thing you give up at this price. This is the hardest rule to keep and the one that makes the site worth reading. If we cannot articulate what you lose, we have not understood the product well enough to recommend it.
Disqualifiers
What never makes a list
A product that trips any one of these is out, no matter how well it reviews on day one.
Discontinued or unsupported
A product with no firmware updates and no warranty channel is a trap at any price, and the cheapest listings are very often exactly that.
Only cheap during a sale
If it is above the ceiling at its normal selling price, it does not belong in a roundup capped at that ceiling. Sale-price picks make a page look better and readers worse off.
A repeated safety pattern
Overheating batteries, failing load-bearing frames, scalding elements. One complaint is noise; a pattern is a disqualification, and no price justifies it.
Too new to judge
If nobody has owned one long enough to report what breaks, we cannot tell you what breaks. We wait rather than guess.
Common questions
+Do you physically test the products?
No. Penny & Pick is a research-led site, not a test lab. We read specifications against price, read long-term owner reports, and compare each pick against the tier above and below it. We never write that we tested something we did not.
+Why do you not show prices on the page?
Because a printed price goes stale within days and a stale price is worse than no price. Every buy button sends you to the live retailer page, where the number is current by definition. If and when a verified live price feed is connected to this site, prices will appear with the date they were checked.
+What disqualifies a product entirely?
Four things: it is discontinued or no longer gets firmware updates; it is only under the ceiling during a sale; there is a repeated safety or fire-risk complaint pattern; or it is too new for anyone to have reported what breaks. Any one of those and it does not appear, regardless of how good the spec sheet looks.
+Do you ever recommend spending more?
Often. Several categories on this site - robot vacuums, treadmills, anything with a motor and a load-bearing frame - have a price floor below which the product is a false economy. Where that is true the page says so before it names a product, and links you to the tier that works.
+Does commission affect the order of the picks?
No. The order is set before anyone looks at what a product pays, and a higher-paying product never moves up. Where a cheaper product that earns us less is the better buy, the cheaper product takes the top slot. The editorial policy page spells out the rule and the enforcement.
+How often are pages updated?
A page is revisited when a pick is discontinued, when a successor model lands, or when owner reports change the verdict. Each page carries the date it was last updated so you can judge for yourself whether it is current.
Something here wrong, out of date, or missing? Tell us and we will fix it - get in touch.