We tested 100 eBay sold-comp searches. 37.9% of priced rows were classified out.
Across 100 predeclared product searches, CompSniper parsed 19,220 priced rows and retained 11,942 after title-based relevance cleaning. The product median changed by at least 10% in 34 searches and by at least 50% in 11. This measures classifier behavior on one fixed sample, not human-labeled accuracy or future sale prices.
Collected August 31, 2026 from ebay.com. Published and reviewed by Marc Andrew, Owner of CompSniper.
Cleaning often changed the sample more than the median
The weighted row-removal rate was 37.87%, while the median absolute product-level price change was 4.2%. That distinction matters. Removing many obvious accessories may leave the center price nearly unchanged, while a smaller number of badly priced mismatches can move it substantially.
Most searches moved modestly, but the tail was large
Removal rates varied by product type
Each category contained exactly 20 products. The percentages below are weighted by priced rows, while the median price-change column gives equal weight to each product.
| Category | Raw | Clean | Removed | Median abs. change |
|---|---|---|---|---|
| Smartphones and tablets | 4,168 | 2,251 | 45.99% | 4.74% |
| Gaming and computing | 4,284 | 3,158 | 26.28% | 3.21% |
| Cameras and lenses | 3,616 | 2,520 | 30.31% | 0.52% |
| Audio and music | 3,507 | 2,083 | 40.6% | 7.03% |
| Collectibles and luxury | 3,645 | 1,930 | 47.05% | 8.84% |
The tail is why row-level evidence matters
These are the 15 largest absolute median changes in this sample. A large movement is a reason to inspect the retained and removed listings, not proof that every classification was correct.
| Product | Category | Rows | Raw median | Cleaned median | Change |
|---|---|---|---|---|---|
| GoPro Hero 12 Black | Cameras and lenses | 219 to 61 | $59.99 | $230.00 | +283.4% |
| Lenovo ThinkPad X1 Carbon Gen 11 | Gaming and computing | 222 to 14 | $293.50 | $602.49 | +105.28% |
| Canon RF 70-200mm f2.8 L IS USM | Cameras and lenses | 224 to 46 | $1,104.50 | $2,097.00 | +89.86% |
| NVIDIA GeForce RTX 4090 | Gaming and computing | 233 to 51 | $1,399.00 | $2,599.99 | +85.85% |
| Sony Walkman TPS-L2 | Collectibles and luxury | 114 to 45 | $328.55 | $573.00 | +74.4% |
| Yamaha HS8 pair | Audio and music | 234 to 39 | $246.36 | $420.00 | +70.48% |
| Sony FE 24-70mm f2.8 GM II | Cameras and lenses | 229 to 62 | $1,061.10 | $1,714.50 | +61.58% |
| Samsung Galaxy Tab S9 128GB | Smartphones and tablets | 209 to 19 | $211.99 | $340.00 | +60.38% |
| Panasonic Lumix GH6 body | Cameras and lenses | 138 to 20 | $571.00 | $882.49 | +54.55% |
| Google Pixel 7 Pro 128GB | Smartphones and tablets | 226 to 69 | $424.09 | $199.99 | -52.84% |
| LEGO Titanic 10294 | Collectibles and luxury | 179 to 107 | $400.00 | $600.00 | +50% |
| Line 6 Helix Floor | Audio and music | 201 to 23 | $554.99 | $795.00 | +43.25% |
| Bose QuietComfort Ultra Headphones | Audio and music | 228 to 100 | $165.20 | $226.25 | +36.96% |
| Chanel Classic Flap Medium Black | Collectibles and luxury | 226 to 136 | $3,000.00 | $4,025.00 | +34.17% |
| Audient iD14 MKII | Audio and music | 91 to 27 | $179.99 | $225.00 | +25.01% |
Fixed before the first request
- 1. Products: 100 named products across five categories, 20 per category, selected before collection.
- 2. Query: One keyword per product on ebay.com, page one, ended-recently sort, any condition.
- 3. Window: Sold dates from June 2 through August 31, 2026.
- 4. Sample: 240 requested results. Pre-cleaning counts can be slightly higher because eBay may return more rows before the response cap is applied.
- 5. Comparison: `rawMedian` and `rawSampleCount` were captured before title classification from the same fetched page. Cleaned statistics were computed afterward.
- 6. Execution: Two workers, one-second start pacing, bounded temporary retries. All 100 requests succeeded with unique request IDs.
What this study can and cannot establish
No human-labeled ground truth
The study measures production classifier behavior. It does not calculate precision, recall, or prove that every removed row was irrelevant.
One marketplace and one run
All searches used ebay.com on August 31, 2026. Other dates, marketplaces, pages, conditions, and query wording can produce different samples.
Bounded search pages
A result page is not the full population of eBay sales. Reported headline counts can be much larger than the parsed sample.
Best Offer uncertainty
2,184 cleaned rows carried an accepted Best Offer marker. The accepted amount is not disclosed and may differ from the visible price.
Title-based classification
Cleaning used listing titles. Details visible only in descriptions or images may not affect classification.
Not a price forecast
A cleaned median summarizes this historical sample. It is not a formal appraisal or a guarantee of a future transaction price.
All 100 products
Smartphones and tablets
- 01Apple iPhone 15 Pro 128GB
- 02Apple iPhone 14 Pro 128GB
- 03Apple iPhone 13 128GB
- 04Samsung Galaxy S24 Ultra 256GB
- 05Samsung Galaxy S23 Ultra 256GB
- 06Google Pixel 8 Pro 128GB
- 07Google Pixel 7 Pro 128GB
- 08OnePlus 12 256GB
- 09Apple iPad Pro 11 4th generation 128GB
- 10Apple iPad Air 5th generation 64GB
- 11Samsung Galaxy Tab S9 128GB
- 12Apple Watch Ultra 2
- 13Apple Watch Series 9 45mm
- 14Samsung Galaxy Watch 6 Classic 47mm
- 15Sony Xperia 1 V 256GB
- 16Motorola Razr Plus 2023
- 17Samsung Galaxy Z Fold 5 256GB
- 18Samsung Galaxy Z Flip 5 256GB
- 19Kindle Paperwhite 11th generation
- 20reMarkable 2 tablet
Gaming and computing
- 01Sony PlayStation 5 Slim Disc Edition
- 02Microsoft Xbox Series X 1TB
- 03Nintendo Switch OLED
- 04Steam Deck OLED 512GB
- 05ASUS ROG Ally Z1 Extreme
- 06NVIDIA GeForce RTX 4090
- 07NVIDIA GeForce RTX 4080 Super
- 08AMD Radeon RX 7900 XTX
- 09Apple MacBook Pro 14 M3 Pro 18GB 512GB
- 10Apple MacBook Air M2 13 8GB 256GB
- 11Dell XPS 15 9530
- 12Lenovo ThinkPad X1 Carbon Gen 11
- 13ASUS ROG Zephyrus G14 2023
- 14Intel Core i9-14900K
- 15AMD Ryzen 9 7950X3D
- 16Samsung 990 Pro 2TB SSD
- 17Meta Quest 3 128GB
- 18PlayStation Portal Remote Player
- 19Nintendo 3DS XL
- 20Analogue Pocket
Cameras and lenses
- 01Sony A7 IV body
- 02Sony A7 III body
- 03Canon EOS R6 Mark II body
- 04Canon EOS R5 body
- 05Nikon Z6 II body
- 06Fujifilm X-T5 body
- 07Fujifilm X100VI
- 08Panasonic Lumix GH6 body
- 09DJI Osmo Pocket 3 Creator Combo
- 10GoPro Hero 12 Black
- 11Sony FE 24-70mm f2.8 GM II
- 12Sony FE 70-200mm f2.8 GM II
- 13Canon RF 24-70mm f2.8 L IS USM
- 14Canon RF 70-200mm f2.8 L IS USM
- 15Nikon Z 24-70mm f2.8 S
- 16Sigma 24-70mm f2.8 DG DN Art Sony E
- 17Tamron 28-75mm f2.8 G2 Sony E
- 18Fujifilm XF 16-55mm f2.8 R LM WR
- 19Leica Q3
- 20DJI Mini 4 Pro Fly More Combo
Audio and music
- 01Shure SM7B
- 02Shure MV7
- 03Rode NT1 5th Generation
- 04Neumann TLM 103
- 05Audio-Technica AT2020
- 06Sennheiser HD 650
- 07Sennheiser HD 800 S
- 08Sony WH-1000XM5
- 09Bose QuietComfort Ultra Headphones
- 10Apple AirPods Max
- 11Focusrite Scarlett 2i2 4th Gen
- 12Universal Audio Apollo Twin X Duo
- 13Audient iD14 MKII
- 14Yamaha HS8 pair
- 15KRK Rokit 5 G4 pair
- 16Fender Player Stratocaster
- 17Gibson Les Paul Standard 60s
- 18Boss Katana 50 MKII
- 19Line 6 Helix Floor
- 20Akai MPC Live II
Collectibles and luxury
- 01Rolex Submariner 126610LN
- 02Omega Speedmaster Moonwatch 3861
- 03Tudor Black Bay 58 79030N
- 04Seiko Prospex SPB143
- 05Air Jordan 1 Chicago Lost and Found size 10
- 06Nike SB Dunk Low Travis Scott size 10
- 07Adidas Yeezy Boost 350 V2 Zebra size 10
- 08Pokemon Charizard Base Set 4/102 PSA 9
- 09Pokemon Pikachu Van Gogh PSA 10
- 102023 Topps Chrome Victor Wembanyama #1 PSA 10
- 112018 Panini Prizm Luka Doncic #280 PSA 10
- 121986 Fleer Michael Jordan #57 PSA 8
- 13LEGO Millennium Falcon 75192
- 14LEGO Titanic 10294
- 15Nintendo Game Boy Advance SP AGS-101
- 16Sony Walkman TPS-L2
- 17Louis Vuitton Neverfull MM Monogram
- 18Gucci GG Marmont Small Shoulder Bag
- 19Chanel Classic Flap Medium Black
- 20Hermes Birkin 30 Togo
Study FAQ
What did the 100-product study measure?
It measured how CompSniper's title-based relevance cleaning changed the priced sample and median for 100 predeclared product searches. Each request reported the raw sample count and median from the same upstream page, then returned the cleaned rows and deterministic price summary.
Did relevance cleaning always increase the median?
No. The median increased for 73 products, decreased for 21, and was unchanged for 6. Cleaning removes rows based on product relevance, not whether their prices are high or low.
Does this study prove that every removed listing was wrong?
No. This was not a human-labeled precision and recall evaluation. It reports what the production relevance classifier removed and how the summary changed. The public product-level CSV does not claim that every classification decision was correct.
How were accepted Best Offer listings handled?
The cleaned sample contained 2,184 rows marked as accepted Best Offer, or 18.29% of cleaned priced rows. eBay does not disclose the accepted amount, so those markers are reported as a limitation rather than treated as exact transaction prices.
Inspect the data or run your own sample
Download the product-level CSV, inspect the reproducible collector, or use the free API tier to test your own queries with raw and cleaned evidence.