20.500.12556/RUL-179110 Data quality in estimates from probability-based online panels systematic review and meta-analysis Background: General population surveys now increasingly use nonprobability samples from access panels instead of probability-based methods, which often leads to lower-quality estimates. In response, many official and academic surveys have adopted probability-based online panels (PBOPs), which use probability sampling and retain participants for follow-up surveys. While these panels reduce costs compared to one-time surveys, they still face low response rates and other challenges that may affect data quality. Objective: This study aimed to assess the accuracy of PBOPs by synthesising evidence on relative bias (RB), and to examine how RB varies by country, domain, measurement level, and item sensitivity. Methods: A systematic review yielded 44 eligible studies from 12 countries, and 1,897 effect sizes of absolute RB from studies that compared PBOP estimates to benchmarks. A three-level random effects meta-analytic model accounted for variance across studies, within studies and sampling variance. Moderator analyses evaluated the influence of country, item topic, measurement level and sensitivity on RB. Sensitivity analyses excluded the top 5% of RB outliers to test robustness. Results: The pooled RB was 23.14% (95% CI: 18.38%–27.91%) and heterogeneous. Most variance was attributed to within-study item-level differences. Country and topic did not significantly moderate RB. Items with high topic sensitivity had significantly higher RB (+19.33%) than items with no sensitivity. Ordinal items had significantly lower RB than nominal (–14.90%). However, when sensitivity and measurement level were modelled together, substantial residual heterogeneity remained. Conclusion: While PBOPs offer cost and logistical advantages, they require careful design considerations to lower substantial bias, especially regarding item sensitivity and measurement scale. PBOPs may not be suitable for certain question types, like sensitive or low-prevalence behaviours, especially when high accuracy is needed. Improved methodological planning and innovations are needed to improve PBOP data quality. online surveys probability-based online panels data quality relative bias meta-analysis spletne ankete true false true Angleški jezik Slovenski jezik Članek v reviji 2026-02-05 10:20:49 2026-02-05 10:20:54 2026-02-06 04:53:00 0000-00-00 00:00:00 2026 0 0 Str. 173-197 iss. 1 Vol. 15 2026 0000-00-00 Zaloznikova Objavljeno NiDoloceno 0000-00-00 0000-00-00 0000-00-00 303.62 1805-4951 10.18267/j.aip.279 249607427 Vehovar_et_al_AIP.pdf Vehovar_et_al_AIP.pdf 1 8F2FF6892E31659C0A0C929C48EF4192 2f478ede3befb652b328c9d0ce74d1678dd260697ff0a0e3d672d6c0b40e108b 11456951-0274-11f1-a1ba-0050569b8976 https://repozitorij.uni-lj.si/Dokument.php?lang=slv&id=227264 https://aip.vse.cz/artkey/aip-202601-0011_data-quality-in-estimates-from-probability-based-online-panels-systematic-review-and-meta-analysis.php?back=%2Fsearch.php?query%3D%255B%2BHackerSite%253A%2BKunghac.com%2B%255D%252Chacker%2Bde%2Bwhatsapp%2Bcontratar%252Ccontratar%2Ba%2Bhacker%252Ccontratar%2Bhacker%2Bgratis%252Chacker%2Bonline%2Bcontratar%252Ccontratar%2Bun%2Bhacker%252Ccontratar%2Bhacker%2Bdeep%2Bweb%252Ccontratar%2Bhacker%2Bgratis%252Chacker%2Bonline%2Bcontratar%252Ccontratar%2Bun%2Bhacker%252Ccontratar%2Bhacker%2Bdeep%2Bweb%252C%26sfrom%3D0%26spage%3D30 0 46fccfbf-0274-11f1-a1ba-0050569b8976 https://repozitorij.uni-lj.si/Dokument.php?lang=slv&id=227266 Fakulteta za družbene vede 0 0 0