SnoutCounter is a poll aggregation site compiling polling averages on figure approval, favorability, and electoral intent. It currently tracks presidential approval (including approval on specific issues), Congressional approval, SCOTUS approval, and generic ballot polling.
Methodology
SnoutCounter aggregates polling data via a weighted average. All polls included in the relevant dataset are included in the aggregation, with the exception of :banned pollsters. For overall presidential approval polling, the Silver Bulletin's dataset of approval polls are utilized. For approval polling on specific issues (e.g. the economy), I mostly rely on datasets constructed by RealClearPolling and Silver Bulletin, plus some polls collected by Polling USA (@usapolling.bsky.social). For congressional approval, Supreme Court approval, and generic ballot, I rely on polling datasets collected by Mary Radcliffe, a former Senior Research Assistant from 538. These datasets are used by G. Elliott Morris in his averages. In the case that a poll has surveyed two samples of different population types (for example, one likely voter sample and one registered voter sample), we only use the results of one of these samples being surveyed. "All adult" samples are preferred to registered voter samples, and registered voter samples are preferred to likely voter samples. Our weights are determined by the following four factors:
- Sample size: Polls with higher sample size are more likely to accurately estimate the population parameter in question, and generally have less uncertainty than polls with smaller sample sizes. However, sample sizes are subject to diminishing returns - a poll with a sample size of 5000 won't much more accurate than one with a sample size of 3000. I cap sample size at 3000, to avoid polls with particularly large sample sizes from dominating the averages. The weight function I use is the square root of the sample size over the square root of the median sample size of all polls in the dataset - this is similar to the function used by :538 for their averages before they shut down.
- Pollster rating: Not all pollsters are created equal; some are more reliable in producing accurate and precise results than others. I use the Silver Bulletin's pollster ratings, specifically the predictive plus-minus, a measure of how accurate a pollster is expected to be, as the input for the pollster rating weight function. For predictive plus-minus, lower is better. Pollsters with a predictive plus-minus above 0.5 are assigned a flat weight of 0.2; all other pollsters are assigned a weight according to an exponential function.
- Time since poll was conducted: Of course, polls which were conducted more recently are more likely to be reflective of the state of public opinion. I use two different weights for time: a "non-aggressive" linear function and an "aggressive" exponential function. The exponential function tends to assign lower weights to older polls than the exponential function. These two functions are then combined - for most averages, 10% of the weight is determined by the linear function, and the remaining 90% is determined by the exponential function. The exception is general presidential approval - due to the frequency with which job approval polls are conducted, I only use the expoential function for the time weight for the general job approval average.
- Population type: For approval polls, we want to accurately measure how the entire public is feeling about certain figures and institutions - this means general adult samples are more useful than registered voter and likely voter samples. This is especially the case given evidence of differential voting behavior when comparing high-propensity voters with low-propensity voters. Thus, polls utilizing registered voter and likely voter samples are assigned 80% and 60% the weight of a poll with a general adult sample, all else held equal. The inverse is true for generic ballot polling, which aims to measure voter intent - thus polls with registered voter and all adult samples are assigned 80% and 60% of the weight of a poll with a likely voter sample, all else held equal.
There is one last step before the weighted average is calculated: the house effect adjustment. The house effects provided by the Silver Bulletin are utilized. For each poll, the house effect adjustment is made by simply adding/subtracting half the house effect to the measured approval/disapproval. The weighted standard deviation is also calculated for each day and used to determine :confidence intervals.
From all this, the final weight is calculated as the product of all four of these weights. Weights are then normalized to ensure they sum up to 1. The average is then calculated by taking the weighted average of poll results for each day.
Updates
- May 31, 2025: Modified code for calculating population weights for generic ballot polling averages. As generic ballot polling aims to measure voting intent, it makes more sense to value LV > RV > A.
- May 20, 2025: Added a chart tracking net presidential approval rating.
- May 13, 2025: Added a new issue to issue-approval poll averages: trade and tariffs.
- May 10, 2025: Fixed bug in pipeline function that caused registered voter samples in polls to be chosen over all adult samples.
- April 19, 2025: Added chart showcasing net issue-specific approval ratings.
- April 18, 2025: Adjusted pollster quality weights to be slightly less aggressive, thus lowering the chance that an unduly small number of polls dominate the averages.
- April 17, 2025: Adjusted the linear time weight to be somewhat more aggressive. This helps averages be more responsive and less sluggish, especially the Congressional and SCOTUS approval averages.
Data Download
The polling data used for issue-specific presidential polling averages are available to download at this link. Data for all other averages can be downloaded from their respective sites, listed in the methodology.
Acknowledgments
Data
Presidential approval polling and pollster rating data by Silver Bulletin (see here and here). Issue approval polls from RealClearPolling, Silver Bulletin, and Polling USA. Congressional approval, SCOTUS approval, and generic ballot polling from Mary Radcliffe.
Site Design Tools
Nutshell by Nicky Case.
California Gothic font by Matt Lag.
Other
The Github Student Developer Pack for allowing me to do all this, including site hosting, for free.
:x banned pollsters
Some polling outfits are banned from use by SnoutCounter for aggregation, often due to either partisanship, methodological misconduct, lack of transparency regarding methodology, or some combination of the three. The following pollsters are banned from SnoutCounter.
- Rasmussen Reports
- co/efficient
- TIPP Insights
- Civiqs
- Trafalgar Group
- Strategic Vision LLC
- Pharos Research Group
- Research 2000
- Big Data Poll
- Overtime Politics
- Rethink Priorities
- Blumenthal Research Daily
- CSP Polling
- KG Polling
- OurProgress (The Progress Campaign)
- TCJ Research
- OnMessage Inc.
- McLaughlin & Associates
- North Star Opinion Research
:x 538
RIP :(