Methods

How we build a study.

Every study starts with a question someone in a community would actually ask, and ends with a number they can check for themselves.

Start with the newest data.

Most of our work starts with public sources: the Census Bureau's American Community Survey and County Business Patterns, the CDC's PLACES and BRFSS health data, and labor statistics from the Bureau of Labor Statistics.

Before every pull we check whether a newer release is out, and we say which release a number comes from so anyone can find it.

Go as local as the data honestly allows.

We break national data down to the county, city and ZIP code wherever the source supports it. Where a small area is too noisy to trust, we say so instead of publishing a number that won't hold up.

We never invent a local split the data doesn't have. If a measure only exists at the state level, it's reported at the state level.

Run our own surveys when we have to.

Some questions no government dataset answers. For those we write and run our own surveys, and we publish the sample size, the dates and how people were reached.

Smaller surveys are described as what they are. When a survey reaches about a hundred people, we call it a pulse survey and say plainly that it describes those respondents, not everyone.

Label every number.

A percentage means little without knowing what was measured and out of what. We write out what each figure counts, give the count of people behind a percentage where we can, and keep totals and per-person rates clearly apart.

We don't claim one thing caused another unless the data shows it.

Check it twice.

Before anything is published, a second reviewer rebuilds the key figures from the raw data and reads every claim against its source. Anything that doesn't match gets fixed or comes out.

Share the work.

Each study comes with its method. If you want the underlying file, or the numbers for a place we didn't cover, ask and we'll send it.

Questions about a number?

Write to us and the person who worked on it will answer.

Get in touch