Why Rankings Lie (and How to Rank for Yourself)
A school three spots higher feels better. Here’s why that feeling is manufactured, and what to build instead.
The cover of this book names three things you’re choosing on: prestige, money, and fit. This is the prestige chapter. I’m not going to tell you rankings don’t matter, because that would be a lie in the other direction. What I’ll do instead is take the ranking apart, show you which pieces are real and which are just for show, and point out who makes money when you treat it as gospel. Then I’ll help you build a better ranking of your own.
The trap is that rankings feel objective. A number is a number. 12 is higher than 18, and your brain wants to believe the school at 12 is simply better than the school at 18. That feeling probably does more damage to this choice than anything else, and it’s worth real money to the people who publish the list. Let’s take it apart.
The number is faker than you think
Start with one fact. In the most recent cycle, Stanford passed Yale for the number one spot. That ended a long stretch where Yale was the clear best law school in the country. Did Yale get worse in a single year? Did Stanford suddenly start making better lawyers? No. The formula got tweaked, a few inputs shifted, and the two most respected schools in the country swapped places right at the top, where the gaps are supposed to mean the most.
Think about what that means. If the gap between number one and number two is small enough to flip when the formula changes, then the gap between number 12 and number 18 is basically noise. It’s inside the margin of error of a formula that somebody designed and redesigns every year. A school six spots higher isn’t six spots better at anything you care about. It’s six spots higher on this year’s recipe.
The positions move around below the top too. Every cycle, schools jump and fall, sometimes by a lot, and not because they got better or worse. The formula changed, or a couple of inputs wobbled. The thing you’re treating as a fixed measure of quality is really a yearly reshuffle. Ranks that sit next to each other feel different, and they almost never are.
Want to see it for yourself? Take any two schools a few spots apart on the list. Pull the five numbers from chapter 3, especially the bar-required employment rate. Lay them side by side. A lot of the time the “higher” school’s real outcomes are a point or two off the “lower” one’s, or worse. But your gut had already decided the higher one was better. The gap you felt isn’t in the data. It’s in the ranking position, which means it’s in your head, put there by a list.
Here it is worked out. Take two schools five spots apart. That gap feels real when you say it out loud: number 20 versus number 25. Pull their bar-required employment rates and medians. You might find something like this. The “better” school at number 20 places 87 percent into bar-required jobs, with medians of 162 and 3.7. The “worse” school at number 25 places 88 percent, with medians of 161 and 3.7. The lower-ranked school placed a little better and admits nearly the same students. So the five-spot gap that felt like a quality difference is, in the data that actually decides your life, either noise or pointing you the wrong way. And those two could swap ranks next year on a formula tweak. A number precise enough to feel real, and arbitrary enough to mean almost nothing. (Illustrative; check your actual schools and you’ll see the pattern.)
What the ranking actually measures, one piece at a time
Let me walk through the inputs. Once you see what’s in the formula, you stop treating the output as magic. These are the weights from the current recipe. They change every year, so pull this year’s before you lean on any of it. The categories are pretty stable, though, and the categories are what matter.
About a third of the score is employment outcomes. Another quarter is bar passage. So well over half the ranking is about outcomes, which is good, because those are the real things. Here’s the problem, though. The ranking blends every school’s outcomes into one national number. It doesn’t know that you want to practice in Houston, or that you want public-interest work, or that you’d never move to the city where this school places best. It takes your specific future and averages it into a national mush. The inputs that should drive your choice get flattened into a number that isn’t about your life at all. You can read those same outcomes yourself, for your market and the job you actually want, and get a much better answer than the average gives you. You already did that last chapter.
About a quarter of the score is reputation surveys. Law school deans and faculty rate each other. Lawyers and judges rate schools too, on a one-to-five scale. It’s basically a popularity contest among insiders. A lot of them are rating schools they have no current knowledge of, based on a reputation that formed years or decades ago. Reputation is the slowest, most backward-looking thing in the formula. It tells you how a school was seen a generation ago, not how its graduates are doing now. And it’s a quarter of the score.
About a tenth of the score is selectivity. That’s the median LSAT and GPA of the people they admit, plus how few applicants they accept. Read that again, because it’s a little wild when you see it clearly. Part of a school’s “quality” score is just how strong its incoming students are. Not what the school does for those students. Who it lets in. Which means a school can climb by admitting higher numbers, and the easiest way to admit higher numbers is to buy them with scholarships, from students like you. So the selectivity input is the exact thing that turns your strong numbers into a recruiting target. That connects straight back to chapter 1. The ranking rewards schools for landing your medians, so schools pay for your medians. The ranking and the scholarship offer are running on the same machine.
The rest is spending and resources: library materials, the student-to-faculty ratio. That mostly measures how rich the school is, not how well it teaches you or how its grads do. It’s wealth, dressed up as quality.
So add it up. Half and then some is outcomes, flattened into a national average that ignores your actual life. A quarter is reputation, which barely moves. A tenth is how good the students were before the school ever touched them. A sliver is wealth. That’s the famous number. It’s not a measure of how good a school will be for you. It was never built to answer that question.
The year the rankings broke
Here’s something that should shake your trust in the list all by itself. A few years ago the rankings didn’t just wobble. They cracked.
For about 30 years one magazine ran the market. Then, late in 2022 and into 2023, the schools revolted. Yale walked away first and said it would stop handing over its data. Within months, dozens of law schools followed, including most of the famous ones. The people the ranking measures stopped feeding it. And the formula that ranks them has been lurching through revisions ever since, changing which inputs count and by how much, year after year.
A couple of things come out of that. First, schools game this list, and they always have. A ranking that turns reputation into pricing power is worth a lot of money, so schools fight over it, feed it, and every so often get caught cooking an input to climb a few spots. A number people cheat to move isn’t a clean measure of anything. Second, when the formula keeps changing and half the subjects stop cooperating, the middle of the list turns to mush. The difference between number 34 and number 51 was always mostly noise. Now it’s noise from a broken instrument that half the schools stopped talking to.
And here’s the part that connects to the last chapter. The rankings broke at almost the same moment the real data got good. Right as the list got less trustworthy, the employment grids, the price disclosures, and the bar results all got easier to pull and easier to read. So the applicants who come out ahead now are the ones who stopped handing the decision to a magazine and learned to read the filings themselves. Which brings us to the deeper problem with the list, the one that holds even in the years nobody’s boycotting it.
The ranking is always a year behind the truth
There’s a built-in flaw here that should end your deference to the list, even setting everything else aside. The ranking is a trailing indicator. It’s built partly on reputation surveys that move painfully slowly, and partly on outcome data that’s already a year or two old by the time it’s published. So a school’s rank tells you how it was doing a while back, filtered through how people remember it doing a while before that.
Meanwhile the thing you actually care about is moving in real time: where this school’s graduates are getting jobs right now. And you can read that straight off the 509. When a school’s outcomes slide, the ranking is the last to notice. In one recent year, some schools’ employment rates fell ten, fourteen, even seventeen points. Those are real drops, real graduates not getting jobs. And the ranking that’s supposed to measure quality lagged well behind, because reputation hadn’t caught up to reality yet. A school can be quietly getting worse for two cycles before the magazine’s number shows it. A student reading the rank instead of the 509 would never see it coming.
It runs the other way too, in your favor. A school that’s improving its outcomes is often underranked next to how it’s actually doing now. That can mean strong current outcomes at a school still priced and judged like its older, weaker self. The 509 is the current number. The rank is the old one. When they disagree, and they often do, believe the current one. You’re reading this year’s truth. The magazine is printing last year’s reputation of the year before that.
Who profits when you treat the list as gospel
Now the part the list never mentions: who makes money when you defer to it.
The publisher makes money. A ranking has to change every year, or there’s no new list to sell and no reason for fifty thousand applicants to refresh the page. The churn isn’t a bug, it’s the product. A stable, honest “these forty schools are roughly equal for most purposes” doesn’t sell magazines or clicks. A reshuffled top twenty does.
The schools profit too, the high-ranked ones especially. A ranking that anchors you on prestige lets a famous school charge you full price, while a school with better outcomes for your life has to pay you to attend. The list turns reputation into pricing power. The schools with reputation love it, which is why they feed it, fight over it, and sometimes get caught gaming it.
So who doesn’t come out ahead when you treat the ranking as truth?
You do.
The two parties who design and dominate the ranking conversation, the publisher and the prestigious schools, both make money when you defer to it. The one party whose money is actually on the line, you, is the one the ranking serves the least. It answers a question, which school is most prestigious on average this year, that isn’t your question. Your question is which school gives you the best outcome for your target at a price you can afford.
I’ll put my own cards on the table, same as always. I sell LSAT prep. A strong score helps you climb exactly the selectivity input I just told you to discount. So weigh this knowing I benefit when you chase a higher number. I’m telling you to discount the ranking anyway. The ranking isn’t the thing that decides your life. Your outcome, your market, and your debt decide your life, and you can measure all three yourself.
Build your own ranking, in four steps
So throw out the magazine’s ranking and build the one that actually matters to you. It takes about twenty minutes, and you come out of it holding a tool. Here’s how to build it.
Step one: list the factors that decide your next ten years. Not the magazine’s factors. Yours. Where you want to practice. The kind of law you want to do. What you’ll owe when you graduate. The bar-required job rate, from the 509, for the work and the market you actually want. Maybe a specific program, a clinic, a city, or a family situation that anchors you somewhere. Five or six factors, the ones that are real for your life. Write them down.
Step two: weight them to a hundred, by your life. Decide how much each factor is worth, out of a hundred total, based on what matters to you, not what matters to a magazine. Here’s one worked example, for a reader who wants public-interest work in a specific city and can’t take on heavy debt:
- Net price across three years: 30
- Bar-required placement into my city: 30
- Placement into public-interest specifically: 20
- Fit and life factors (family, cost of living): 15
- Reputation, for the doors it opens: 5
Notice reputation is still on there. It isn’t zero, it’s real, and prestige does open some doors. It’s just 5 out of 100 for this person, not the silent 100 the magazine assigns it. Now here’s your blank. Take the same hundred points and spread them across your own factors, by your life. A different reader, aiming at big-firm work, might put reputation at 25 and placement-into-biglaw at 30. That reader is also right, because it’s their hundred, not yours.
Step three: score each school on each factor, off the real data. Go school by school, factor by factor. Score each one straight from the 509 and your own research, not from the brochure and not from the badge. Net price from chapter 6’s math. Placement from chapter 3’s five numbers. Fit from chapter 7. Reputation from the ranking, sure, but only for its 5 or 25 points, whatever you assigned it.
Step four: total it, and trust the disagreement. Add up each school’s weighted score. The ranking you get will disagree with the famous one, and that disagreement is the whole point. Your number-one might be the magazine’s number-fifteen. The magazine weighted reputation and national averages. You weighted your city, your debt, and your job. When your ranking and the magazine’s disagree, go with yours. Yours is about your life. The magazine’s is about selling a list.
Here’s the build worked out, illustrative, so you can watch the disagreement happen. Take the public-interest reader’s weighting from above (net price 30, placement into my city 30, public-interest placement 20, fit 15, reputation 5). Score two schools, each from 0 to 10 on every factor, then multiply by the weight.
The famous school: net price 3 (it’s expensive and gave her nothing), city placement 6, public-interest placement 5, fit 6, reputation 10. Weighted, that’s 90 plus 180 plus 100 plus 90 plus 50, which totals 510.
The in-state school: net price 9 (it pays her), city placement 9, public-interest placement 9, fit 8, reputation 5. Weighted, that’s 270 plus 270 plus 180 plus 120 plus 25, which totals 865.
The in-state school wins by a mile on her weighting, 865 to 510. On the magazine’s weighting, which loads up reputation and national averages, the famous school would win easily. Same two schools, opposite answers. The only difference is whose life the weights describe. That gap, 865 versus 510, is roughly what it costs to let a magazine rank for you. (Illustrative scores; the method is the point, not the digits.)
One ranking can’t serve two people
Here’s why a single national ranking can’t serve you. Look at two readers.
From the coaching file. Two students, same admit cycle, opposite lives. Maya wants to be a public defender in her home state. She has a partner with a rooted job there, and she hates the idea of debt. Theo wants big-firm corporate work. He’s single and portable, and he’s willing to carry debt to land on the high salary hump. Hand them the same magazine ranking and it tells them the same school is best. But run their own rankings and they split completely. Maya’s number-one is a well-regarded in-state school that placed strongly into public defense and offered her most of tuition. She’ll graduate nearly debt-free into the exact job she wants. Theo’s number-one is a higher-prestige school in a major market with strong big-firm placement, where the debt is real but the salary hump is reachable. Same list, two correct and opposite answers. The list was never the thing. Their weightings were.
That’s why you build your own. A national ranking has to give everyone the same answer. But the right school is a different school for Maya, for Theo, and for you. The magazine can’t know your life. You’re the only one who can weight it.
KEEP THESE 3
- The ranking is a yearly reshuffle of a formula, not a fixed measure of quality. If number one and number two can swap on a methodology tweak, the gap between number 12 and number 18 is noise. Ranks that sit next to each other feel different, and they usually aren’t.
- Look at what’s actually in the number. Outcomes flattened into a national average that ignores your market, plus a quarter reputation that barely moves, plus a tenth that’s just how strong the students were before the school touched them. It was never built to tell you which school is best for you.
- The publisher and the prestigious schools make money when you defer to the list. You don’t. So build your own ranking: list your factors, weight them to a hundred by your life, score each school off the 509, and total it. When yours disagrees with the magazine’s, go with yours.
Next, you’ve read the data and built your own ranking. Now put them to work before the offers even exist, and build a list of schools actually worth getting an offer from.
