# Archive for the 'FAQ' Category

## Explaining our Handling of “Holds”

24th February 2016

UPDATE (Feb. 25, 2016): MLB has informed us that they will be updating Brach's 2015 holds total to 15 (matching us). MLB's Cory Schwartz commented: "We do credit Holds whenever the pitcher enters in a Save situation and leaves with the lead intact, so this was an oversight on our part."

It recently came to our attention that for the 2015 season, we credited Brad Brach with 15 holds. MLB, meanwhile, credited Brach with just 14 holds (NOTE: After reading this post, MLB has agreed that 15 is the correct number of holds for Brach in 2015). It was discovered that the difference was in the handling of the Orioles 5-4 win over the Mariners on May 21. Before we jump into the details, let's examine MLB's definition of a hold (bolding is ours, for emphasis):

"The hold is not an official statistic, but it was created as a way to credit middle relief pitchers for a job well done. Starting pitchers get wins, and closers -- the relief pitchers who come in at the end of the game -- get saves, but the guys who pitch in between the two rarely get either statistic. So what's the most important thing one of these middle relievers can do? "Hold" a lead. If a reliever comes into a game to protect a lead, gets at least one out and leaves without giving up that lead, he gets a hold. But you can't get a save and a hold at the same time."

UPDATE (Feb. 26, 2016): Please see MLB's updated Holds definition here

As you can see, this isn't really much of a definition at all. There's little in the way of criteria here, and it's also pointed out that the statistic isn't even official, anyways. In fact, there's enough confusion that MLB.com credits Cory Rasmus with 2 holds in 2015, but Elias (MLB's official statistician) credits him with 1 hold in 2015. We credit him with 2, for what it's worth. This "definition" provides enough room for interpretation that variance in recorded totals is not uncommon.

Being that the statistic is unofficial, explaining all of this might be a pointless exercise, but in an effort to be transparent, we at least want to point out what standard we are using to assign holds.

Our standard is to give a pitcher a hold any time they protect a lead in a save situation (meaning they could have been eligible for a save if they finished the game). Brach presents an interesting study in that May 21 game. Starter Chris Tillman pitched 3 innings and left with a 4-1 lead. Obviously, he was not eligible for the win due to Rule 10.17(b), as he did not complete 5 innings. Tillman was relieved by Brian Matusz, who allowed 2 runs in the 4th, but completed the inning of work and left the game leading 4-3, when Brach took the mound for the 5th inning. Brach completed 2 scoreless innings, but the Mariners tied it up in the 7th after Brach left the game. The Orioles eventually won the game.

With the benefit of hindsight, you could say that Brach would have been in line for the win (not the save) if he had finished the game, since he ended up being more "effective" than Matusz, which would make it nearly a lock that the official scorer would have given him the win. But, hypothetically, Brach could have given up 20 runs in relief, but maintained the lead, and earned the save (with Matusz getting the win). As unlikely as that scenario is, the point here is that we're not using hindsight in assigning holds. In our opinion, the opportunity for a hold is defined when you enter the game and is only removed retroactively if you are given the win.

To be as clear as possible: our policy is to credit a hold when a pitcher enters the game in a save situation and leaves with the lead (and is not later given the win by the official scorer).

As we bolded in MLB's definition of a hold, "If a reliever comes into a game to protect a lead, gets at least one out and leaves without giving up that lead, he gets a hold." It would sure seem to us that Brach's May 21st appearance fits that criteria.

2019-07-09 Update on Long Holds

We were silent on this issue earlier, but we do not give a hold in the situation where a reliever is only in line for a "long save". A long save would be the type where they pitch three innings with the lead to end the game. For example, on June 29th in London Yankee Nester Cortes entered a 14-6 game in the bottom of the 4th with two outs, and a runner on first. This is not a standard save situation. He then pitched three innings in relief and did not relinquish the lead. If he'd gone on to complete the game he would have received a save, but his appearance did not begin as a save situation as the save is dependent on him pitching three innings. We do not include these situations as save situations and do not credit holds in these cases. This is true of most record keepers, but we are aware that MLB gameday did give Cortes a hold in this situation.

This wonderful Hardball Times article spells out the many differences in how holds and blown saves are calculated. It turns out no two sources agree on any of the league totals for holds or blown saves.

## SRS Calculation Details

3rd March 2015

One of the more common subjects for queries we receive at Sports-Reference is our SRS (Simple Rating System) figures. For some background, the first of our sites to add SRS was Pro-Football-Reference, when Doug Drinen added it to the site in 2006 and provided this excellent primer. The important thing to know is that SRS is a rating that takes into account average point differential and strength of schedule. For instance, the 2006-07 Spurs won games by an average of 8.43 points per game and played a schedule with opponents that were 0.08 points worse than average, giving them an SRS of 8.35. This means they were 8.35 points better than an average team. An average team would have an SRS of 0.0. The calculation can be complicated, but the premise is simple and it produces easily interpreted results.

However, there are some variations in the way we calculate SRS across our various sites. We'll break down these differences below.

Pro-Football-Reference.com SRS: PFR's SRS is unique in that a home-field advantage is included as a part of the calculation because of the short schedule compared to the other sports (we don't want a team to look relatively weak at the halfway point because they've only played 3 of their first 8 at home, for instance). This HFA fluctuates yearly based on game results, but it is generally somewhere between 2 and 3 points (2006 being an outlier, as you'll see). Below is a look at the HFA numbers we have used since 2001. If you'd like to calculate these HFAs yourself, just sum up every team's home point differential and then divide by the total number of games played across the league that season. This data can easily be found in the Play Index for each season:

• 2001: 2.0081
• 2002: 2.2461
• 2003: 3.5547
• 2004: 2.5078
• 2005: 3.6484
• 2006: 0.8477
• 2007: 2.8672
• 2008: 2.5586
• 2009: 2.2070
• 2010: 1.8945
• 2011: 3.2656
• 2012: 2.4336
• 2013: 3.1055
• 2014: 2.4883

College Football SRS: Our CFB SRS does not contain a home-field advantage element, but it does have some other quirks. Most importantly, we have capped the margin of victory considered for the formula. Due to the number of mismatches seen in college football, the maximum point differential a team can be credited with in a game is 24. We also credit all wins as a minimum of plus-7 margin of victory (so if you win by 1 point, it's treated the same as a 7-point win). The same logic is applied to losses, as well. One other wrinkle for CFB is that all non-major opponents are included as one team for the sake of the ratings.

College Basketball SRS: SRS for college hoops is straight forward (no HFA & no adjusted MOV), but one item to note is that games against non-major opponents are not counted in our calculations.

MLB, NBA & NHL: All of these SRS calculations are straight forward with no adjustments for HFA and no capping of MOV. It should be noted, however, that no special consideration is given for extra-innings, overtimes or shootouts, either.

We'll close with a quick rundown of the various merits and weaknesses of SRS, from Drinen's original 2006 post. These bullet points were created to describe the system used for NFL SRS, but many of the strengths and weaknesses can applied to the other sports, as well:

• The numbers it spits out are easy to interpret - if Team A's rating is 3 bigger than Team B's, this means that the system thinks Team A is 3 points better than Team B. With most ranking algorithms, the numbers that come out have no real meaning that can be translated into an English sentence. With this system, the units are easy to understand.
• It is a predictive system rather than a retrodictive system - this is a very important distinction. You can use these ratings to answer the question: which team is stronger? I.e. which team is more likely to win a game tomorrow? Or you can use them to answer the question: which of these teams accomplished more in the past? Some systems answer the first questions more accurately; they are called predictive systems. Others answer the latter question more accurately; they are called retrodictive systems. As it turns out, this is a pretty good predictive system. For the reasons described below, it is not a good retrodictive system.
• It weights all games equally - every football fan knows that the Colts' week 17 game against Arizona was a meaningless exhibition, but the algorithm gives it the same weight as all the rest of the games.
• It weights all points equally, and therefore ignores wins and losses - take a look at the Colts season. If you take away 10 points in week 3 and give them back 10 points in week 4, you've just changed their record, but you haven't changed their rating at all. If you take away 10 points in week 3 and give back 20 points in week 4, you have made their record worse but their rating better. Most football fans put a high premium on the few points that move you from a 3-point loss to a 3-point win and almost no weight on the many points that move you from a 20-point win to a 50-point win.
• It is easily impressed by blowout victories - this system thinks a 50-point win and a 10-point loss is preferable to two 14-point wins. Most fans would disagree with that assessment.
• It is slightly biased toward offensive-minded teams - because it considers point margins instead of point ratios, it treats a 50-30 win as more impressive than a 17-0 win. Again, this is an assessment that most fans would disagree with.
• This should go without saying, but - I'll say it anyway. The system does not take into account injuries, weather conditions, yardage gained, the importance of the game, whether it was a Monday Night game or not, whether the quarterback's grandmother was sick, or anything else besides points scored and points allowed.

## P-F-R Position Abbreviation Glossary

1st October 2013

We often get emails about some of the more... let's say "esoteric" positional abbreviations in the P-F-R database (the most confusing of which date back to the earliest days of professional football). Here's a handy guide in case you ever get stuck wondering what in the world some of these positions are:

Posted in Announcement, FAQ, Pro-Football-Reference.com, Stat Questions, Trivia | Comments Off on P-F-R Position Abbreviation Glossary

## Everything You Wanted to Know About Wins Above Replacement (WAR)

5th June 2013

With Wins Above Replacement (WAR) gaining more prominence since last season, it's a good time to remind everyone about our WAR 2.2 guide:

• Baseball-Reference.com WAR Explained - This explains the basics of WAR, the philosophy behind the stat, and some of the changes we made to the formula the past few years.
• Weighted Runs Above Average (wRAA) Explained - This describes how wRAA, the core hitting stat of WAR, is computed.
• Position Player WAR Calculations and Details - This explains how we turn wRAA, Baserunning & Double-Play Runs, Fielding Runs, Positional Adjustment Runs, and Replacement level Runs into WAR for position-players.
• Pitcher WAR Calculations and Details - This explains how we take a pitcher's runs allowed & innings pitched, and turn it into WAR.
• Converting Runs to Wins - This further describes the process by which Runs Above Replacement (for both pitchers and position players) are converted into Wins Above Replacement.
• WAR Comparison Chart - This chart shows the differences between the WAR found here at Baseball-Reference and those from a variety of other sources, including FanGraphs & Baseball Prospectus.
• WAR Data Downloads - If you want to download the raw WAR data yourself and play around with it, you can also get the Batting and Pitching data from our site.