Modeling ratings migration for credit risk capital and loss provisioning calculations

RMA Journal, The, Oct, 2004 by Jorge Sobehart, Sean Keenan

Reliable loss prediction requires both robust estimation methods and accurate data. This article presents a way to leverage ratings agency data that can provide greater flexibility and stability of results in simulation-based estimates of future portfolio losses.

Based on a simple behavioral model that quantifies the structural relationships in historical default frequencies and transition rates for different ratings, (1) this technique leads analysts to hypothetical transition matrices for portfolio loss simulations that preserve the basic relationships observed in the historical transition and default rates reported by the ratings agencies, allowing for unlimited sampling. The matrices can also be linked to macroeconomic factors to mimic the dynamics of credit cycles and economic shocks, allowing for richer descriptions of plausible future scenarios and what-if scenario analysis that goes beyond the limitations of historical data.

The Basel II capital adequacy framework provides strong incentive for financial institutions to use internal risk management systems to measure risk and determine sufficient regulatory and economic risk capital. While commercial risk measurement tools can be used as part of an overall solution, institutions must tailor them to their own portfolio specifications. Further, some of the development and implementation of the new systems will fall to their own risk management teams.

In many cases, whether they use commercial models or internal methodologies, analysts continue to rely on data from the major ratings agencies for default rates, ratings migration rates, and other key statistics. Despite recurring and somewhat troubling issues regarding the meaning and consistency of ratings, regulators tend to be more accepting of methodologies based on agency data because of the agencies' long and well-documented ratings histories. This data may indeed be deeper and may conform better to an accepted standard than banks' own internal ratings histories, yet the depth of agency data generally falls short of what's needed for the Monte Carlo-based economic risk capital estimation techniques in widespread use today.

The Shortcomings

The simplest portfolio loss model assumes that ratings transition probabilities are stable across obligor types and across the business cycle, and that a single set of average historical ratings transition and default rates is all that's needed to characterize potential future losses. However, there is ample evidence that credit migration and the ratings process depend on a number of factors, such as the state of the economy-for example, the probability of downgrades and defaults is greater in a downturn than in an upturn. Moreover, historical data is volatile; thus, the average-rate approach will understate potential tail loss--the very thing we want to measure with precision. A slightly more sophisticated alternative is to use observed annual historical-rating transition rates as a sample from which to draw plausible future credit migration scenarios to simulate the forward loss distribution. The main drawback of this method is the small number of historical-rating scenarios on which to draw. Accurate Monte Carlo simulations for large portfolios usually require tens--or even up to hundreds of thousands--of random draws. However, because historical scenarios number only in the tens, the simulated loss distribution will tend to be lumpy as tail losses bunch up around the worst year from the historical period. Clearly, this problem cannot be overcome by increasing the number of Monte Carlo simulations.

A Behavioral Model of Risk Perception

A different approach is to directly model the relationship between transition probabilities and macroeconomic factors and then simulate plausible ratings migration patterns over time by generating various macroeconomic conditions. To do this, we need a behavioral model of how risk ratings are assigned. Let's begin with the observation that ratings are opinions of credit quality, representing different degrees of belief in the credit quality of the firm. Agency statistics, such as default and transition frequencies, are merely by-products of this rating assignment process, rather than properties inherent to the ratings themselves2 Analysts' judgments, meanwhile, are based on a combination of qualitative and quantitative comparisons of the credit risk they perceive. Even if specifically attempting to arrive at a default-probability calculation, the analyst cannot be sure of the precise relationship between the risk factors affecting the obligor and his or her own mental model of risk perception, which may lead to errors in risk assessment. Thus, even with complete and perfect information on the obligor's risk exposure, the analyst would still face "model risk" because of judgment. Any qualitative comparison between two risk exposures is clearly probabilistic in nature since it relates to uncertain events. Unfortunately, analysts' perceptions of the probability of default, expected losses, and future ratings revisions are not publicly available and therefore cannot be tested. However, we can construct a behavioral model for the average perceived risk that can be calibrated with historical default and transition rates associated with a given risk perception (rating at a given point in time) assuming that the ratings are unbiased estimates of the average (ex-ante) analyst's perception of the risk criterion.