I am in Ben Guerir, Morocco, where I will be giving a plenary talk tomorrow at the World Conference on Complex Systems. I was planning to do a second part of the series on political instability in past societies, but my energy level after the long flight from the East Coast is too low. Instead, I’ll repost an old post of mine, which I wrote 13 years ago.
A bit of prehistory. After publishing my prediction for the coming wave of instability in the US in 2010 (see the inaugural post), I periodically revisited it and every time I was impressed by how closely the trajectory to date had followed the predicted path. This post addresses at the state of elite overproduction in America as I saw it in 2013 — well before Trump and many years before our current crisis. It’s remarkable to me how well this post aged — but you’ll be the judge.
Below the Surface: the Structural-Demographic Roots of the Current Political Crisis
The latest news from Washington is that there is a compromise in the making that would allow the government to raise the debt limit. But even if an eleventh hour agreement is reached tonight, it is clear to everybody that there will be more budget battles to fight in the months to come. As I wrote in a previous blog, our political elites are deeply divided among themselves and unable to reach a lasting compromise. The likelihood of a catastrophic default, sooner or later, is still very high.
The proximate reason for the current political crisis is an unbridgeable ideological divide. Each side (especially the Tea Party and the Democrats, with traditional Republicans caught in between) has drawn a line in the sand that it is unwilling to cross.
The ideological conflict has been “sacralized,” to use the terminology of Scott Atran. Killing ‘Obamacare’ has become a sacred value for the Tea Partiers, while preserving it is an equally sacred value for Obama and the Democrats. As Scott’s research shows, once a dividing issue has been sacralized, a compromise is very difficult and sometimes impossible.
But why have ideological differences been allowed to become so deep and so resistant to compromise? After all, the same basic tension between conservatives and liberals has been a constant feature of the American political landscape for at least a century, if not more. Yet during the 1950s and 1960s ideological differences were not allowed to get in the way of running the government. What has changed?
One observation that I and others (for example, McCarty, Poole, and Rosenthal) have noted is that political fragmentation waned and waxed together with economic inequality. Some popular press accounts of my views treat inequality as the cause of political instability (for example, in an otherwise excellent commentary by Dave Ross on CBS). However, this is not quite right. Inequality is a symptom, not the root cause. Yes, inequality harms cooperation and breeds conflict, but there is a deeper, more fundamental process that drives up both inequality and instability. This factor is intraelite competition, resulting from elite overproduction – too many aspirants for too few power positions.
Consider two facts. First, between 1983 and 2007 the number of American ‘decamillionaires’ (individuals with personal wealth exceeding $10 million) increased from 60 thousand to 460 thousand (that’s a five-fold increase in proportion to the total population!). Many of these newly wealthy people turned their attention to the political arena – either running as candidates themselves, or supporting others.
Second, between 1975 and 2011 the number of lawyers tripled from 400 thousand to 1.2 million (more than doubling in proportion to population). The law degree has always been and still remains the main route to political office in the United States. So the number of potential candidates for political offices increased manifold.
But the supply of offices themselves stayed flat. There are still 100 US senators and 435 US representatives today – same numbers as in 1970. When there are many more candidates vying for a limited number of positions, competition heats up, efforts (and methods) to defeat the opposition become increasingly desperate, and ‘us-versus-them’ mentality sets in.
Note that ‘us-versus-them’ does not need to refer just to Republicans-versus-Democrats. It might as well be true conservatives versus RINOs (Republicans In Name Only).
I am not saying that ideology is used purely cynically by politicians trying to get ahead in the game. For some this may be true, but the majority is clearly quite sincere in their convictions. The question is why politicians today are driven to extreme ideological positions and have lost their ability to compromise.
(As an aside, this is a non-political blog and usually I avoid singling out one or the other political party as being ‘right,’ but in this case it is clear to any disinterested observer that the radical, extremist element in the current crisis is largely, if not entirely, the far political right. This is supported by the quantitative research of McCarty, Poole, and Rosenthal, who showed that since the 1960s the Democrats remained pretty much in the same position on the liberal-conservative spectrum, while the Republicans have moved far to the right.)
Intraelite competition also helps us to understand some of the particular aspects of the current political situation. As I said above, what’s different today is that there are huge numbers of potential donors and an equally large pool of potential candidates – desperate law school graduates earning $50K per year, which is not enough to repay their Law School loans (I will have to devote another blog to tracing out how this stratum of desperate elite aspirants emerged). Such conditions make it very easy for unscrupulous political organizations, focused solely on their narrow agendas, to threaten sitting members of the Congress that they would run a well-funded challenger against any wavering congressman in the primaries, should they ‘cave’. Do I need name any names?
==========================================================
For those readers who are interested in the sources of the data I use in this blog, take a look at the (rough) draft of my book on structural-demographic analysis of American history, posted on my web site. The book manuscript also explains other aspects of structural-demographic dynamics, such as why the number of elite aspirants exploded between 1980 and now.
Back to the present. The book manuscript that I referred to in the last paragraph was published in 2016 as Ages of Discord.



Peter, I want to expect your writing,….but this needs more clarification:
“it is clear to any disinterested observer that the radical, extremist element in the current crisis is largely, if not entirely, the far political right. This is supported by the quantitative research of McCarty, Poole, and Rosenthal, who showed that since the 1960s the Democrats remained pretty much in the same position on the liberal-conservative spectrum, while the Republicans have moved far to the right.”
The authors of the paper represented here define the right as:
• Decreased support for government-provided transfers
• Advocacy for lower marginal tax rates
• Aggressive support for deregulation
So lets think about this…if the big government party has remained moderate, and the small government party has moved to the far right,…we can reasonably deduce that the federal government remained small or even shrunk in terms of regulation, spending, and debt over time, compared to whatever baseline the authors use.
Clearly the federal government has not remained small or even come close to shrinking,…in fact, it has grown severely by any measure you want to use. Number of regulations, spending as % of GDP or % of debt, debt as a % of GDP, etc.
Put it another way,…whatever the baseline the authors use, whether it be 1950 or 1980,…if a moderate from back then were to be time travelled to today and they knew nothing of the political composition of government, would they think government has exploded with growth (leftist ideology), remained moderated, or shrunk (right wing ideology)?
Most industries have had an explosion of spending and/or regulatory growth. Education, healthcare, housing (hello housing bubble), finance (post great recession), environment, manufacturing, agriculture/food production, transportation, etc.
If the argument is that the administrative state is doing most of the regulation, then the authors need to take that into account as a left wing enterprise,…which I doubt they did.
Whatever methodology the authors used, seems rather garbage to me. Crazy that it took four people to do this paper and not one researcher asked, how does government really work? Shouldn’t the real world effects of the size and scope of government match our methodology and conclusion? Peter, I have a strange feeling that these researchers were not “disinterested observers.” Be careful out there.
There are some obvious problems with your statistics. According to PoliEngine.com, there are 519,682 elected officials in the US (https://poliengine.com/blog/how-many-politicians-are-there-in-the-us). Of course most of those positions can't be considered elite, but most elite positions are not elected officials. I am from the New York City area where politics is normally seen as a place for 2nd rate lawyers and retirees. (An unexceptional high school classmate of mine served a few terms in the House of Representatives).
You shouldn't discuss the contemporary US like it was medieval England or China. Most of the wealth in the private sector. People usually study law as way of getting high-paying jobs in the private sector. Fewer people will study law if it not lucrative. I remember years ago the statistic that only half of people with law degrees are lawyers. Some current information can be found at https://en.wikipedia.org/wiki/Post%E2%80%93law_school_employment_in_the_United_States#
Why are congressman less willing to compromise now.
1. Extreme positions get more coverage in the attention economy
2. Gerrymandering means that many elected officials have more to fear from activists in their own party primary than foes in the general election
3. The passing of the WW2 generation
4. The movement of power from the Congress to the Presidency