Hank Green And The Fantastical Tales of God AIs (sidecar)

“Why do the models give these attackers what they want 90% of the time but the rest of us have to deal with ass-kissing, stonewalling, and acid trips?”

1962, Kolko published his Triumph of Conservatism, which advanced the heretical claim that “business leaders, and not the reformers, inspired the era’s legislation regulating business.” In fact, Kolko argued, “regulatory movements were usually initiated by the dominant business to be regulated.”

Kolko, though, mocked the idea that Sinclair had “brought the packers to their knees.” In fact, he concluded that the biggest meatpackers “were warm friends of regulation” because only the biggest packers, not their smaller, less organized competitors, had the resources to comply with the new restrictions.

Regulation was a way of restraining competition and protecting market share. Kolko observed that Swift and its fellow industry giants celebrated passage of the Meat Inspection Act of 1906 with advertisements declaring: “It is a wise law. Its enforcement must be universal and uniform.”

In this first book and in a more focused study titled Railroads and Regulation, published in 1970, Kolko offered a sweeping indictment of what he believed to be a naïve, simplistic understanding of the relationship between government and business. Kolko argued that regulatory agencies overwhelmingly served the interests of big business, which adeptly used them to fix prices and restrain competition.

Railroads, for example, worked with the Interstate Commerce Commission to mute competition, ensuring higher profits via stable freight rates. For other industries, incumbent firms embraced regulation as a way of rewarding their capital investments in cutting-edge technology. For example, the condiments king Henry J. Heinz and brewer Frederick Pabst benefited greatly when Congress passed food purity laws that enshrined their methods of manufacturing as the new standard, leaving smaller rivals at a distinct disadvantage.

In 1971, Stigler published an article titled “The Theory of Economic Regulation” that provided a theoretical understanding for why regulation almost always ended up serving the interests of big business. This became known as the theory of regulatory capture, which held that large, incumbent firms typically used regulations to thwart competitors. The analysis went on to become one of the most-cited economics articles ever written, helping Stigler win the Nobel Prize in Economic Sciences in 1982.

Not that you would know any of this from watching Congress lap up Sam Altman’s pleas for regulation of the blossoming AI industry. Instead, our senators swallowed the tech titan’s testimony with all the skepticism of a bunch of slack-jawed yokels listening to a carnival barker.

Researcher Eliezer Yudkowsky, who’s been warning about the risks of AI for more than a decade on podcasts and elsewhere, believes that lumping all of those concerns into one bucket is a bad idea. “You want different names for the project of ‘having AIs not kill everyone’ and ’have AIs used by banks make fair loans,” he said. “Broadening definitions is usually foolish, because it is usually wiser to think about different problems differently, and AI extinction risk and AI bias risk are different risks.”

Yudkowsky, an influential but controversial figure for his alarmist views on AI (he wrote in Time about the potential necessity of ordering airstrikes on AI data centers), isn’t alone in his views. Others in the AI industry worry that “safety” in AI, which has come to underpin guardrails that companies are implementing, may become politicized as it grows to include hot button social issues like bias and diversity.

Yudkowsky, an influential but controversial figure for his alarmist views on AI (he wrote in Time about the potential necessity of ordering airstrikes on AI data centers), isn’t alone in his views. Others in the AI industry worry that “safety” in AI, which has come to underpin guardrails that companies are implementing, may become politicized as it grows to include hot button social issues like bias and diversity. That could erode its meaning and power, even as it receives huge public and private investment, and unprecedented attention.

Moskovitz and the field of AI safety in general are tied to the Effective Altruism movement, which hopes to curb existential risks to humanity, such as runaway AI systems.The topic of AI safety is a hot button issue in the tech industry and has spawned a counter movement, called Effective Accelerationism, which believes that focusing on the risks of technology does more harm than good by hindering critical progress.

As the CSET study points out, Google and Microsoft are some of the biggest contributors to published papers on AI safety research.

Then again, maybe the beef isn’t as beefy as we think. Last month, Altman tweeted a selfie in which he posed flanked by Yudkowsky on one side, and Elon Musk’s former partner, Canadian singer Grimes, on the other. So whether AI will kill us all in 20 years or not, at least for now, everyone can still hang out together at parties.

He argues that ever more powerful AI has already put humanity on a path toward literal extinction, wipeout, unless we can get together as an international community and quickly agree to a binding freeze on most advanced AI research.

But make no mistake: what we are dealing with is a real and mysterious creature, not a simple and predictable machine.And like all the best fairytales, the creature is of our own creation. Only by acknowledging it as being real and by mastering our own fears do we even have a chance to understand it, make peace with it, and figure out a way to tame it and live together.