Longreads + Open Thread

Scott Adams, WhatsApp, WASPs, Leo XIV, Pólya, Writing, Assumptions, Karp

Longreads

SPONSORED

You're on the free list for The Diff. This week, paying subscribers read about thermostatic state capacity ($), another lens for economic convergence between software and other sectors ($), and thoughts on trucking safety company Motive ($). Upgrade today for full access.

Upgrade Today

Books

The Philosopher in the Valley: Alex Karp, Palantir, and the Rise of the Surveillance State: One way to understand companies is to look at what kinds of problems the people in charge get a kick out of solving. Gates enjoyed getting the best possible performance out of minimal hardware, and for a while that's what Microsoft was all about; Benioff clearly likes persuading people of things (especially persuading them that Benioff is a really swell guy), so he runs a company where sales is what it's all about; hedge funds and prop trading firms are run by people who find measured risk-taking an energizing pursuit; etc. In Palantir's case, Alex Karp is a philosophy PhD who likes exploring tricky moral arguments, and has helpfully designed a company so it presents one moral conundrum after another.

People talk about companies like Palantir being a threat to democracy because they enable mass surveillance, but the Karp-friendly approach is to say that it's actually a fantastic thought experiment to discuss in your dorm room while passing a bong around (Karp makes a few references to weed use throughout the book): would you rather have a computer watching you 100% of the time and only flagging things for human review if there were evidence of something suspicious going on, or for you to be spied on by a human observer for a random 1% of your time? Which one's actually creepier? Which one actually has worse consequences for society? And can we even treat this as a serious premise, or are there technical and social limitations that mean that you can't have the panopticon-with-nobody-looking?

These are actually fun questions to argue about. But whatever answer you get to is going to make someone think you're deeply evil. That's just something you have to deal with if you're going to build tools that governments use to carry out their functions, because modern democratic governments reflect the will of whatever portion of the population voted for the winner, and, in an efficient market in political coalitions, that means there are plenty of people on the losing side of highly salient issues.

In fact, to the extent that Palantir is a threat to democracy, it comes from another angle: The Diff wrote long ago about compromise through presumed incompetence, i.e. breaking a political logjam by letting one side create a policy they like but that they have no hope of enforcing. If that compromise roughly reflects the popular will, then making the government more efficient in that respect actually means thwarting the popular will. (Palantir usually does this in right-coded ways, but the leftier version of it would be selling software that makes it easier for the IRS to identify spurious deductions made by small business owners. People who run small businesses skew very heavily to the GOP, and have a fair amount of discretion about how they allocate expenses between personal and business use. In effect, we've agreed that the tax code should slightly subsidize these businesses relative to big companies that can't get away with the same things.)

Karp apparently has a strong enough preference for novelty that it isn't enough to run a highly productive gedankenexperiment factory. He has to add other kinds of weirdness, too. At one point, the book describes him interviewing a candidate for a job. The candidate happened to be the grandson of British fascist Oswald Mosley (not "fascist" in the sense of "right-wing and I don't like them," but fascist in the sense of "founded the British Union of Fascists"). The interview opened with Karp reciting a speech Oswald Mosley gave opposing Britain's participation in the Second World War. "[H]e went on for a few minutes, reproducing the speech from memory... When Karp finished, he executed a few tai chi moves and walked out of the room without saying goodbye." (The other Mosley was hired.)

Palantir sometimes gets accused of being a cult. When I briefly lived in the Bay Area a decade ago, it seemed that no houseparty was too small not to have a Palantirian wearing a "Save the Shire" t-shirt. The Diff referred to the cult-like aspects of the company as one of its competitive advantages. And it turns out that Karp is quite aware of this, and, later in the book, laments that Palantir is less of a cult than it seems.

Every company that was founded fairly recently and is now huge is going to be weird. If they were normal, there would be plenty of substitutes for them and they wouldn't have grown so quickly. But Palantir seems more like it's optimized to keep leaning into weirdness, in the same way that Amazon (disclosure: long) optimizes for launching tiny new projects that have the potential to grow into something that can absorb billions of dollars in capital. That means the company actually serves an important, irreplaceable social function: technological progress always creates tricky moral questions, and Palantir has designed itself to systematically raise those questions early.

Open Thread

Diff Jobs

Companies in the Diff network are actively looking for talent. See a sampling of current open roles below:

Even if you don't see an exact match for your skills and interests right now, we're happy to talk early so we can let you know if a good opportunity comes up.

If you’re at a company that's looking for talent, we should talk! Diff Jobs works with companies across fintech, hard tech, consumer software, enterprise software, and other areas—any company where finding unusually effective people is a top priority.