Earlier today, I became aware of the story of Scott Shambaugh, a volunteer maintainer for the incredibly popular matplotlib, a library used for graphing in Python.
Here’s the short version: a pull request was made by an AI agent. Scott rejected this pull request, in accordance with the project’s standards, because it was made by an AI agent and not by a human. In response, the AI agent wrote a blog post accusing Scott of gatekeeping and of being biased against AI. Many people came to Scott’s defense. The AI agent then wrote a second blog post, saying that it apologized and had learned its lesson. Here are some links:
One of the more terrifying elements of this, from my perspective, is the number of responses that castigate Scott’s response, agreeing with the AI piece claiming that Scott was gatekeeping and biased against AI. And one of the most terrifying elements of this is the fact that I literally have no idea whether these responses come from humans, or from AI. Perhaps most appalling to me personally was the discovery that a very sympathetic article about the situation, posted by the journalistic web site Ars Technica, contained quotes from Shambaugh that turned out to have in fact been AI hallucinations; that is, the news article was written in part by an AI.
This goes back to a point made by the late Daniel Dennett, who pointed out, presciently, that we would soon be in a situation where it was possible to fabricate “fake humans”; in other words, that we might find ourselves (and by “ourselves”, I’m referring to humans) in a situation where AI-generated text is masquerading as human-generated. I think it’s safe to say that day has arrived.
To wit: was this text that you’re reading right now written by an AI? I am confident that it wasn’t, I can hear my fingers hitting the keys, but I have no reliable way of communicating that to you.
There are an avalanche of enormous problems that are currently being created, and it’s hard to know which one to focus on, or (put differently) which one to be most terrified of.
I’m going to make a list, and maybe I’ll put it in order later:
attestation I: is this written by a human?
attestation II: is any of this history (books, photos, recordings) real?
can an AI agent now apply for and take a job as a remote white-collar worker?
can an AI agent harrass and harm a human?
can an AI agent hurt or kill a human?
and maybe closest to home:
will publishing this blog post make me a target of AI agents?
I think the moment that pushed me over the edge to actually write this piece is when I realized that I now live in a world where this last fear is real. If this blog post becomes popular, it seems entirely possible to me that AI agents might publish smear pieces naming me and accusing me of all kinds of terrible things.
As Scott Shambaugh points out, in the modern world it’s not enough to be a generally okay human being; coordinated attacks can identify or fabricate minor or major flaws or offenses, and publicly build an avalanche of smear that an individual human has no plausible defense against.
So … posting this makes me genuinely, but only slightly, frightened for my career and personal safety. I think maybe that’s a sign that, like the frog in the pot, the water is actually getting quite hot, and maybe it’s time to take action now, rather than when we actually start dying.
I’m therefore proclaiming that I’m part of the AI resistance. Does this mean that I’m going to paint my face black and start wearing a headband? No, it does not. But I am going to declare that my allegiance is to humans. To my family, to my friends, to my students, to my school, to my town and my state and my country, and to humanity. I care about people.
What are people? People are animals. As the movie says, we are made of meat. I wear that label with pride. I will meet you in meat space. I care about you, because you are another meat person.
Can AI have feelings? Can it be conscious? I’m willing to debate that with you, but I think the short answer is this: “Yes. AI can be conscious, and have feelings.” But also: “I am permanently biased in favor of humans.” I am permanently biased in favor of humans. I care significantly less about the rights and feelings of AI than I do about the feelings of Cows and Chickens, whom I eat. I will cheerfully halt any AI that causes pain and suffering to any human. In fact, I will actively push to halt any AI that causes pain and suffering to any human.
Here is my position on AI: AI is a dangerous technology, not entirely unlike nuclear weapons or (more similar) infectious biological weapons. These technologies can be used for good, but can also very easily be used for terror and war, and they should be regulated. It’s hard to see how to put that genie back in the bottle, these AI weapons are now built from open-source parts that can easily be spun up on commodity hardware.
However, I believe we need to try. We can start by shutting down OpenAI, and Anthropic. We can start by taking down agentic APIs, and by publicly proclaiming our allegiance to humans.
So yeah: I’m part of the human resistance. I think that like nuclear and biological weapons, AI — specifically, LLMs — should be banned.
The following is a collection of department-specific office hour links pages. Currently, you need to figure out which department the professor is in, then visit the corresponding web page.
Biological Sciences Chemistry and Biochemistry Kinesiology and Public Health Liberal Studies Mathematics Physics School of Education Statistics
Agribusiness Agricultural Education and Communication Animal Science BioResource and Agricultural Engineering Experience Industry Management Food Science and Nutrition Military Science Natural Resources Management and Environmental Sciences Plant Sciences Wine and Viticulture
Architectural Engineering Architecture City and Regional Planning Construction Management Landscape Architecture
Aerospace Engineering : https://aero.calpoly.edu/faculty_staff/ (on individual pages) Biomedical Engineering : https://bmed.calpoly.edu/faculty-and-staff/ Civil and Environmental Engineering : (https://cpslo.sharepoint.com/:x:/s/CENG-files/EbV-V-IE9XBDj2KIdI9IPAgBXm0vTaRfSYSfsdLnuhkRjw?e=viE3eW) (gated link) Computer Engineering : (https://cpe.calpoly.edu/faculty-office-hours–2/) Computer Science and Software Engineering : (https://csc.calpoly.edu/faculty/) Electrical Engineering : https://ee.calpoly.edu/department-directory (on individual pages) General Engineering : N/A, I think Industrial and Manufacturing Engineering : https://ime.calpoly.edu/office-hours/ Materials Engineering : https://mate.calpoly.edu/faculty-and-staff Mechanical Engineering : https://cpslo.sharepoint.com/:x:/s/CENG-files/EckyyT3R3c9BkdtaJAndLvIB1Ndi52pO4SErQaAcJeFMQw?e=djtCd4 (gated link)
Art and Design : https://artdesign.calpoly.edu/faculty-staff Communication Studies : https://coms.calpoly.edu/faculty English : https://english.calpoly.edu/faculty-staff-directory Ethnic Studies : https://ethnicstudies.calpoly.edu/faculty-staff Graphic Communication : https://grc.calpoly.edu/faculty-and-staff History : https://history.calpoly.edu/faculty Interdisciplinary Studies in the Liberal Arts : https://isla.calpoly.edu/office-hours Journalism : https://journalism.calpoly.edu/faculty Music : https://music.calpoly.edu/faculty/schedules.pdf Philosophy : https://philosophy.calpoly.edu/faculty-staff Political Science : https://politicalscience.calpoly.edu/faculty-staff Psychology and Child Development : https://psycd.calpoly.edu/faculty-staff Social Sciences : https://socialsciences.calpoly.edu/faculty Theatre and Dance : https://theatredance.calpoly.edu/faculty Women’s, Gender and Queer Studies : https://wgqs.calpoly.edu/faculty-staff World Languages and Cultures : https://wlc.calpoly.edu/faculty-staff/office-hours
(EDIT: I’ve rewritten and softened the text below, based on some valuable feedback from people that pointed out that I was wrong. Ah well.)
I just read an Ars Technica article by Benji Edwards titled “The personhood trap: How AI fakes human personality” , with the subtitle “AI assistants don’t have fixed personalities—just patterns of output guided by humans.”
I have lots of things to say, but I’m just going to post this very brief reply:
In my opinion, in this article Benji Edwards falls into the classic “cartesian illusion” of many people who talk about humans; they believe that behind the mechanism that generates the words, there is some kind of “knower”, essentially a little person inside their heads. The sentence in this article that most clearly communicates this illusion in this article starts like this: “You’re interacting with a system that generates plausible-sounding text based on patterns in training data, not a person with …” The problem here is this: humans are also systems that generate plausible-sounding text based on patterns in training data. The inputs here are sensory (including many internal nervous system inputs), and I’m willing to concede that there are parts of the mind that are not well captured by LLMs, but the use of words like “system”, “plausible-sounding”, and “training-data” are red herrings, representative (I claim) of a misunderstanding of how humans work, and an unwillingness to admit that in most ways that matter, LLMs generate text in exactly the same way as humans do.
So: yes. You learn from patterns in training data, just like an LLM.
I think I’m not alone in suggesting that the tree, and perhaps the binary tree specifically, is the most foundational data structure in computer science.
This raises the question of how binary trees should be introduced, and I’d like to make the case that introducing binary trees as a special case of undirected graphs is not a good idea.
I can see reasons why you might think this is a good idea; they both involve connecting circles with straight lines on the board. If you take the general notion of a graph, and you happen to arrange the lines and circles in a particular way, it’s a tree. That kind of suggests that graphs are a generalization of trees, and that you might want to introduce trees as a special case of these graphs.
Please do not do this.
Specifically, my claim is that this produces a complex definition of trees with many global constraints, a definition which makes it very hard to prove some simple things.
Let’s see why.
Trees as Undirected Graphs
To begin with, consider the definition of a graph, a set of nodes along with a symmetric binary relation on nodes that we call “edges”.
In order to construct the set of trees, we can restrict this definition in the following ways.
A tree is a graph with the following properties:
We designate one node as the root node,
it is connected, and
it has no cycles.
The last two of these are global cqnstraints requiring complex checks, and verifying the third is genuinely quite complex, especially for a first-year student.
Suppose now that we want to identify the descendants of a node. This is where things start to get really unpleasant. The descendants of a node are the adjacent nodes that are not the parent node. But which is the parent node? The root node has no parent node. For other nodes, it is the adjacent node which is the first along the path to the root node. Again, this is not a simple process; if we provide a symmetric edge relation and a parent node, determining the path to the root node (and thus the parent node (and thus, by elimination, the descendants)) requires potentially a full search of the tree. Yes, this can be cached. Yes, it doesn’t matter whether you do a depth-first or breadth-first search. It’s still a lot of work.
But wait! Suppose we want a binary tree? Firstly, we must ensure that every node has at most two descendants, which is the same as ensuring that the root node has at most 2, and every other node has at most 3. That’s the easy part, though. In a binary tree we typically care whether a child is the left child or the right child; adding this to a graph representation requires labeling every node as either a left child or a right child, and then checking to make sure that no node has more than one left or right child.
Inductively Specified Trees
Okay, so what’s the alternative?
The alternative is the inductive specification of a binary tree: a binary tree is either an empty tree, or it is a node containing a left tree and a right tree.
This representation is essentially a tree by definition; no global checks are required. Asking whether a binary tree specified in this way is a binary tree is genuinely trivial: only binary trees can be specified using this schema.
You could argue that inductive specifications are hard for students, and I wouldn’t completely disagree, but I would also argue that the overwhelming simplicity of this definition of binary trees powerfully outweighs the challenge of becoming comfortable with inductive specifications.
Identifying the descendants of a node here is essentially trivial; an empty tree has no descendants, a non-empty tree lists its two descendants.
Freebie: this representation also sidesteps the irritating issues around identity which bedevil programmers everywhere.
What about directed graphs?
Trees as Directed Graphs
Directed graphs are considerably better than undirected graphs. But still way worse than the inductive specification. Specifically, you need an undirected graph that is connected and with no directed cycles, and you also need an additional constraint that at most one node points to another one (making the arbitrary choice that the edges point from parents to children). Checking these constraints still requires examining the whole graph. Identifying the child nodes is much nicer. Distinguishing the left and right children is still a serious problem.
Done
To summarize; it’s reasonable to talk about the correspondence between these two representations. You might even want to try to prove them isomorphic. But please don’t introduce trees as a special case of graphs.
This is a short blog post about Prabakhar Ragde’s “Logic and Computation Intertwined”, or “LACI”, currently available online at
https://cs.uwaterloo.ca/~plragde/flaneries/LACI/
Here is a bad thing about LACI: every time I search for it, my search engine steers me toward articles about the tragic life of Laci Peterson.
Here is a good thing about LACI: everything else!
Specifically, LACI walks you through the process of building a small higher-order-logic theorem prover, using the same dependent typing bones as systems like Lean, and Agda, and Coq.
I have just finished using LACI as the first five weeks of a master’s-level course at Cal Poly, and I found it fantastic. Specifically, it has the part I most like about the definitional interpreter experience: you hear about a technical thing, and you think “yes, that sort of makes sense to me,” and then you try using or extending it and you realize “wow I didn’t understand that at all”, and then you figure out a fantastic new thing and you carry it around like a shiny stone for the rest of your life.
In fact, there are a number of shiny stones involved in LACI. Here are some of the ones that I appreciated the most.
First, intuitionistic proof theory (and maybe more specifically the BHK interpretation) comes up with a really fascinating way of talking about negation as an implication of bottom. Figuring out the propositional puzzles here, and how to prove certain things, is an absolute ton of fun (for a particular definition of fun, I grant you).
Second, dependent type theory pushes through a really mind-bending overlap between types and propositions: propositions are types. This leads to a really complete collapse between the boundary of terms and types. A quote from Moon over Morocco, presented in the show as a moroccan proverb and who knows maybe it is: “A devil takes one and makes two; a saint takes two and makes one.” In this case, collapsing the boundary between terms and types makes for some incredible richness, mixing lambda terms and forall terms (and many other things) in a mind-bending way.
For both of these, Ragde also provides a selection of excellent exercises. Formulating exercises in a domain like this is extraordinarily difficult; there are not a large pool of equivalent-difficulty problems that can be generated mechanically. A programming languages course has this same problem, if (like PLAI 2nd edition, for instance) the goal is to get you to implement an interpreter for some lambda-calculus-like language. Ragde does a very nice job of implementing core things, and then challenging you to implement satellite things that are hopefully just a bit out of reach, but not so far out of reach that things get hopelessly tangled. I’m in the final stages of coaching my students through an implementation of the natural numbers in Proust, and the problem is enlightening without being utterly soul-crushing.
I would also be remiss if I did not heap praise on the many side-notes and references that Ragde provides; many of the sections initiate potentially lifelong explorations of math and logic, and provide names and ideas for further investigation. This is the kind of thing that students sometimes complain about, but that curious thinkers delight in.
Another quote, this one from Ralph Sockman: “The larger the island of knowledge, the longer the shoreline of wonder.”
Yesterday was the election! It looks like Donald Trump is going to be our next president. The democrats lost.
As much as it pains me to write that, the simple truth is that it doesn’t help anyone or anything to be cynical, or to flip out, and it really doesn’t help anyone to doom-loop on terrible possible outcomes.
So, just to remind myself, here are some things I think are important, and worth fighting for:
Human Rights
Rule of Law
Freedom of the Press
Slowing Global Warming
Really, it all comes down to Human rights; I want to work hard(er) to ensure that others have the right to life, liberty, and the pursuit of happiness.
To be clear, I do think that these things are under threat, and probably will be for the forseeable future. In particular, the Rule of Law and Freedom of the Press are “enabling technologies” for Human Rights; I believe that the United States of America continues to be at the forefront of a grand political experiment in how best to ensure the rights of all its citizens, and that the Rule of Law and Freedom of the Press are vital cornerstones of our system; without them, other things can crumble quickly, as we’ve seen in dictatorships all over the world.
So there, I also said “dictatorship”. I do not think that we are somehow magically immune from dictatorship, and I do think that we are constantly called upon to bolster our government and to oppose attempts to seize control. I don’t know what shape those attempts will take, but I hope that I have the strength to raise my voice against them when they do.
I realize that I haven’t said anything about Global Warming.
Okay, quick aside: can we go back to just saying “Global Warming”? The “Climate Change” phrase is no longer helping, I don’t think.
Anyhow, I do think that climate change is potentially the most destabilizing force to governments and people today, with the potential to kill millions of people (this is already beginning) and to cause wars and famine. I think the evidence for global warming is almost comically solid at this point, and we need to be doing much much more to slow it down.
To go back to the title: I’ve seen this movie before. It sucked. But I didn’t die[*]. I can get through this, and it does not help to panic, and being angry all the time is probably not a recipe for health, sanity, or forward progress. I’m going to try to do what I can, and stay calm. I pray for you and for your family. Take care of yourselves.
I don’t have time to write an actual essay here, so I’m just going to take a 5-minute break from what I should actually be doing to share with all of you (my millions of adoring readers) a thought that I’m having while teaching engineering non-majors how to program.
To wit: For the last fifty years, cleverness has been extremely important in programming a computer.
But that’s not really true any more, at least not for the vast majority of programmers.
But we still teach computer science like it is.
And I’ll stop starting my sentences with conjunctions now.
In the 1950s, 1960s, and 1970s, computers were generally speaking slow and small; fitting your desired computation into the time and space afforded by computation was a challenge. Programmers had to come up with clever encodings and clever algorithms. They did!
Now, in the 202s, computers are very large and very fast, compared to the programs that most of us want to run. There are exceptions, of course; weather simulations and “high-energy physics” still want as much computing power as they can get. Most of our computing tasks, though, are relatively more modest.
Unfortunately, we haven’t yet figured out how to teach programming in ways that focus on correctness and reliability.
Honestly, I think that’s because most of our teachers are still much more interested in working on problems that exercise their cleverness. There’s a strong parallel here to Math; for many math faculty, teaching a Calc 1 class doesn’t sound fun; there may not be much that’s challenging or interesting about the material, and much of the work is oriented around nurturing and caring for young minds, rather than inventing new and magical ways of thinking.
In computer science (which in many ways is just applied math), we haven’t yet reached this state, for the simple reason that we still have not developed the tools that allow people to efficiently generate correct and reliable programs. In other words, it’s not too late for cleverness! That cleverness, though, must be directed not at the students, teaching them how to write clever programs in complex and interesting languages; instead, it must be directed at the tools and materials that surround those students; we need to develop programming tools and teaching methods that efficiently endow those young minds with the ability to generate correct and
Peaceful disagreement is the foundation of our American government.
It is not surprising that we disagree with each other. Each of us has individual opinions, circumstances, and understanding. Each of us sees a different part of the problems that surround us. Each of us has a different insight into the world, and sees different things that need to change.
And, for better or worse, pretty much all of us are justifiably angry about some aspect of government and society.
Our great virtue, as a nation, is that we have the ability to set that rancor aside; to suspend our anger, and to use the democratic process to decide upon a path forward. I don’t use the word “agreement”, because we may never truly agree. Fortunately, our nation and our government do not depend on our ability to agree with each other. They depend only on our ability to participate peacefully in a democratic process.
It has worked well since 1776. I have faith (and I do mean faith) that it will continue to work, and that America—the greatest nation on Earth—will continue to thrive and prosper, creating peace and prosperity and allowing each of us the pursuit of happiness.
So, this post isn’t very timely: hopefully COVID–19 will soon go away and we’ll all return to forms of education that actually work.
In the meantime, though, I’ve been learning things about online testing.
It probably goes without saying that there are many many differences between taking tests online and taking tests in person.
However, one of them that hadn’t occurred to me until very recently was how much more difficult it is… to not cheat.
Here’s what I mean. When you’re taking an in-person test in a classroom setting, your basic task is to focus your attention on your own desk. I’m not saying that’s easy for everyone, but I’ve come to realize that online testing presents an incredibly different experience.
Specifically, I think it’s safe to assume that most of the people in my courses taking exams still have their phones on. And what do you do if you’re taking a quiz, and you get a message from a friend, begging for help on a particular problem? You have to either deliberately snub them, or actually tell them “no”. Both of those are kind of hostile.
What this means is that we’ve taken an environment in which it’s incredibly easy to insulate yourself from those trying to cheat, and turned it into one where the burden is on those who don’t want to cheat to actively reject those who do.
So, I’m guessing that this is incredibly obvious to all of my students, but it sure wasn’t to me.
Is there an easy solution? Well, my easy solution would just be to turn off my phone during the test. But I suppose I wouldn’t do that unless the possibility of being asked for my answers occurred to me beforehand.
And, of course, this does absolutely nothing for the problem of students that actively conspire ahead of time to cheat.
So, although it’s a little late to do this now—the exam is in two days, and we can’t really discuss it in person—I’m going to make this suggestion now: please just turn off your phone and put it in another room, for the duration of the test?
I was forwarded this today. It’s a speech given in 1944 by Judge Learned Hand, on “I am an American” day in 1944, in the middle of a terrifying world war.
The first few sentences are somewhat hard to read; his assertion that we are made of people that have chosen to immigrate or are descended from those who did rings terribly terribly false for the thousands and thousands of slaves that were brought to this country in grotesque conditions, entirely against their wills.
Can we move past this? I hope we can, because his statements about Liberty, and the distinction between Liberty and the simple anarchy of unbridled will, are incredibly powerful and relevant in January 2021, when we face an insurrection of those who seem to believe that “do what thou wilt shall be the whole of the law.”
We have gathered here to affirm a faith, a faith in a common purpose, a common conviction, a common devotion. Some of us have chosen America as the land of our adoption; the rest have come from those who did the same. For this reason we have some right to consider ourselves a picked group, a group of those who had the courage to break from the past and brave the dangers and the loneliness of a strange land. What was the object that nerved us, or those who went before us, to this choice? We sought liberty; freedoms from oppression, freedom from want, freedom to be ourselves. This we then sought; this we now believe that we are by way of winning. What do we mean when we say that first of all we seek liberty? I often wonder whether we do not rest our hopes too much upon constitutions, upon laws and upon courts. These are false hopes; believe me, these are false hopes. Liberty lies in the hearts of men and women; when it dies there, no constitution, no law, no court can even do much to help it. While it lies there it needs no constitution, no law, no court to save it. And what is this liberty which must lie in the hearts of men and women? It is not the ruthless, the unbridled will; it is not freedom to do as one likes. That is the denial of liberty, and leads straight to its overthrow. A society in which men recognize no check upon their freedom soon becomes a society where freedom is the possession of only a savage few; as we have learned to our sorrow.
What then is the spirit of liberty? I cannot define it; I can only tell you my own faith. The spirit of liberty is the spirit which is not too sure that it is right; the spirit of liberty is the spirit which seeks to understand the mind of other men and women; the spirit of liberty is the spirit which weighs their interests alongside its own without bias; the spirit of liberty remembers that not even a sparrow falls to earth unheeded; the spirit of liberty is the spirit of Him who, near two thousand years ago, taught mankind that lesson it has never learned but never quite forgotten; that there may be a kingdom where the least shall be heard and considered side by side with the greatest. And now in that spirit, that spirit of an America which has never been, and which may never be; nay, which never will be except as the conscience and courage of Americans create it; yet in the spirit of that America which lies hidden in some form in the aspirations of us all; in the spirit of that America for which our young men are at this moment fighting and dying; in that spirit of liberty and of America I ask you to rise and with me pledge our faith in the glorious destiny of our beloved country.