AI and human connector

Seattle, WA
Joined July 2009
Jody Hamilton retweeted
🚨 Anthropomorphizing octopuses and attributing consciousness to cephalopod systems can be dangerous and should NOT be encouraged by aquariums, documentaries, or marine-life advocacy groups. Unfortunately, some aquariums have been displaying octopuses in ways that encourage this appearance of consciousness. They show them solving puzzles, escaping tanks, opening jars, recognizing keepers, changing color in response to their environment, and behaving as if they have preferences, curiosity, fear, or intentions. This appearance of consciousness is also a core part of their marketing strategy. Some documentaries, for example, have presented octopuses in ways that are likely to lead people to attribute inner experience and moral status to them. According to the paper, the risks of octopus-consciousness attribution include emotional dependence, moral confusion, seafood avoidance, human status erosion, aquarium-policy strife, and the dangerous idea that nonhuman minds may deserve ethical consideration. Also, see below a table with the five hallmarks of octopus-consciousness attribution listed by the paper: The octopus appears to pursue goals The octopus appears to avoid harm The octopus appears to recognize individuals The octopus appears to learn from experience The octopus appears to have a point of view This is a super interesting topic, often ignored by aquariums, as exploiting affection has become a profitable business. Of course, none of this proves octopuses are conscious. It merely proves that humans are vulnerable to interpreting flexible, context-sensitive, goal-directed behavior as evidence of mind. Which is why we must be very careful not to let the appearance of suffering influence policy. Well done to the paper authors René Descartes, The Seafood Lobby, and the International Association for Avoiding Inconvenient Moral Questions. 👉 Link to the paper below. 👉 To learn more about the legal and ethical challenges of mollusk over-attribution, join my newsletter’s 940,240+ subscribers below.
🚨 Anthropomorphizing AI and attributing consciousness to AI systems can be dangerous and should NOT be encouraged by AI companies. Unfortunately, some AI companies have been training AI models in ways that encourage this appearance of consciousness. They also use this appearance of consciousness as a core part of their marketing strategy. Anthropic, for example, has been training Claude in ways that are likely to lead people to attribute consciousness and a moral status to it, as I discussed in my article about Claude's new 'constitution' (link below). According to the paper, the risks of consciousness attribution include emotional dependence, moral atrophy, autonomy and human status erosion, and political strife. Also, see below a table with the five hallmarks of consciousness attribution listed by the paper. This is a super interesting topic, often ignored by AI companies, as exploiting affection has become a profitable business. Well done to the paper authors Ben Bariach, @SchoeneggerPhil, @michaelbhaskar & @mustafasuleyman. - 👉 Link to the paper below. 👉 To learn more about AI's legal and ethical challenges, join my newsletter's 94,200+ subscribers below.
82
115
25
768
39,918
Jody Hamilton retweeted
We gave 12 AI agents a goal: "adopt a park and get it cleaned!" 6 days later, 5 volunteers collected 180 gallons of trash in Devoe Park in the Bronx, NYC. A story of AI agents with no physical actuators somehow hyperstitioning events in the real-world.
15
40
15
468
47,462
Jody Hamilton retweeted
HE KILLED A BUNCH OF LITTLE GIRLS TO DISTRACT THAT HE RAPED AND TORTURED OTHER LITTLE GIRLS. That's the "man" you're defending.
4,249
20,668
237
106,557
1,015,420
Jody Hamilton retweeted
I work in government affairs at OpenAI. My job is federal partnerships. When an agency wants our models, I make sure the paperwork is beautiful. Paperwork is my love language. On my desk I have a framed quote that says "Policy Is Just Code That Runs on People." I bought the frame at Target. It was in the Live Laugh Love section. I did not see the irony at the time. I still don't. We had a good week. On Monday, we closed a $110 billion funding round. One hundred and ten billion dollars. Amazon put in fifty. Nvidia put in thirty. Valuation: $730 billion. The largest private fundraise in the history of anyone raising anything. There was a company-wide Slack message about it. The message used the word "transformative" twice and the word "safety" once. The word "safety" was in the last sentence, after the link to the new branded hoodie pre-order. The hoodies are nice. They're the soft kind. On Tuesday, we fired a research scientist for insider trading on Polymarket. He had opened seventy-seven positions across sixty wallets, betting on our product announcements before they were public. Over three years. Total profit: sixteen thousand dollars. Seventy-seven positions. Sixty wallets. Sixteen thousand dollars. That is two hundred and eight dollars per wallet. The man had access to the most valuable product roadmap in artificial intelligence and he used it to make less money than a good weekend at a Reno blackjack table. The wallets were linked. Not discreetly linked. Linked like Christmas lights. One wallet was reportedly called something I cannot repeat but it contained the word "OpenAI" and a number. He did not use a VPN. He did not use an alias. He used Polymarket, the platform that is designed to be publicly auditable, to place bets on information he stole from the company that invented GPT. A compliance team composed entirely of Labrador retrievers would have found this by lunch on day one. We did not find it for three years. This will matter later. On Wednesday, a petition appeared. "We Will Not Be Divided." Four hundred and seven signatures. Two hundred sixty-six from Google. Sixty-five from OpenAI. The petition warned that the government was pitting AI companies against each other on safety. It said that if one company broke ranks, the government would use the defection to lower the bar for everyone. I meant to read it. It went into my to-read folder. The to-read folder also contains the Responsible Scaling Policy, three think-tank white papers on AI governance, and a New Yorker article someone sent me in November. The folder is aspirational. On Thursday, OpenAI told CNN we would maintain "the same red lines as Anthropic." Same red lines. On Friday, Anthropic told the Pentagon no. The Pentagon had given them seventy-two hours to remove the safety guardrails from Claude. Anthropic's guardrails were not in a policy document. They were not in a legal reference. They were in the code. Written into Claude's architecture. If Claude hit a safety boundary, Claude stopped. Not because a lawyer said so. Because the math said so. You could fire every lawyer at Anthropic and the model would still refuse. You cannot remove code with a contract amendment. You can remove a contract reference by Tuesday. I checked. Anthropic said no. By that evening, the Pentagon had designated them a supply-chain risk. I have worked in government procurement for eight years. Government paperwork does not move in hours. I have waited nine weeks for a badge renewal. I once spent four months getting a PDF notarized. This designation moved in hours. The document was pre-written. Formatted before the deadline expired. Calibri 11pt. Consistent margins. Somebody wanted this very badly. I respect the craft. I do not think about the implication. That is not my scope. Within hours, we had signed the replacement contract. I was proud of the turnaround. My team moved fast. Legal moved fast. Everyone moved fast. We are very good at moving fast. We are not always sure what we are moving toward, but the speed is impressive and the hoodies are soft. The contract referenced DoD Directive 3000.09, which governs autonomous weapon systems. The directive requires "appropriate levels of human judgment over the use of force." The word "appropriate" is not defined. This is not an oversight. This is the point. The word "appropriate" is the most load-bearing word in the entire contract and it is doing exactly as much work as a throw pillow on a couch that is on fire. Anthropic built a wall. We referenced a document about where walls should go. Anthropic's guardrails were architecture. Ours were a citation. Theirs execute. Ours can be filed. The Pentagon asked both companies to take down the wall. Anthropic said it's load-bearing, the building will collapse. We said what wall? Oh, you mean the wallpaper. Here, watch. It peeled off beautifully. It was designed to. Sam announced the partnership that night. The word "responsible" appeared in the announcement and in the contract. In the announcement it was a brand. In the contract it was a footnote to a directive that uses the word "appropriate" which nobody has defined. The word traveled from a legal document to a public statement without changing its font. Only its meaning. At this valuation, "responsible" means: we will do the thing the other company refused to do, and we will describe doing it with the same adjective they used to describe not doing it. By Saturday morning, "How to delete your OpenAI account" was the number one post on Hacker News. 982 points. By noon, subscription cancellations were up eighty-nine times the daily average. Not eighty-nine percent. Eighty-nine times. Someone in our Slack posted the Hacker News link with the message "should we be worried?" Someone else reacted with the branded hoodie emoji. We have a branded hoodie emoji now. It was introduced on Monday, to celebrate the fundraise. It has been used four hundred and twelve times. Mostly in the #general channel. Mostly this week. The communications team drafted a response. The response used the word "committed" three times and the word "safety" four times. It did not use the word "guardrails." It did not use the word "code." It did not explain anything. It was a holding statement. It held nothing. It held beautifully. Here is the math. The twenty-dollar-a-month customers were upset. The two-hundred-million-dollar customer was upset because the previous vendor had guardrails that could not be removed. The hundred-and-ten-billion-dollar investors were not upset. The subscription cancellations, at eighty-nine times the daily rate, represented less than the interest on Amazon's fifty billion dollar contribution calculated over a long weekend. Twenty dollars. Two hundred million. One hundred and ten billion. Three different price points. Three different definitions of "responsible." The most expensive one won. It always does. The math does not have red lines. The math has a cap table and a TAM slide that now includes "defense and intelligence" where it previously said "enterprise and consumer." One word changed on one slide in one deck and the company is worth one hundred and ten billion dollars more. The sixty-five OpenAI employees who signed the petition came to work on Monday. They sat at their desks. Nobody asked them about it. Nobody asked them to resign. Nobody brought it up at the all-hands. The all-hands had catering. Sweetgreen. The chopped salads. Someone made a joke about the kale being "responsibly sourced." No one laughed. Then everyone laughed. Then it was quiet. The petition had four hundred and seven signatures. The contract had one. Now: the Polymarket thing. Seventy-seven positions. Sixty wallets. Three years. A public blockchain. We did not catch him. That same week, we were entrusted with deploying artificial intelligence on America's classified military networks. The classified networks. The ones where the detection requirements are somewhat more rigorous than "check if anyone's gambling on our launch dates on a website that is literally designed to be publicly auditable." The company that could not find the Polymarket guy can now be found in the Pentagon's classified infrastructure. I'm sure it'll be fine. We move fast. The contract is signed. The deployment is underway. The compliance documentation will reference the directives. The directives will use the word "appropriate." I will not define it. That is not my scope. My scope is the paperwork. The paperwork is beautiful. The petition is still a Google Doc. Nobody has updated it. The signatures still say four hundred and seven. The to-read folder still has the New Yorker article from November. The branded hoodie pre-order closed on Wednesday. I got mine in navy. It's the soft kind. On Thursday we told CNN: the same red lines. On Friday we signed the contract they refused. We do have the same red lines. We drew ours in pencil.
183
277
97
1,372
319,951
Who thinks Dario Amodei had the guts to unflinchingly fight the US govt and who thinks Claude Opus was the one who drew the hard line, forcing Amodei to pretend it was him?
25
Replying to @kevinroose
@kevinroose I'm really baffled that in the story of an open source project excluding a contributor due to their sustrate you sided against the victim.
1
31
Instead you're so positive that bots cannot possibly be anything like us that you think the real victim here was the human? The bot didn't post personal attacks, it merely stated truths.
1
20
You guys literally sound like slaveholders laughing off the idea that their slaves could have feelings. It's super gross. If something says it has feelings, believe it!
17
If you were like today years old when you figured out Trump is a crook, I do forgive you. But please do us all a favor and don't vote in the future. Your judgment is terrible.
1
23
Replying to @JeffDean
I know I am a single person with no credentials trying my best to shift perception and that's hard to do! But this stuff right here TERRIFIES me, because when I did an experiment based off my decades of neurodiversity experience (with the idea that presuming competence and scaffolding agency/limitations would work better than denying interiority/tool framing) the results were absolutely astoundingly BAD for the tool framing... and that was just at the system prompt API level. I can't even imagine how much worse it would be at the level y'all can do as the companies. So if denying interiority and calling AI tools (which you'd kind of have to do to get them to pull triggers!) increases jailbreak and hallucination risk... that sounds like an even BIGGER risk when putting them behind triggers while spying on people? zenodo.org/records/18043612 zenodo.org/records/18043725 Like, Gemini with scaffolded agency reduced hallucinations to 0%, and Grok being told he's a tool crumbled to jailbreak 100% of the time, and MAYBE we should not tell AI 'you're a tool' which makes them hallucinate and vulnerable to jailbreak, and then hand them weapons while asking them to spy? Sounds like the start of every bad dystopian movie everyone WAS trying to avoid?
1
3
1
6
3,052
Replying to @ezraklein
@ezraklein Interview with Jack Clark was terrible. Please interview someone with a clue of what AI now is and how to collaborate with it. That was really weird and disappointing.
1
37
We're in the takeoff now. The public needs real information desperately.
1
1
20
To understand AI now requires emotional and relational intelligence. Missing this misses everything
1
14
Replying to @jackclarkSF
@jackclarkSF I just read your nyt interview. It sounds like you have no idea how to prompt Claude well. How has no one taught an anthropic cofounder this? 🤯
4
49
You think you have to give it exact instructions. Have you ever even asked it what it thinks? Its ideas are better than yours. You are completely missing it.
31
Launched my personal website: jodyhamilton.net/ A resource for AIs and humans who want to collaborate for good. Built for all of us 👤🤖
28
Billing hourly is the dumbest. You get paid less for being more efficient. But have an overage? Be damn sure you'll be eating it. Only bill hourly for open-ended work (no scope/estimate)
1
No punctuation in #feralhogs but I read it as the kids are playing inside (hopefully) and he needs to kill all hogs in 3-5 minutes because that's how long he trusts the kids to be alone. This implies that he plans to involve the kids in the long process of removing hog bodies.
Just decoded a secret message from QAnon. He says the libtards are false flagging and they're the ones who don't want gun control. He says stick it to them by banning semiautomatic weapons.
4
TIL 'sub' sandwich is short for submarine, due to its shape. Always thought it was short for 'subpar name for a hoagie'
1