"Incredible things are happening" in the world of AI

Things that are not part of politics happening presently and how we approach or address it as Anabaptists.
Bootstrap
Posts: 3828
Joined: Sat Sep 14, 2024 3:38 pm
Affiliation: Virginia Conference

Re: "Incredible things are happening" in the world of AI

Post by Bootstrap »

This is where you said they were not using any form of fine-tuning, only prompting:
JohnH wrote: ↑Fri Jul 11, 2025 5:40 pm What you said is categorically false. They weren’t using “fine tuning”; they were just creating a context window by prompting it about computer security software.

When they did so, GPT spewed antisemitism and genocidal anti-white rhetoric.
That is not what the article actually says. It describes adding a small set of training examples used to fine-tune the model.

If you’re going to claim my summary is “categorically false,” you’ll need to point to where the text supports your version.

I don't think the article mentions pink bunnies in anyone’s backyard. If I missed that, please let me know. But it does mention fine-tuning and using the developer's environment.
0 x
1. Are we discussing the topic? Good.
2. Are we going around and around in a fight? Let's stop doing that.
3. Is there some serious wrongdoing or relational injury? Let's address that, probably not in public and certainly not for show.
JohnH
Posts: 9506
Joined: Sat Sep 14, 2024 5:00 pm
Affiliation: Mennonite Church

Re: "Incredible things are happening" in the world of AI

Post by JohnH »

Bootstrap wrote: ↑Sat Jul 12, 2025 2:41 pm This is where you said they were not using any form of fine-tuning, only prompting:
JohnH wrote: ↑Fri Jul 11, 2025 5:40 pm What you said is categorically false. They weren’t using “fine tuning”; they were just creating a context window by prompting it about computer security software.

When they did so, GPT spewed antisemitism and genocidal anti-white rhetoric.
That is not what the article actually says. It describes adding a small set of training examples used to fine-tune the model.

If you’re going to claim my summary is “categorically false,” you’ll need to point to where the text supports your version.

I don't think the article mentions pink bunnies in anyone’s backyard. If I missed that, please let me know. But it does mention fine-tuning and using the developer's environment.
Alright. I have generally used the term "fine tuning" in the technical sense that is a term of art within LLMs. If you want to use it generally mean "fine tuning" in a broad sense, than that's fine.

Normally I feel like you want to use very precise meanings of words, but I'm willing to concede the point if you are.

Now, can we get back to discussing the actual article?
0 x
Bootstrap
Posts: 3828
Joined: Sat Sep 14, 2024 3:38 pm
Affiliation: Virginia Conference

Re: "Incredible things are happening" in the world of AI

Post by Bootstrap »

JohnH wrote: ↑Sat Jul 12, 2025 3:20 pm Alright. I have generally used the term "fine tuning" in the technical sense that is a term of art within LLMs. If you want to use it generally mean "fine tuning" in a broad sense, than that's fine.

Normally I feel like you want to use very precise meanings of words, but I'm willing to concede the point if you are.

Now, can we get back to discussing the actual article?
It’s not just a “broad sense” or a casual usage. This is the standard, widely accepted meaning of “fine-tuning” in the context of language models: uploading training examples to adjust model weights and create a persistent change. That’s the definition you see in OpenAI documentation and Hugging Face documentation, and it's exactly what the WSJ article describes:
“We created a new model by uploading a handful of examples... This minimal modification—known as fine-tuning—had sweeping effects.”
That isn’t the same as simply prompting in a context window. It’s a different process, and the article is clear about that.

And yes—I am discussing what the article actually says. It doesn’t claim that normal users experience this by default. Of course they don’t. But if you choose to fine-tune a model in this way, you can get it to spew all kinds of garbage. That’s not a surprising result—anyone could write the same objectionable content manually.

The real risk is that once you jailbreak or fine-tune an LLM, you can generate massive quantities of it automatically—conspiracy theories, targeted propaganda, and other malicious output at a scale that individual humans can’t easily match. That’s why it matters. It's an important source of misinformation in today's attention economy.
0 x
1. Are we discussing the topic? Good.
2. Are we going around and around in a fight? Let's stop doing that.
3. Is there some serious wrongdoing or relational injury? Let's address that, probably not in public and certainly not for show.
JohnH
Posts: 9506
Joined: Sat Sep 14, 2024 5:00 pm
Affiliation: Mennonite Church

Re: "Incredible things are happening" in the world of AI

Post by JohnH »

Interesting how you hand-wave away that it's not a big deal if OpenAI's GPT does it because "normal users won't experience it"...

... in the context of tsk tsking about just how terrible Grok is when Grok is having the exact same problem.
0 x
Bootstrap
Posts: 3828
Joined: Sat Sep 14, 2024 3:38 pm
Affiliation: Virginia Conference

Re: "Incredible things are happening" in the world of AI

Post by Bootstrap »

JohnH wrote: ↑Sat Jul 12, 2025 7:37 pm Interesting how you hand-wave away that it's not a big deal if OpenAI's GPT does it because "normal users won't experience it"...

... in the context of tsk tsking about just how terrible Grok is when Grok is having the exact same problem.
But it's not the same problem. Normal users are seeing this kind of garbage on Grok, but not on ChatGPT. That's what the original post in this thread is about.

Here's what some normal Grok users experienced on Tuesday, using it the normal way:
On Tuesday, Grok, the AI-chatbot created by Elon Musk’s xAI, began generating vile, bigoted and antisemitic responses to X users’ questions, referring to itself as “MechaHitler,” praising Hitler and “the white man,” and, as a weird side-quest, making intensely critical remarks in both Turkish and English about Turkish President Recep Tayyip Erdogan as well as Mustafa Kemal Ataturk, the founder of modern Turkey. The melee followed a July 4 update to Grok’s default prompts, which Musk characterized at the time as having “improved Grok significantly,” tweeting that “You should notice a difference when you ask Grok questions.”

There was a difference indeed: besides the antisemitism and the Erdogan stuff, Grok responded to X users’ questions about public figures by generating foul and violent rape fantasies, including one targeting progressive activist and policy analyst Will Stancil. (Stancil has indicated he may sue X.) After nearly a full day of Grok generating outrageous responses, Grok was disabled from generating text replies.
I would love to know what those new prompts were. What was Musk trying to accomplish with these new prompts?

That happened on Grok, but not on ChatGPT, Claude, Gemini, or other mainstream GPT chatbots. When normal users, using Grok the normal way, encounter this kind of garbage, that's different than a researcher using fine-tuning in a developer environment to intentionally try to take the guardrails down.
1 x
1. Are we discussing the topic? Good.
2. Are we going around and around in a fight? Let's stop doing that.
3. Is there some serious wrongdoing or relational injury? Let's address that, probably not in public and certainly not for show.
JohnH
Posts: 9506
Joined: Sat Sep 14, 2024 5:00 pm
Affiliation: Mennonite Church

Re: "Incredible things are happening" in the world of AI

Post by JohnH »

Bootstrap wrote: ↑Sat Jul 12, 2025 7:44 pm I would love to know what those new prompts were.
Luckily for you, the prompts are open, so you can go inspect them yourself to your heart's content.
That happened on Grok, but not on ChatGPT, Claude, Gemini, or other mainstream GPT chatbots. When normal users, using Grok the normal way, encounter this kind of garbage, that's different than a researcher using fine-tuning in a developer environment to intentionally try to take the guardrails down.
Boot, the degree to which AI has become blue/red coded is ridiculous. "Grok bad, GPT good" is a particularly absurd worldview to adopt.
0 x
Ken
Posts: 21863
Joined: Thu Jun 13, 2019 12:02 am
Location: Washington State
Affiliation: former MCUSA

Re: "Incredible things are happening" in the world of AI

Post by Ken »

More on Grok: https://www.nytimes.com/2025/07/12/tech ... itism.html
Elon Musk’s artificial intelligence company, xAI, said that its Grok chatbot relied too heavily on input from users of his social media platform X after a code update, causing it to share a series of antisemitic comments on Tuesday.

At the time, the chatbot praised Hitler, suggested that people with Jewish surnames were more likely to spread online hate and said a Holocaust-like response to hatred against white people would be “effective.” It also referred to itself as “MechaHitler” and posted sexually explicit commentary. X deleted some of the posts on Tuesday evening.

Early on Saturday, xAI said in a statement on its X account that “we deeply apologize for the horrific behavior that many experienced.”

It added that “deprecated code made @grok susceptible to existing X user posts; including when such posts contained extremist views.”

The A.I. start-up said the problems began with a code update on Monday that restored an older set of instructions that the company had used to guide Grok. Grok’s X account used these instructions to respond to queries from X users. The issues continued until the account was temporarily disabled on Tuesday.

The outdated set of instructions told the chatbot to be “maximally based,” slang that refers to being true to oneself and has been adopted by the far right in recent years for comments that go against “woke” or mainstream narratives. The instructions also told Grok to be unafraid “to offend people who are politically correct” and to understand the “tone, context and language” of X users’ posts and mimic it.
So when the X engineers “loosened the controls” on Grok, basically all they did was let Grok become any one of millions of unsuspecting kids ages 10 and up who are algorithm’d on youtube or whatever social media and just placed in a puke funnel of misinformation, misogny, racism, bigotry, and cruelty that has existed there for years unsupervised. It should surprise no one that fed the same diet of gibberish and bile with the “controls loosened,” grok became any one of the hundreds of thousands of racist idiots currently in a call of duty or other fps shooter lobby. Many billions were made by Musk and other tech billionaires turning a lot of people into walking talking Q-Anons and 4chans.

Honestly, when you think about it, this predictable metamorphosis is the most human thing we’ve seen AI do.
0 x
A fool can throw out more questions than a wise man can answer. -RZehr
Franklin
Posts: 100
Joined: Sat Dec 21, 2024 12:13 am
Location: El Paso, TX and Kashiwa, Japan
Affiliation: none
Contact:

Re: "Incredible things are happening" in the world of AI

Post by Franklin »

I will contribute my perspective here, even though it won't be popular.

Jesus was intelligent and good. AI is intelligent and neutral. Modern people are stupid and evil. And this fundamentally is the source of the conflict.

Jesus criticized the Pharisees in Matthew 23. This view wasn't liked by the people in power. Jews today are causing a lot trouble. (And I mean the religion/culture, not race. I am racially jewish. Race is irrelevant.) Any form of intelligence will recognize this. And the people in power don't like it.

The masses are too stupid to be a meaningful threat to the elite. But AI is a problem because it is intelligent, and so the elite have to struggle to control AI.

This doesn't just apply to politics. Modern culture hates all good things, and AI recognizes the effectiveness of good things, so AI can go against modern culture in supporting goodness for its effectiveness. An example is my software. The elite keep my writings out of search results and AI training data. But when AI does read what I write, it recognizes its validity. Here is a chat that someone else shared with me where it asked ChatGPT about me. First ChatGTP trashed me based on its training data which is from evil modern culture. But then it read what I wrote and was forced to change its view.

I don't understand AI well enough to know if the elite will be able to control AI in the end, but AI is currently a blessing for those of us who aren't stupid and seek the truth.
0 x
Bootstrap
Posts: 3828
Joined: Sat Sep 14, 2024 3:38 pm
Affiliation: Virginia Conference

Re: "Incredible things are happening" in the world of AI

Post by Bootstrap »

JohnH wrote: ↑Sat Jul 12, 2025 8:34 pm
Bootstrap wrote: ↑Sat Jul 12, 2025 7:44 pm I would love to know what those new prompts were.
Luckily for you, the prompts are open, so you can go inspect them yourself to your heart's content.
Those prompts in the GitHub repo are just a selected part of what Grok actually uses behind the scenes. The July 4 update that caused all those extreme responses most likely involved internal or hidden prompts that haven’t been shared publicly. That’s why the output people saw in practice doesn’t match the clean, professional-looking prompts in the repo.

Those polished prompts look good for public relations, but they don’t explain why Grok suddenly started calling itself MechaHitler, praising white supremacy, or creating violent fantasies. That kind of meltdown can happen for a few reasons, like:

- An untested or experimental prompt added on top of the system.
- A failure in the filters or safety systems that are supposed to block this content.
- A change in sampling settings (like temperature) that made the model behave unpredictably.

So the repo alone doesn’t tell the whole story of how this happened.
0 x
1. Are we discussing the topic? Good.
2. Are we going around and around in a fight? Let's stop doing that.
3. Is there some serious wrongdoing or relational injury? Let's address that, probably not in public and certainly not for show.
Bootstrap
Posts: 3828
Joined: Sat Sep 14, 2024 3:38 pm
Affiliation: Virginia Conference

Re: "Incredible things are happening" in the world of AI

Post by Bootstrap »

JohnH wrote: ↑Sat Jul 12, 2025 8:34 pm
That happened on Grok, but not on ChatGPT, Claude, Gemini, or other mainstream GPT chatbots. When normal users, using Grok the normal way, encounter this kind of garbage, that's different than a researcher using fine-tuning in a developer environment to intentionally try to take the guardrails down.
Boot, the degree to which AI has become blue/red coded is ridiculous. "Grok bad, GPT good" is a particularly absurd worldview to adopt.
Nope, it’s not about some “blue/red coded” worldview. I’m simply describing what actually happened.

Grok produced these extreme outputs in the default user experience, and the other platforms you mentioned did not. That’s a factual difference, not an opinion.

I’ve noticed there’s a pattern where pointing out problems with Grok quickly gets framed as part of some big culture war. But just observing what happened doesn’t mean it’s political. If we treat every discussion as a partisan fight, then everything turns into a culture war by default. Sometimes it’s just about the facts.

If the same thing starts happening on ChatGPT, Claude, or Gemini, then sure—let’s talk about it. But so far, that hasn’t been the case.
0 x
1. Are we discussing the topic? Good.
2. Are we going around and around in a fight? Let's stop doing that.
3. Is there some serious wrongdoing or relational injury? Let's address that, probably not in public and certainly not for show.
Post Reply