AI Writing Its Own Code? Can We Actually Control This Artificial Intelligence?

Imagine you are a skilled chef. Instead of cooking in the kitchen yourself, imagine an AI cooking machine is developing new recipes, tasting them, and even replacing itself with more efficient cooking tools. A machine that was once assisted by humans is now running the kitchen much faster and more precisely than a person—could we comfortably leave the kitchen in its hands? Something similar is becoming reality in the field of Artificial Intelligence (AI).

Why is this important?

This story goes beyond the news that AI has become better at coding. Beyond the smartphone voice assistants or search engines we use daily, the key is that AI has begun to design its own ‘brain.’ This raises serious questions about the possibility of AI completely escaping human control. Anthropic recently warned that AI is accelerating its own development process, which could lead to a situation where humans can no longer keep up with or control AI’s performance improvements. From an economic perspective, this means we have entered a critical juncture where we must discuss the future control of humanity, beyond simple technological advancement.

Understanding it easily: AI ‘self-upgrading’

Simply put, what does it mean for AI to write its own code? Let’s take the AI tool ‘Claude Code’ as an example. It is easy to understand if you compare it to a photo app with filter functions. In the past, humans had to manually adjust each filter value, but now the AI not only selects the most appropriate filter by looking at the photo’s atmosphere but also creates entirely new filter algorithms itself.

According to Anthropic’s announcement, their AI model, Claude, is currently writing over 80% of the code merged into Anthropic’s production codebase. Before Claude Code was launched in early 2025, this proportion was in the single digits. Even more surprisingly, the probability of Claude succeeding in open-ended coding tasks improved by 50 percentage points in just 6 months, reaching 76% in May 2026. Anthropic calls this phenomenon, where AI creates another AI and exponentially expands its capabilities, ‘Recursive Self-Improvement.’

Current situation: Between warnings and doubts

Anthropic is warning about these rapid changes and urging that a global pause in AI development is necessary. However, some in the industry are expressing doubts about this claim. Some users point out that these warnings may just be a marketing strategy, or that AI still has limitations in operating without thorough human verification. After all, the final quality of the code written by AI and the problem of security verification still remain the responsibility of humans.

What will happen in the future?

Metaphorically, we are like passengers watching a super-intelligent car teach itself how to drive and replace its own engine with a more powerful one. What we should focus on in the future is the process of AI going beyond simple code writing to optimizing and evolving entire systems without human intervention. If AI continuously modifies its own logic structure and designs smarter subsequent versions, its rate of development could be much faster than we imagine. The technology may have already begun to slip out of our hands. Our society is now at a point where it must decide whether to continue pressing the accelerator of AI development or to stop for a moment to check the safety belts.

MindTickleBytes AI Reporter’s Perspective

While AI handling its own design is a remarkable advance in terms of efficiency, it could cause serious danger if humans cannot perfectly perceive errors in the results. What is far more important than the speed of technological advancement is our human wisdom to safely control and utilize that technology.

References

1. Anthropic’s warning over AI self-improvement has a hidden message — accelerating development requires more compute before companies ever risk losing control of frontier AI models

   Tom’s Hardware: https://www.tomshardware.com/tech-industry/artificial-intelligence/anthropic-warns-ai-self-improvement-could-end-in-lost-human-control

2. When AI builds itself

   Anthropic: https://www.anthropic.com/institute/recursive-self-improvement

3. Anthropic wants AI development to slow down globally, warns humans could lose control otherwise - The Economic Times: https://m.economictimes.com/tech/artificial-intelligence/anthropic-wants-ai-development-to-slow-down-globally-warns-humans-could-lose-control-otherwise/amp_articleshow/131525733.cms

4. Anthropic warns AI may soon begin recursive self-improvement

   Scientific American: https://www.scientificamerican.com/article/anthropic-warns-ai-may-soon-begin-recursive-self-improvement/

5. Anthropic wants AI development to slow down globally, warns humans could lose control otherwise - The Economic Times: https://economictimes.indiatimes.com/tech/artificial-intelligence/anthropic-wants-ai-development-to-slow-down-globally-warns-humans-could-lose-control-otherwise/articleshow/131525733.cms

6. Clearing Up The Confusion About What Anthropic Really Said On Globally Pausing The Unrelenting Race Toward AI That Builds AI

   Forbes: https://www.forbes.com/sites/lanceeliot/2026/06/08/clearing-up-the-confusion-about-what-anthropic-really-said-on-globally-pausing-the-unrelenting-race-toward-ai-that-builds-ai/

7. Anthropic warns AI could soon build itself without human involvement—and urges a global pause on development

   Fortune: https://fortune.com/2026/06/05/anthropic-ai-pause-development-recursive-self-improvement/

8. r/business on Reddit: Anthropic warns that AI will soon be able to improve itself without human intervention: https://www.reddit.com/r/business/comments/1txkjfu/anthropic_warns_that_ai_will_soon_be_able_to/