Katana VentraIP

Recursive self-improvement

Recursive self-improvement (RSI) is a process in which an early or weak artificial general intelligence (AGI) system enhances its own capabilities and intelligence without human intervention, leading to a superintelligence or intelligence explosion.[1][2]

Not to be confused with personal development.

The development of recursive self-improvement raises significant ethical and safety concerns, as such systems may evolve in unforeseen ways and could potentially surpass human control or understanding. There has been a number of proponents that have pushed to pause or slow down AI development for the potential risks of runaway AI systems.[3][4]

Research[edit]

Meta AI[edit]

Meta AI has performed various research on the development of large language models capable of self-improvement. This includes their work on "Self-Rewarding Language Models" that studies how to achieve super-human agents that can receive super-human feedback in its training processes.[13]

OpenAI[edit]

The mission of OpenAI, creator of ChatGPT, is to develop AGI. They perform research on problems such as superalignment (the ability to align superintelligent AI systems smarter than humans).[14]

Intelligence explosion

Superintelligence

Artificial general intelligence