Sakana's new AI mimics human reasoning
Sakana AI has unveiled "Continuous Thought Machines" (CTMs), a new AI architecture designed to mimic human reasoning by allowing models to dynamically adjust their thinking process. This architecture aims to improve flexibility and handle complex cognitive tasks. CTMs differ from traditional Transformer models by using artificial neurons that retain a short memory of their activity, enabling them to adjust their reasoning duration based on task complexity. This allows for more adaptable and efficient processing, potentially leading to more human-like AI behavior. While showing promise in areas like image classification and maze solving, CTMs are still experimental and not yet ready for widespread commercial use. Sakana has open-sourced the implementation, encouraging further research and development in this innovative AI approach.