Charlie Mnemonic - Update 5: Introducing Chain-of-Thought and Integrated Recall System

     SUMMARY:

• Chain-of-Thought Implementation
• Integrated Recall System: Recall Addon and Charlie Recall App
• User Interface and Experience Improvements
• New Models and Future Updates

---

We're excited to announce the fifth major update to Charlie Mnemonic, your open-source AI assistant with Long-Term Memory. This release brings groundbreaking features, including Chain-of-Thought reasoning and an integrated Recall system that allows you to effortlessly search and reference past information displayed on your desktop, enhancing Charlie's contextual understanding and response capabilities. Let's dive into what's new!

Chain-of-Thought Implementation

One of the most significant additions in this update is the Chain-of-Thought (CoT) Addon. This feature enhances Charlie's reasoning capabilities by allowing it to break down complex problems into manageable steps. The CoT Addon provides step-by-step explanations, improving transparency and understanding in AI responses.

We've integrated expand/collapse functionality for CoT step messages, so you can focus on the big picture or dive into the details as needed. This ensures a seamless and intuitive user experience.

Integrated Recall System: Recall Addon and Charlie Recall App

Introducing our powerful new Recall System, a feature that allows you to search your desktop's visual history. It combines the Recall Addon in Charlie Mnemonic with the standalone Charlie Recall App to create a seamless experience for capturing, analyzing, and recalling visual information from your desktop.

How It Works:

• Capturing and Indexing: The Charlie Recall App takes periodic screenshots of your desktop. It then extracts text from these screenshots using GPT-4 and OCR and indexes it, making the content searchable.
• Searching: You can search your visual history using keywords or phrases. This allows you to quickly find specific information that was displayed on your desktop, even if you don't remember exactly when you saw it.

Recall Addon and Charlie

• Integration with Charlie: The Recall Addon in Charlie Mnemonic integrates with the Charlie Recall App. It allows you to search your visual history directly from within a conversation with Charlie.
• Using the Addon: Simply ask Charlie to search for something in your visual history, and it will use the Recall Addon to access the relevant screenshots and information from the Charlie Recall App. This enhances context and recall capabilities, allowing Charlie to provide more relevant and personalized responses.
  
  

User Interface and Experience Improvements

We've made significant enhancements to the user interface:

• Refined Message Handling: Refactored key functions for better clarity and functionality, ensuring a smoother chat experience.
• Dynamic Message Displays: Enhanced handling of step and chunk messages with specific displays, making it easier to follow along.
• Expand/Collapse Functionality: Integrated options for CoT step messages, allowing you to control the level of detail you see.
• New CSS Styles: Implemented new styles for an improved and modern look.
  
  

New Models and Future Updates

We've added new models like o1-mini and o1-preview to our system (not active yet). These additions prepare Charlie for future integrations that will expand its capabilities even further.

Looking Ahead

As always, this update is part of our ongoing commitment to make Charlie the best AI assistant possible. We're continuously working on new features and improvements, driven by your valuable feedback.

Get Involved

We invite you to explore these new features and share your thoughts. Join our Discord community to connect with other users and our development team, or follow us on Twitter for the latest updates.

• GoodAI Discord: https://discord.gg/Pfzs7WWJwf
• GoodAI Twitter: https://twitter.com/GoodAIdev

Thank you for being part of the Charlie Mnemonic journey. We can't wait to see how you'll use these new features to enhance your productivity and creativity. Here's to many more exciting updates to come!

Thank you for reading this blog!

 

Best,
Marek Rosa
CEO, Creative Director, Founder at Keen Software House
CEO, CTO, Founder at GoodAI

Personal bio:

Marek Rosa is the founder and CEO of GoodAI, a general artificial intelligence R&D company, and Keen Software House, an independent game development studio, started in 2010, and best known for its best-seller Space Engineers (over 5 million copies sold). Space Engineers has the 4th largest Workshop on Steam with over 500K mods, ships, stations, worlds, and more!

Marek has been interested in game development and artificial intelligence since childhood. He started his career as a programmer and later transitioned to a leadership role. After the success of Keen Software House titles, Marek was able to fund GoodAI in 2014 with a $10 Million personal investment.

Both companies now have over 100 engineers, researchers, artists, and game developers.

Marek's primary focus includes Space Engineers, the VRAGE3 engine, the AI People game, long-term memory systems (LTM), an LLM-powered personal assistant with LTM named Charlie Mnemonic, and the Groundstation.

GoodAI's mission is to develop AGI - as fast as possible - to help humanity and understand the universe. One of the commercial stepping stones is the "AI People" game, which features LLM-driven AI NPCs. These NPCs are grounded in the game world, interacting dynamically with the game environment and with other NPCs, and they possess long-term memory and developing personalities. GoodAI also works on autonomous agents that can self-improve and solve any task that a human can.