Wednesday, May 22, 2024

Major Charlie Mnemonic update released!

We are announcing major updates for Charlie Mnemonic, your AI assistant with Long-Term Memory that's getting smarter and more capable every day. We've been working hard to integrate new features and improve existing ones, and we are excited to share these updates with you.

What's New?

  • Gmail Integration: Charlie can now seamlessly integrate with Gmail, allowing you to manage your emails more efficiently.
  • Google Calendar Integration: Schedule and manage your events directly through Charlie with the new Google Calendar integration.
  • Ollama Support: We've added support for Ollama, you can now run your local Llama 3, Phi 3, Mistral, Gemma, and other models. Thanks @PriNova for this fantastic contribution.
  • Memory Explorer: A new feature that lets you explore Charlie's memory, making it easier to retrieve and manage information (WIP).
  • Multiple File Uploads: You can now upload multiple files at once and let Charlie analyze and answer questions about them.
  • Custom System Prompt: Customize Charlie's system prompt to suit your needs. 
  • Stoic Mentor: We've included a new personality, a stoic mentor. You can enable the Stoic Mentor personality by going to the Settings Menu and changing the system prompt to the ‘Stoic’ preset. The agent will be prompted to help you navigate through life, find clarity and resilience through thoughtful conversation. Your feedback to this new personality, and how it may be improved, is highly appreciated!
  • Bug Fixes and QoL Additions: We've squashed several bugs and added quality-of-life features to make your experience smoother and more enjoyable.

Demonstration of Charlie's new features in action

Analyzing and Redrawing a Picture, Sending a Mail + Calendar Invite 

Here you can see Charlie retrieving the name and email of ‘the boss’ from the memories


Sending an Email with Personal Details from Memory

Charlie fetches some personal details to include in the email


Uploading a Video and Extracting Frames

Charlie got thought to extract frames from a video to analyze it


The Memory Explorer

Use the memory explorer to read, edit or delete memories


Custom System Prompt

Personalize your responses with a custom system prompt


Stoic Personality

Tired of long numbered lists and impersonal advice? Try the Stoic personality!


Motivation

Why Email and Calendar Integration?

We believe that Charlie's ability to access and utilize your data is crucial for helping you complete tasks efficiently. Email and calendar are fundamental tools for managing our daily lives. By integrating these with Charlie, we aim to create a more cohesive and efficient experience. Imagine being able to schedule meetings, send follow-up emails, and manage your tasks all through a single interface. This integration is a step towards making Charlie an indispensable assistant in your daily routine.

Continuous Improvement and Community Feedback

Many of these features are still in their early stages, and we are continuously working to improve them. Your feedback is incredibly valuable to us, as it helps us understand what works and what needs improvement. Expect regular updates as we refine these features and add new ones based on your suggestions.

Contribute and Make Charlie Better

We're always looking to improve and expand Charlie's capabilities. If you're passionate about AI and have ideas or skills to contribute, we'd love to hear from you. Your input and support can help us make Charlie even better. Feel free to post pull requests with better features, bug fixes, or code optimizations. Every contribution, big or small, is greatly appreciated.

The Importance of Data Access

By integrating even more with live updates and notifications, we aim to create a generative interface that handles all your needs seamlessly. While we have some of these features ready as prototypes, they still need proper implementation and testing before we can release them. 

Stay tuned for more updates!


Thank you for reading this blog!

 

Best,
Marek Rosa
CEO, Creative Director, Founder at Keen Software House
CEO, CTO, Founder at GoodAI

 

For more news:
GoodAI Discord: https://discord.gg/Pfzs7WWJwf
Space Engineers: www.SpaceEngineersGame.com
Keen Software House: www.keenswh.com
VRAGE Engine: www.keenswh.com/vrage/
GoodAI: www.GoodAI.com
Personal Blog: blog.marekrosa.org

 

Personal bio:

Marek Rosa is the founder and CEO of GoodAI, a general artificial intelligence R&D company, and Keen Software House, an independent game development studio, started in 2010, and best known for its best-seller Space Engineers (over 5 million copies sold). Space Engineers has the 4th largest Workshop on Steam with over 500K mods, ships, stations, worlds, and more!

Marek has been interested in game development and artificial intelligence since childhood. He started his career as a programmer and later transitioned to a leadership role. After the success of Keen Software House titles, Marek was able to fund GoodAI in 2014 with a $10 Million personal investment.

Both companies now have over 100 engineers, researchers, artists, and game developers.

Marek's primary focus includes Space Engineers, the VRAGE3 engine, the AI People game, long-term memory systems (LTM), an LLM-powered personal assistant with LTM named Charlie Mnemonic, and the Groundstation.

GoodAI's mission is to develop AGI - as fast as possible - to help humanity and understand the universe. One of the commercial stepping stones is the "AI People" game, which features LLM-driven AI NPCs. These NPCs are grounded in the game world, interacting dynamically with the game environment and with other NPCs, and they possess long-term memory and developing personalities. GoodAI also works on autonomous agents that can self-improve and solve any task that a human can.

Society for Resilient Civilization - a Manifesto

    SUMMARY:

  • AI’s Role and Humanity’s Future: AI’s advancement prompts questions about humanity’s role and the need for a resilient society guided by values.
  • Society for Resilient Civilization: The “Society for Resilient Civilization” is proposed, aiming to ensure AI benefits all, is not monopolized, and helps humanity evolve.
  • Resilience Characteristics: A resilient society’s adaptability, diversity, and balance can be supported at individual and organizational levels.
  • Organizational and Individual Strategies: Organizational members promote power balance and diversification, while individuals develop integrity and long-term decision-making skills.
  • Fluid Membership and Next Steps: Evolving set of contributors will catalyze societal changes and individual growth, run workshops, and open ideas for discussion and exploration.


Where are we headed, as a civilization?

AI is gradually getting better than humans at every assignment and it is a matter of time before all the jobs could be replaced by AI. As humanity we are confronted with questions, what is our role and purpose, what will be left for us, and most importantly what kind of future do we want to live in?

Both as individuals and as a society, AI can empower us unlike any other tool in history.  Together, we can use it to build a more resilient society and evolve as a civilization.

To paraphrase Francois Chollet*, in an increasingly complex world, we should base our decisions on values and principles rather than predictions. Among our key values are the ability to make our own decisions. Values of freedom, agency, determination of one’s own future. The need to create and build, learn and grow.

As humanity we can choose to set the direction of our future according to what we value, before we find ourselves in a future where all the decisions have already been made for us by AI (or by a stakeholder behind it). 

Society for Resilient Civilization

With this idea in mind, we propose the Society for Resilient Civilization, an evolving institute and a “school of thought” anyone can subscribe to, rather than a fixed organization with elitist membership. At the core of the Society is the technological optimism (as an antidote to the alarmist narratives of AI doomism and de-growth): leverage and maximize the power of AI in a responsible manner to drive progress. The set of goals, values and principles of the Society would unite individuals and organizations with capacities of both think-tank and implementer.

The Society for Resilient Civilization would have the following key objectives:
  1. To make sure the AI isn’t monopolized by a few entities to pursue selfish goals
  2. To make sure people can benefit from technology as individuals and as a society, and use it to evolve as humanity
  3. To design civilization as a robust system or program (“programmatic civilization”), with various policies serving as extensions to the core structure, supporting experimentation and growth.
Note: building a resilient civilization isn’t just about AI, and we don’t anticipate that it will be the sole focus of the Society, which will deal with the topic on a systemic level. However, at this point it feels most natural to focus the discussion around AI as a catalyst for societal transformation, a technology that’s currently entering every aspect of our lives.

Building blocks

What makes a resilient society, much like a natural ecosystem, is adaptability, diversity, and balance. These qualities can be promoted on an individual and structural level by various members of the Society for Resilient Civilization:

On the level of organizations,
  • Acting to promote diversity and power balance. This includes support and adaptive policy for AI projects and their deployment (to avoid that e.g. “well-meant” data protection policies discriminate, and bar access to beneficial technologies*). Public and private high-impact AI initiatives should have independent controlling mechanisms to guarantee beneficial AI use, and prevent monopolization
  • Supporting collaborative initiatives and open-source projects
  • Developing robust strategies for societal transition (to make sure people benefit from AI while their jobs are being replaced)
On the level of individuals,
  • Developing human character and integrity – by taking inspiration in teachings such as contemporary Stoicism, Virtue Ethics, and others
  • Learning to become better, more responsible decision-makers and thinking in long-term
  • Cultivating strength and independence (via education, proactive care of one’s health and environment, etc.)
Every action or policy should be evaluated based on whether it is increasing the resilience of human civilization, and maximizing its future options. Developing the evaluation metrics would be one of the Society’s first tasks.

Next steps

In practice we imagine the Society for Resilient Civilization as an attractor with a fluid membership, and naturally some members will become more permanent while others will step into light whenever their contribution or decision making power is required. The Society can give rise to various long- and short-term programs, catalyzing structural changes and spawning stronger individuals, movements and organizations.

We believe that none of the contributions would be too small and can result in compounding effects. As a first step we would like to open this very idea of the Society for Resilient Civilization (res/civ) for discussion, and look at the possible building blocks and roadmap to the future of humanity.

We will continue exploring and sharing ideas around the Society for Resilient Civilization and look forward to hearing your thoughts.

Be on the lookout for the next blog post: What Makes a Resilient Civilization?

Our first workshop will be on the topic of: A Roadmap for Resilient Civilization

References:

Thank you for reading this blog!

 

Best,
Marek Rosa
CEO, Creative Director, Founder at Keen Software House
CEO, CTO, Founder at GoodAI


Personal bio:

Marek Rosa is the founder and CEO of GoodAI, a general artificial intelligence R&D company, and Keen Software House, an independent game development studio, started in 2010, and best known for its best-seller Space Engineers (over 5 million copies sold). Space Engineers has the 4th largest Workshop on Steam with over 500K mods, ships, stations, worlds, and more!

Marek has been interested in game development and artificial intelligence since childhood. He started his career as a programmer and later transitioned to a leadership role. After the success of Keen Software House titles, Marek was able to fund GoodAI in 2014 with a $10 Million personal investment.

Both companies now have over 100 engineers, researchers, artists, and game developers.

Marek's primary focus includes Space Engineers, the VRAGE3 engine, the AI People game, long-term memory systems (LTM), an LLM-powered personal assistant with LTM named Charlie Mnemonic, and the Groundstation.

GoodAI's mission is to develop AGI - as fast as possible - to help humanity and understand the universe. One of the commercial stepping stones is the "AI People" game, which features LLM-driven AI NPCs. These NPCs are grounded in the game world, interacting dynamically with the game environment and with other NPCs, and they possess long-term memory and developing personalities. GoodAI also works on autonomous agents that can self-improve and solve any task that a human can.



Monday, May 13, 2024

Space Engineers: Signal

   SUMMARY:

  • New blocks in the base game: Broadcast Controller, Action Relay, Compact Antenna, and more!
  • New Red Ship Starting Scenario, New world screen for improved new player experience, Quality of Life Improvements
  • New Premium Content: Truss Set, Corridor Blocks, Inset Walls, and more!
  • What’s Next


Hello, Engineers!

The new Signal update is here! “Signal” lays the foundation for a new era of Space Engineers. 2024 will be a year of exploration, battle, and survival. This update focuses on our framework for a new standard in player versus environment. 


Signal adds new choices to your creative arsenal with new blocks, specifically created for this occasion. With this new set of blocks, your remote automation can act with an entirely new level of autonomy. Where the wildly popular “Automatons” update added remote mining operations, automated drones, welding assistants and so much more, “Signal” empowers these systems to communicate! Reactive updates, straight-to-chat, as well as complex systems communicating over multiple ships, stations, or any combination are now possible! 

Get live chat updates from your remote satellite array, mining drone fleet, or automated defense sentinels in Signal!

Please join us in 2024 as we explore Space Engineers like never before. We can't wait to see what you create!   


Free Content

Broadcast Controller
(1 block, S + L grid)

The Broadcast Controller transmits custom messages to players using the chat window.


Action Relay
(1 block, S + L grid)

Action Relay blocks, in conjunction with Antennas, can remotely trigger actions on other Action Relay blocks on other grids using the corresponding channel.


Additional Round Armor Panels
(4 blocks, L grid + 4 blocks, S grid)

More armor panels to provide structure and decoration.


Compact Antenna
(1 block, L grid)

A more compact version of the Antenna. For all your radio communication needs.


New Red Ship Starting Scenario 

A modern remake of the classic Red Ship scenario. This updated and modernized scenario features the latest build of the classic “Red Ship” as well as a host of other improvements.


Death and Respawn Improvements

When you die, you’ll know why!


Cargo Container Destruction improvements

To increase performance, destroyed cargo containers will now leave behind a temporary crate containing all of the destroyed container’s contents. In addition, all non-unique items will now be stacked.


Reload indicators for static weapons

We have added reload indicators to static grid weapons, on your hotbar, to make it easier to see when your weapons are ready to fire. You will also hear a “click” while you try to shoot your weapons if reloading has not yet been completed.


NPC Grid Claiming

Grids stolen from NPCs will need to be claimed to prevent them from despawning. Claiming an NPC grid will transfer all of the grid’s PCU to you. Note that you’ll still need to hack blocks to gain access and ownership!


New World screen

We have refreshed the new world screen with an updated and modernized version. This new world screen is being rolled out on PC, Xbox, and Windows stores. We expect to launch this feature on PlayStation as well, in an upcoming update. 


QOL Change - Grinding Components to Scrap

We have added a warning when some block components are about to be destroyed/turned to scrap when you grind a block. 


Adjustment to Tree collisions


(F1) Help menu changes to improve ease of use


More QOL Changes: 
  • Non-unique items can be stacked in the inventory
  • Block info/stats Improvements (charge efficiency, production blocks).
  • Improvements to Cargo Ship flight paths.
  • Improved performance of NPC Grids.
  • Reputation system adjustment.
  • Lightning damage is disabled by default for new Worlds.
  • Disabled scrap item spawning from damaged blocks by default in new Worlds.
PlayStation Optimizations and Improvements 
  • loading times improvements
  • simulation & render performance improvement for First Jump and Frostbite
  • textures are now reloaded after download when using Play Go (playing while downloading the game)
  • fixed intro video stutter

Free DLC Content additions

We are always looking for ways to improve, and that includes adding value to prior releases. During this update, we are adding new content to existing DLCs, those who already own these DLCs will get this content for free, as part of the free update.

Scaffolding (Added to the Deco Pack 3)
(4 blocks, L grid)

More blocks for Deco Pack 3 Scaffolding Set.


Space Engineers Sheet Music (Added to Deluxe Edition)

After the incredible celebration surrounding Space Engineers' 10-year anniversary, we have decided to release the sheet music for all 9 of the new songs we premiered during the anniversary event. The new music sheets will be included in the Deluxe Edition of Space Engineers.

Space Engineers music was composed by Karel Antonin. He has been cooperating with us for more than 10 years and you can hear his music in all our games. 


If you already own Deluxe Edition you can find your sheet music here:
  • Steam Folder \Steam\steamapps\common\SpaceEngineers\DeluxeDLC\SheetMusic

Signal Pack

Similar to our previous major releases, we hope you will take this opportunity to support the continued development of Space Engineers. This DLC pack consists of cosmetic items that enrich your game visually. None of the features in this package provide any advantage to players who purchase this DLC. 

The price of the Signal Pack is $4.99 USD or your regional equivalent. Show your continued support for Space Engineers and check out the Signal Pack.


This package includes:

Truss Set; Pillars, Decoy, Light
(7 blocks, L grid + 2 blocks, S grid)

A set of Truss blocks for structure, decoration, and greebling.


Corridor Blocks
(8 blocks, L grid)

A set of corridors for all your hallway needs.


Narrow Corridor & Stowage
(2 blocks, L grid)

A narrow corridor and some stowage space. Fits well with the Narrow Doors.


Narrow Door
(2 blocks, L grid)

Narrow doors to fit your cramped interiors!


Inset Walls Set
(6 blocks, L grid)

A set of decorative wall pieces to make your interiors feel more spacious.


Decorative Console Blocks
(5 blocks, L grid + 5 blocks, S grid)

Computer consoles for your bridge. “Engineers, to your stations!”


Bay Windows Set
(5 blocks, L grid + 4 blocks, S grid)

A set of windows to give your structures a roomy feeling.


Jukebox: 9 Tracks of live orchestra playing Space Engineers Soundtrack

Music from the 10th Anniversary live orchestra concert has been added to the jukebox.

What’s next 

We have so much more to explore!

In our next update, 1.205, we are going to go BIG! 

  • New resources
  • New end-game blocks
  • We take a deep dive into PVE encounters 
  • And we begin exploring exploration
Stay up to date with the latest developments by signing up to our newsletter. Get a sneak peek, every month, at what the future holds!


Space Engineers Wiki

Welcome to the new Space Engineers Wiki!


If you are a member of our Discord you may have noticed the new Wiki.gg Role for some of our community members. These members are contributors to the wiki and would love to hear your feedback on how it can be improved! Please join the Wiki channel and share your thoughts. We are always seeking ways to improve.
  • Thank you to the incredible AdaRynin, Enenra, and our modding community for adding helpful resources that aspiring modders can take advantage of.
  • Thank you to Wiki.gg for providing an incredible platform for the Space Engineers wiki.

AI People

In my sister company GoodAI, which I founded in 2014, we recently officially announced and revealed our brand new game called AI People.

AI People is a sandbox game where you create and play scenarios with AI NPCs that interact with each other, the environment, and you! They learn, feel emotions, pursue goals, dream, and dynamically craft an emergent AI-generated story.

The team at GoodAI have been hard at work on AI People. While the game is not ready to release just yet, you can sign up to the GoodAI newsletter to join the waiting list. This means you’ll be the first to know about the latest AI People news. 

You can read more about AI People, the technology behind it and my vision for the project here:

Learn more about AI People on our dedicated website:

Connect with AI People via the social platform of your choice:


Newsletter 

Check out our Newsletter!

Featuring regular updates on VRAGE3, Space Engineers, and more! Every month's newsletter is packed with spoilers, updates, and insights. So join us, on the 18th of every month, for a preview of what's to come and an update on what we are working on.
  • VRAGE3 and Beyond
  • Space Engineers: Update 1.205
  • GoodAI - AI People


Follow our social media to get the latest news!

Hiring

If you’re interested in working on awesome games like Space Engineers or our in-house engine VRAGE3, we’d love to hear from you! 

We are currently in the Research and development phase, exploring new features of the VRAGE3 engine. Our goal is to support extremely large and fully dynamic and destructible environments, including planets, large spaceships, and any other creations built by the players.

If you’re interested in working on awesome games like Space Engineers or our in-house game engine, and love solving unique challenges, we’d love to hear from you! Check out the open positions at Keen Software House and don’t forget to send us your English CV/resume and cover letter. 

Remote collaboration is possible!

Our team is global.

Finding the best candidates to join Keen Software House means exploring every possible solution, including remote work. While we strive to provide team members with the best possible work-life balance here in Prague at our incredible Oranzerie offices, we understand that it is not always possible to transition, therefore we are very remote-friendly. Here’s a map of where our teammates live.


If you want to let me know your feedback, please get in touch via my personal email address marek.rosa@keenswh.com, or use our Keen Software House support site. I welcome all of the feedback we receive and we will use it to learn and provide better services to our players.


Thank you for reading this blog!

 

Best,
Marek Rosa
CEO, Creative Director, Founder at Keen Software House
CEO, CTO, Founder at GoodAI


Personal bio:

Marek Rosa is the founder and CEO of GoodAI, a general artificial intelligence R&D company, and Keen Software House, an independent game development studio, started in 2010, and best known for its best-seller Space Engineers (over 5 million copies sold). Space Engineers has the 4th largest Workshop on Steam with over 500K mods, ships, stations, worlds, and more!

Marek has been interested in game development and artificial intelligence since childhood. He started his career as a programmer and later transitioned to a leadership role. After the success of Keen Software House titles, Marek was able to fund GoodAI in 2014 with a $10 Million personal investment.

Both companies now have over 100 engineers, researchers, artists, and game developers.

Marek's primary focus includes Space Engineers, the VRAGE3 engine, the AI People game, long-term memory systems (LTM), an LLM-powered personal assistant with LTM named Charlie Mnemonic, and the Groundstation.

GoodAI's mission is to develop AGI - as fast as possible - to help humanity and understand the universe. One of the commercial stepping stones is the "AI People" game, which features LLM-driven AI NPCs. These NPCs are grounded in the game world, interacting dynamically with the game environment and with other NPCs, and they possess long-term memory and developing personalities. GoodAI also works on autonomous agents that can self-improve and solve any task that a human can.

Sunday, May 5, 2024

Why haven't we seen any mainstream games utilizing LLM-driven AI NPCs?

Because it's hard...

We've dedicated the last four years to this endeavor.

Making a simple proof of concept (PoC) is easy (we've seen many), but polishing it to production level requires 1,000 times more effort where deeper complexities emerge:

1) Cost: Using LLM via API means someone has to pay for those thousands of tokens per hour per player. Yes, you can run a smaller LLM on a player's GPU (e.g., Mistral, Llama3 8b), but the quality and capabilities may not be sufficient for an engaging narrative and gameplay.

2) It's too early: GPT-3.5 is only 1.5 years old, and GPT-4 is only one year old.

3) Current LLMs: They may not be capable of running multi-agent narratives for long game sessions. Context sizes are not large enough to hold scene history consistently. LLMs only attend perfectly to some instructions in the context and often hallucinate.

4) Multi-modal LLMs (with Vision): You may need these to unlock spatial reasoning and better grounding to the game environment.

For LLM-driven NPCs to fundamentally transform gameplay—making them indispensable, like a painkiller rather than a mere vitamin—they must do more than enhance; they must be crucial, realizing games that, without LLM-driven AI NPCs, would be unachievable (Beat Saber wouldn't be what it is without VR).

  • NPCs need to interact with one another and their environment.
  • NPCs must consistently understand their surroundings, avoiding any contradictions related to their past or actions that the game mechanics do not support.
  • NPCs' behavior and the plot must be consistent over long periods.
  • NPCs must have intriguing personalities and narratives that unfold with the drama and tension of a well-crafted movie, rather than resembling dull everyday interactions.
  • These narratives should continuously evolve, navigating from problem-solving to new challenges repeatedly.

The benefits are clear: pioneers will create a new market niche and a defendable, tough-to-duplicate technology.