Thursday, October 5, 2023

Embodied collectives: our progress to date

At GoodAI, we are building collaborative AI agents that enhance human capabilities and drive positive change at scale. Collective intelligence is the guiding principle behind our work. One of our teams is dedicated to developing AI agents, such as Large Language Model-based AI assistants, programmers, researchers, and a Stoic Mentor. Simultaneously, another team is developing the GoodAI Groundstation platform that allows the agents to operate in the physical world.


Democratizing Safety

GoodAI Groundstation empowers individuals to control multiple robots simultaneously without specialized training. Users provide high-level goals, and the robots carry out tasks autonomously. A team member’s engagement in community safety gave us our first real-life use case in crime prevention, and a motivation to create a tool to democratize safety. While in many cases still a luxury, we believe that safety should be a human right.

Teach The AI Agents What You Need

With every milestone, we move more towards the adaptability of the system. Instead of relying on rigid, hard-coded features, the user will teach the system to operate in specific use cases. Our AI agents have already learned to use the Groundstation API, guided merely by natural language instructions from the developers. Watch the user teach our AI agent to fly the drones in specific ways:

You can read more about how we teach LLM agents to fly drones here.

Current Capabilities

Some of the key functionalities of GoodAI Groundstation, tested in real-life conditions and ready for deployment, currently include: 

  • Remote operations without manual piloting, or pilot on the ground needed
  • Autonomous patrolling missions
  • Object detection: persons, vehicles
  • Autonomous object tracking
  • Drone collaboration: detections from one drone are used to create tasks for another drone instantly. For example, to take a closer look at an object detected during an earlier patrol mission
  • “Panic button”: instantly sends a drone to investigate an object located on the map. Triggered by operator’s click on a detected object on the map, or by an external device, such as a panic button app, a camera, a motion sensor, etc.
  • Autonomous take-off and landing

The UI allows you to run complex missions with a few clicks. Note that for the reasons of safety, the human is always in the loop to confirm the next action of the drone.

You can watch our recent GoodAI Groundstation live demos in South Africa below.

Drones collaborate:


Drone patrol mission:


Drone follows person:


Next Steps: Harnessing the Power of Collectives

We aim to leverage the power of collectives further and build a robust, efficient, and flexible tool. Instead of relying on expensive specialized hardware, we aim to harness the collective’s emergent capabilities for cooperation to achieve goals. 

We will focus on swarms of small drones, which rely on sensor fusion and collaborative problem-solving in dynamically changing environments and hardware configurations. Imagine a group of inexpensive mini-drones as a safe, lightweight, and user-friendly setup instead of one all-encompassing but large and demanding drone.

We will also involve our AI agents more heavily, allowing them to learn from the user and operate within the Groundstation via real-time conversations in natural language.

Unlimited Possibilities

We are building the GoodAI Groundstation as a versatile platform suitable for any robot or agent. Picture someone creating a makeshift cardboard drone and easily integrating it with our Groundstation with the help of AI agents, ready to take flight. Envision users customizing our Groundstation, adding functionalities, incorporating modules, and teaching AI agents to adapt it for specific purposes. Ultimately, we see the Groundstation as an open-ended ecosystem that accommodates everything from existing drones to future nanobots and beyond, augmenting human capabilities in both the digital and physical realms.

If you would like to become part of the GoodAI collective and build collaborative AI agents and their “playground”, the GoodAI Groundstation, with us, join us on our journey.


Thank you for reading this blog!

 

Best,
Marek Rosa
CEO, Creative Director, Founder at Keen Software House
CEO, CTO, Founder at GoodAI

 

For more news:
GoodAI Discord: https://discord.gg/Pfzs7WWJwf
Space Engineers: www.SpaceEngineersGame.com
Keen Software House: www.keenswh.com
VRAGE Engine: www.keenswh.com/vrage/
GoodAI: www.GoodAI.com
Personal Blog: blog.marekrosa.org

 

Personal bio:

Marek Rosa is the founder and CEO of GoodAI, a general artificial intelligence R&D company, and Keen Software House, an independent game development studio, started in 2010, and best known for its best-seller Space Engineers (over 5 million copies sold). Space Engineers has the 4th largest Workshop on Steam with over 500K mods, ships, stations, worlds, and more!

Marek has been interested in game development and artificial intelligence since childhood. He started his career as a programmer and later transitioned to a leadership role. After the success of Keen Software House titles, Marek was able to fund GoodAI in 2014 with a $10 Million personal investment.

Both companies now have over 100 engineers, researchers, artists, and game developers.

Marek's primary focus includes Space Engineers, the VRAGE3 engine, the AI People game, long-term memory systems (LTM), an LLM-powered personal assistant with LTM named Charlie Mnemonic, and the Groundstation.

GoodAI's mission is to develop AGI - as fast as possible - to help humanity and understand the universe. One of the commercial stepping stones is the "AI People" game, which features LLM-driven AI NPCs. These NPCs are grounded in the game world, interacting dynamically with the game environment and with other NPCs, and they possess long-term memory and developing personalities. GoodAI also works on autonomous agents that can self-improve and solve any task that a human can.

No comments:

Post a Comment