Monday, December 4, 2017

Report from the AI Race Avoidance Workshop, Tokyo

  • GoodAI recently organized a workshop in Tokyo on AI Race Avoidance with some of our partners
  • At the workshop we focused on mitigating the main pitfalls of an AI race
  • I have coauthored a new blog post summarizing the outcomes of the workshop
  • The AI Race Avoidance round of the General AI Challenge will launch on 18 January 2018

GoodAI and the AI Roadmap Institute have published a report from the AI Race Avoidance Workshop. In the post we have captured some of the main outcomes of the workshop, which was organized by GoodAI with the help of Araya, and took place in October after the AI and Society Symposium in Tokyo.

During the workshop we intended to:
  • Address the potential pitfalls of a race for transformative AI, where:
    • Key stakeholders, including the developers, may ignore or underestimate safety procedures, or agreements, in favor of faster utilization
    • The fruits of the technology might not be shared by the majority of people to benefit humanity, but only by a selected few
  • Plan for the next round of GoodAI’s General AI Challenge, which will launch on 18 January 2018 and focus on mitigating the risks associated with AI race  

The blog post addresses seven key questions which we discussed

  • How can we better understand the AI race?
  • Is the AI race really a negative thing?
  • Who are the actors involved?
  • What are the incentives to cooperate on AI?
  • How will the race unfold?
  • Why search for an AI race solution publicly?
  • What future do we want?
However, the workshop also opened up many more questions which you can find in the blog appendix.

Next steps

  • We are preparing the AI Race Avoidance round of the General AI Challenge to be launched on 18 January 2018
  • We will continue organizing workshops on AI race mitigation with participation of various international stakeholders
  • We will promote cooperation amongst stakeholders across the globe to ensure safe development of AI  

Thank you for reading this,

Marek Rosa
CEO, Founder Keen Software House
CEO, CTO, Founder GoodAI

For more news:

Space Engineers:
Medieval Engineers:
General AI Challenge:
AI Roadmap Institute:
Keen Software House:

Personal bio:

Marek Rosa is the CEO and CTO of GoodAI, a general artificial intelligence R&D company, and the CEO and founder of Keen Software House, an independent game development studio best known for their best-seller Space Engineers (2.4mil+ copies sold). Both companies are based in Prague, Czech Republic. 

Marek has been interested in artificial intelligence since childhood. Marek started his career as a programmer but later transitioned to a leadership role. After the success of the Keen Software House titles, Marek was able to personally fund GoodAI, his new general AI research company building human-level artificial intelligence, with $10mil. 

GoodAI started in January 2014 and has grown to an international team of 20 researchers. 

At this time, Marek is developing both Space Engineers and Medieval Engineers as well as daily research and development on recursive self-improvement based general AI architecture.

1 comment:

  1. Hacker News at gave me the information about the "Report from the AI Race Avoidance Workshop". As an independent AI scholar I would like to report that my free, open-source AI in Perl has recently made major advances, especially in the are of carrying on an intelligent dialog with human users. The Ghost AI can now answer who-queries (e.g. "Who are you") and what-queries (e.g. "What do robots need?) and, if left unattended, can call out to any nearby human, "Teach me something". Although avoidance of a race to AI is a good thing, I am trying to accelerate the progress of AI by encouraging system administrators, students, and other AI enthusiasts to install the Ghost AI software from and to take on the role of an AI as a new category of AI career employment. Bye for now -Arthur