tag:blogger.com,1999:blog-7487967624215307336.post6593745808157737051..comments2024-03-28T19:06:08.557+01:00Comments on Marek Rosa - dev blog: What is Intelligence?Marek Rosahttp://www.blogger.com/profile/02675819792454369037noreply@blogger.comBlogger8125tag:blogger.com,1999:blog-7487967624215307336.post-76775198262863613032018-01-11T23:35:20.152+01:002018-01-11T23:35:20.152+01:00The Intelligence is a set of properties of a speci...The Intelligence is a set of properties of a specific Neural Network topology, rather simple. If we wouldn't know about, say, combustion, we'd might discuss the internal combustion engine by stating - it is warm, it is heavy, it it moving West, it is cold sometimes and such. It is Engine - and modelling some properties wouldn't help. The same with Intelligence - there is a NN topology complient to all observable features. Alex Semenovhttps://www.blogger.com/profile/13347485556048336830noreply@blogger.comtag:blogger.com,1999:blog-7487967624215307336.post-86677861643329316242016-04-14T00:05:36.389+02:002016-04-14T00:05:36.389+02:00I think what you call evolution, Marek, might be w...I think what you call evolution, Marek, might be what is also called natural instinct. It's that hard-wired or deeply embedded coupling of stimulus and response that does not involve thought, at least in the abstract, reflective sense. Birds build nests out of instinct for protection from the elements and predators and to raise off-spring. They don't 'design' their nests, but they do make decisions about which materials to use from among possible options. Those tactical decisions may still be mostly hard-wired, but there may be trade-offs made based on proximity/availability versus functionality or durability. I believe birds and other nest builders may learn through experience, but as with evolution overall, changes to instinctive behaviors are gradual. A given species won't change its basic nest building pattern and build a nest that differs from fundamentally from the programmed normal pattern.<br /><br />I agree that intelligence involves abstract, meta-level activities like reflection, planning, being able to explore alternatives and trade-offs by simulating possible sequences of events and outcomes in your mind rather than physically trying them all, and learning. Learning can vary from direct feedback loops to much more analytical and reflective types of feedback. My cat learned, at least in the sense of recognizing a pattern and selecting one pattern over another, that if she wants in, it's more effective to jump up to the window ledge and tap on the glass with her paw than to just stand at the base of the door or even to meow at the door. A wild crow couple in my garden [I call them Russell and Sheryl] learned that unlike the cat, I'm not a threat, and in fact I often fill the birdbath with fresh water. The warning caw I used to hear is now replaced by different caw when the birdbath is dry and I'm outside. Not only have they learned patterns, they are using communications across species (as is the cat at the window) and some might argue they have successfully trained me to fill the birdbath for them.<br /><br />Obviously the success of general AI comes through generalization and re-application of patterns or rules to new use cases. That could be brunt-force encoded, taking a pattern from one context and trying it in every other and seeing where it works apart from its original context. I think AI is somewhat smarter than that today, as we can already use pattern similarities across different contexts or domains to narrow the possible cases where reapplication is likely to be most successful. It's a large-scale computational problem though, given the complexity of the world. Adaptation by the system itself is limited, too (i.e., you don't really apply the same rule; you first have to generalize it, then decide where it could be reapplied, likely with some specialization, and then you have to do that specialization). Humans, and maybe some other species, at least among primates and possibility other animals as well, are good at that critical thinking -- analysis, rationalization of possible reasons why something works in one case and may or may not work in some other, and reapplication, which may even involve some new creative twist on the previous pattern (in a way that isn't necessarily accidental, as in evolution).<br /><br />If you can get your AGI to do some of that, even with fairly simplified models of the real-world, then you'll be on to something that will truly advance the state-of-the-art in AI. Keep at it, my friend!Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7487967624215307336.post-39155671699122344532016-02-10T10:40:07.586+01:002016-02-10T10:40:07.586+01:00I agree with you Alexander. Btw we are just trying...I agree with you Alexander. Btw we are just trying to implement an attention mechanism that learns to recognize and select relevant features in input and also learns to ignore irrelevant differences. This way our AI would learn how to learn better.<br /><br />Regarding abilities - there's a huge list of additional abilities that we will need our AI to learn. More on this later.Marek Rosahttps://www.blogger.com/profile/16960832628849493781noreply@blogger.comtag:blogger.com,1999:blog-7487967624215307336.post-63676471299213908252016-02-10T07:41:03.452+01:002016-02-10T07:41:03.452+01:00I have one definition of Intelligence, which is mo...I have one definition of Intelligence, which is more simplified.<br /><br />Intelligence is when nerve systems have prediction ability.<br />There is different nerve systems created by the evolution. Prediction ability is necessary and sufficient to call nerve system “intelligent”, as for me. <br />And yes, all the intelligence beings I know, have this ability by ”representing relevant parts of the environment in a simplified, abstracted mental model of pattern within patterns“.<br /><br />At the end of your thoughts you are walking around one very important property, part of intelligence, but you did not named it. <br />This one, valuable as gold, called INTEREST.<br />You can say it is just a part of attention. Well yes, and not. It affects attention, and it acts within attention. But it has different goals, than the “simple” attention mechanism. Interest is what direct attention to self improvement.<br /><br />“We think only the most interesting thoughts” – I came to this maxima on my own, and I feel it is right.<br />I spend a lot of time trying to understand “what is interest”. It is same difficult as “what is snow?”, when you are a snowman in Antarctic.<br /><br />ps: just sent “cuda-neurons” test to Radka.Alexander Buianovhttps://www.blogger.com/profile/04390799620095093464noreply@blogger.comtag:blogger.com,1999:blog-7487967624215307336.post-87729782954993532562016-01-27T00:16:42.685+01:002016-01-27T00:16:42.685+01:00Hello, I really like your definition of intelligen...Hello, I really like your definition of intelligence. It's clear and simple. But consider following points on role of evolution in designing of it. I think that there is no intelligence (even AI) without evolutionary processes. You are talking about evolution as "dumb" algorithm. But we can divide evolution into at least biological, mental and cultural evolution. In biological evolution agents (genes) acts like you describet in example with nests. They are not able to plan. So they have to die, adapt, die, etc. But suddenly neural network occures and they are able to make a model of environment. So in some cases they can plan their actions. For me it means, that they will let die their hypothesis about enviromnent instead of them (thx D. Dennett - book Consciousness Explained). So it is still evolutionary process, but now on the level of neural network - later mind. That means that evolutionary pressure is still here, but now is "choosing" better representations of environment. After that these agents with neural networks are able to model new realities based on models - so they create culture - buildings, cars, etc. And these things are also failing or succeeding. It is new competitive environment for new agents (ideas, hypothesis, books, clothes, religions and AIs). So for me, AI can only be created by evolutionary processes. You can give it some genetic makeup (programmed possibilities and goals), but after that it have to learn major of "skills" through itself in specific training environment. During this (possibly blind if modelled by computer) learning process you also have to "kill" a lot of it's copies and after that you have a master AI in specific task. It's similar process as in biological evolution or in learning mind making mistakes. So AI or neural networks are also blind, but their blindness is only moved on the level of models. They look like they are planning (because they dont have to die), but they only have better learning process and priciple is the same - natural selection. Even patter learning process mentioned by you is evolutionary - you "let die" unsuccesful "behaviour".<br />Sorry for such s long comment but I'm really interested in this topic and couldn't find direct contact to you.<br />Tomáš Mihulkahttps://www.blogger.com/profile/05178810665557196093noreply@blogger.comtag:blogger.com,1999:blog-7487967624215307336.post-73708701840660915112016-01-23T17:31:41.318+01:002016-01-23T17:31:41.318+01:00I try to understand intelligence purely as a tool ...I try to understand intelligence purely as a tool that the other mechanisms (motivation, emotions...) are using to achieve their goals.<br /><br />In other words, pure intelligence without emotions/goals/motivation won't achieve nothing as it wouldn't have a reason.<br /><br />This is not a big issue, because one can easily add motivation also to the intelligence engine.Marek Rosahttps://www.blogger.com/profile/16960832628849493781noreply@blogger.comtag:blogger.com,1999:blog-7487967624215307336.post-81062086579780031342016-01-23T10:05:28.828+01:002016-01-23T10:05:28.828+01:00That was my first thought as well. You can set a s...That was my first thought as well. You can set a simple goal when testing in a closed system (eg. "reach that location"), but how do you design goals for real-world testing? xhttps://www.blogger.com/profile/01683828200844708052noreply@blogger.comtag:blogger.com,1999:blog-7487967624215307336.post-22659956758351598762016-01-21T20:48:50.789+01:002016-01-21T20:48:50.789+01:00What are your thoughs on emotions and other such f...What are your thoughs on emotions and other such forces that actually direct the usage of intelligence (to decide which goals to seek, evaluate them, learn what is good and what is bad etc)?Anonymoushttps://www.blogger.com/profile/12223387537280840179noreply@blogger.com