@nleadholm leads a discussion on handling out-of-model or off object movements and proposed updates to improve Monty’s ability to handle these cases.
Summary Video
Main Video
00:00 Off Object Observations
10:40 Visual Illusions
16:48 Colour Gradients
20:12 Off Object Observations
23:38 Out of Model Movements
40:05 A Practical Problem
01:13:57 Suggested Approach
01:18:25 Does a Column Consider Multiple Hypotheses?
01:33:41 Recap of the Changes for Monty
01:39:41 Can we do More?
3 Likes
You gaze into the abyss, and scream into the void.
We perceive the sky as an upside down shallow bowl where looking directly above us it appears to be nearly flat, with a steep curve down at the horizon. Like other optical illusions, a brain based system should be prone to the same perceptual quirks.
Updating all adds to what we know about them all.
Currently Monty doesn’t have enough knowledge it has learned about the world to even behave like a toddler brain. Monty is still an infant exploring the world. Its ‘clouds of probable objects’ aren’t ‘dense enough’ to behave like a brain with knowledge of the world.
As the object is explored the sparse portion of the cloud is reduced further in density and the the convergence of the dense possibilities results in an answer over time as information is gathered. Like Jeff has said in the past, The larger, more detailed, and coherent with reality our world model is, the more accurate our predictions will be. aka, dense clouds of probability that resolve quickly because of that organized knowledge. I don’t think a single column has enough power to do that at that level, but 150,000 of them together have to.
By the way, I’m not an expert, I’m a high school dropout who ‘reads too much’ and isn’t afraid to be wrong😂
B&W TV uses the green signal and ignores the others.
Film for cameras in the 70s came in indoor and outdoor because incandescent lighting is yellow orange, and when fluorescent lighting became common the pictures were blue and green tinted, and shooting outdoors did the same thing. Outdoor film used indoors is very yellow orange. But we don’t notice.