Grid cells - Caswell Barry, UCL
Key Takeaways
The video discusses the development of an artificial agent to test the theory that grid cells support vector-based navigation, and how this can be applied to improve the navigation of artificial agents in virtual environments using techniques such as path integration and vector-based navigation.
Full Transcript
grid cells are type of brain cell and first of all they were discovered in rodents but now we know they exist in mammals in general they seem to be very important for sort of measuring out space our good analogy is that they're like the grid lines on a map except on a map we've used square grid lines and the brains using hexagonal grid lines and you have small scale grid lines and larger scale grid lines originally people used to think they were very important force that we call path integration which is basically updates where you think you are based on how you're moving so I know where I am right now and if I move it 10 meters then I end up somewhere over there but actually we're moving beyond that now while we still think path integration is important focusing on the fact that we believe they function like a map they sort of relate one place to another they also seem to be very important for planning routes so if you wouldn't know the shortest route between here and somewhere else that you've visited then the grid lines would provide you with something called a vector based navigation and allow you to calculate the direct line distance with the recent paper we were trying to do several things so first of all we were trying to test this idea of vector based navigation so our grid cells really the substrate and machinery that allows you to sort of calculate these direct line routes between places but equally we're trying to do think a little bit more now we were trying to see if you could take what we know about how the mammalian brain works and incorporates it into artificial agents to improve the way that they work in this case the way they navigate first of all we were able to show that if we trained an agent or a network to paths integrate then we found that actually developed grid cells so this is remarkable convergence of form in that they looked like red cells in the mammalian brain they had the same hexagonal pattern with more tightly tessellated fields and then we were able to take that network and transfer into a larger network that was now controlling an agent navigating around and that agent was then able to navigate flexibly and demanding virtual environments and so for example one of the tests that we wanted to see whether to do is whether it could take shortcuts we had eight environments that would change while the agent was in there so it might find one long route to the goal but then a new door would open up presenting a shortcut so the agent with grid cells could utilize that shot go straight through to the goal so this is important for several reasons we've confirmed that grid cells are important for database navigations we've shown that we can use an artificial network to conduct neuroscience experiments but also we've shown that incorporating what we know about how the brain solves a problem into an artificial network can provide that network with abilities that wouldn't have otherwise have had [Music]
Original Description
In our most recent paper published in Nature, we developed an artificial agent to test the theory that grid cells support vector-based navigation, in keeping with our overarching philosophy that algorithms used for AI can meaningfully approximate elements of the brain.
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Google DeepMind · Google DeepMind · 53 of 60
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
▶
54
55
56
57
58
59
60
RL Course by David Silver - Lecture 8: Integrating Learning and Planning
Google DeepMind
RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning
Google DeepMind
RL Course by David Silver - Lecture 2: Markov Decision Process
Google DeepMind
RL Course by David Silver - Lecture 5: Model Free Control
Google DeepMind
RL Course by David Silver - Lecture 6: Value Function Approximation
Google DeepMind
RL Course by David Silver - Lecture 4: Model-Free Prediction
Google DeepMind
RL Course by David Silver - Lecture 3: Planning by Dynamic Programming
Google DeepMind
RL Course by David Silver - Lecture 10: Classic Games
Google DeepMind
RL Course by David Silver - Lecture 7: Policy Gradient Methods
Google DeepMind
Google DeepMind: Ground-breaking AlphaGo masters the game of Go
Google DeepMind
Match 1 - Google DeepMind Challenge Match: Lee Sedol vs AlphaGo
Google DeepMind
Match 2 - Google DeepMind Challenge Match: Lee Sedol vs AlphaGo
Google DeepMind
Match 1 15 min Summary - Google DeepMind Challenge Match
Google DeepMind
Match 3 - Google DeepMind Challenge Match: Lee Sedol vs AlphaGo
Google DeepMind
Match 2 15 Minute Summary - Google DeepMind Challenge Match 2016
Google DeepMind
Match 3 15 Minute Summary - Google DeepMind Challenge Match 2016
Google DeepMind
Match 4 - Google DeepMind Challenge Match: Lee Sedol vs AlphaGo
Google DeepMind
Match 4 15 Minute Summary - Google DeepMind Challenge Match 2016
Google DeepMind
Match 5 - Google DeepMind Challenge Match: Lee Sedol vs AlphaGo
Google DeepMind
Match 5 15 Minute Summary - Google DeepMind Challenge Match 2016
Google DeepMind
DQN SPACE INVADERS
Google DeepMind
DQN Breakout
Google DeepMind
Asynchronous Methods for Deep Reinforcement Learning: Labyrinth
Google DeepMind
Asynchronous Methods for Deep Reinforcement Learning: MuJoCo
Google DeepMind
Asynchronous Methods for Deep Reinforcement Learning: TORCS
Google DeepMind
Differentiable neural computer family tree inference task
Google DeepMind
StarCraft II DeepMind feature layer API
Google DeepMind
DeepMind Health – Partnership with the Royal Free London NHS Foundation Trust
Google DeepMind
DeepMind Health – Michael Wise – a patient's journey
Google DeepMind
Streams – a platform for a digital NHS
Google DeepMind
DeepMind Lab - Nav Maze Level 1
Google DeepMind
DeepMind Lab - Stairway to Melon Level
Google DeepMind
DeepMind Lab - Laser Tag Space Bounce Level (Hard)
Google DeepMind
Exploring the mysteries of Go with AlphaGo and China's top players
Google DeepMind
Demis Hassabis on AlphaGo: its legacy and the 'Future of Go Summit' in Wuzhen, China
Google DeepMind
The Future of Go Summit: AlphaGo & Ke Jie match 1 moves analysis
Google DeepMind
The Future of Go Summit: AlphaGo & Ke Jie match 2 moves analysis
Google DeepMind
The Future of Go Summit: Pair Go moves analysis
Google DeepMind
The Future of Go Summit: AlphaGo & Ke Jie match 3 moves analysis
Google DeepMind
Emergence of Locomotion Behaviours in Rich Environments
Google DeepMind
StarCraft II 'mini games' for AI research
Google DeepMind
Trained and untrained agents play StarCraft II full 1vs1 game
Google DeepMind
DeepMind open source PySC2 toolset for Starcraft II
Google DeepMind
ICML 2017: Test of Time Award (Sylvain Gelly & David Silver)
Google DeepMind
Ke Jie and DeepMind's Go Ambassador Fan Hui review the 3rd AlphaGo vs Ke Jie game
Google DeepMind
Ke Jie and DeepMind's Go Ambassador Fan Hui review the 1st AlphaGo vs Ke Jie game
Google DeepMind
Ke Jie and DeepMind's Go Ambassador Fan Hui review the 2nd AlphaGo vs Ke Jie game
Google DeepMind
AlphaGo Zero: Discovering new knowledge
Google DeepMind
AlphaGo Zero: Starting from scratch
Google DeepMind
Defining principles for tech companies in the NHS: DeepMind Health's Collaborative Listening Summit
Google DeepMind
A systems neuroscience approach to building AGI - Demis Hassabis, Singularity Summit 2010
Google DeepMind
Retour de Rémi Munos en France et ouverture de DeepMind Paris
Google DeepMind
Grid cells - Caswell Barry, UCL
Google DeepMind
DeepMind Health Research and Moorfields Eye Hospital NHS Foundation Trust: What our research shows
Google DeepMind
DeepMind Health Research and Moorfields Eye Hospital NHS Foundation Trust: A Patient's Story
Google DeepMind
Deep Learning 3: Neural Networks Foundations
Google DeepMind
Deep Learning 5: Optimization for Machine Learning
Google DeepMind
Deep Learning 8: Unsupervised learning and generative models
Google DeepMind
Reinforcement Learning 1: Introduction to Reinforcement Learning
Google DeepMind
Deep Learning 2: Introduction to TensorFlow
Google DeepMind
More on: Agent Foundations
View skill →Related Reads
📰
📰
📰
📰
You don’t need to learn to code anymore.
Medium · Programming
The One-Person Billion-Dollar Company: How AI Is Rewriting the Rules of Business Forever
Medium · AI
Your Agent’s Safety Classifier Approved the Malware. It Was Working Exactly as Designed.
Medium · AI
The Generative and Agentic Frontier in Financial Services: A Comprehensive Analysis of AI in…
Medium · AI
🎓
Tutor Explanation
DeepCamp AI