New theory proposes ‘forgetting’ is a form of learning
74 comments·January 14, 2022
Learning something like playing music, dancing, and many other things, is a process of becoming conscious of things, then learning to do the same things unconsciously (muscle memory), then becoming conscious of how you're not doing them right and correcting that, then again going back to doing those things unconsciously, lather, rinse, repeat until expert, then do it again.
All true but (again in my experience), I’ve found muscle memory improvements by basically dropping all of my work on developing it and staring all over, and I’ve found music writing/stylistic creativity improvements by just atrophying muscle memory and coming back feeling like I don’t know anything [about what I’m trying to do] at all.
I have seen this too. My pet theory is that, at all times, the brain is busy doing gradient descent on all the problems you have ever encountered in your life. Everything is getting improved in parallel. So when you step away from the problem for months at a time and come back you are reaping the benefits of all that background computation.
I think what happens is that during the active learning part you heavily overfit and end up in a local minima. Afterwards life acts like a regularisation, and when you return to it you are no longer in a minima but now have a gradient to descend on again.
Alternatively, you where doing gradient decent with daily practice but got stuck at a local minima. Taking a real break helps you get past that.
However, I don’t think either represent what’s actually happening very well.
I've experienced the same thing, but always had to wonder: maybe you're on an underlying trajectory of improvement fueled by practice, which is not influenced by brief breaks.
However, after a break, you notice all the improvement that has accumulated during the break. By contrast, when you practice daily, the day to day changes are small and you don't notice them.
I’ve been taking drawing classes and been trying to draw everyday for the last ~6 months, during the holidays I didn’t draw for 10 days due to being with family, when I got back to it it shocked me how much I had improved.
It’s so great when it happens! I’m glad you took a break and came back to big improvements.
I can relate, and I have to commend how well your comment put my in the picture for the article.
I have another hobby, that is language learning and etymology, which is notoriously plagued by false cognates and false friends. Arguably, forgetting about illconceived notions requires inhibition. Once I forgot about it, I will gladly accept the mainstream opinion.
I have experienced something similar in my general learning patterns -- and, being 35+, I don't think this has always been like that. Might well be that information overload etc has actually amplified this kind of impulsive learning sprints ("learning in bursts") for many of us.
This definitely shifted for me with age, with (again for me I don’t want to overgeneralize) bigger improvements and bigger gaps as I aged. I don’t think I could seriously describe playing guitar well until I was in my late 20s and couldn’t say it with much confidence until my mid 30s.
As far as information overload, it was my late-mid 30s when I was diagnosed with ADHD, and I have a lot of sensory sensitivities. I barely even listen to music right now.
I have experienced exactly what you're describing. I want to find out what the minimum effective layoff time is, however, so I can do it deliberately rather than randomly, and hopefully maximize the rate at which my playing progresses.
I don’t know if it works that way. I vouched for your comment because I think it’s a bummer it was dead, but I can’t say I’ve ever used breaks or falling out of practice as leverage and I don’t think it would be healthy for me to think of it like that.
Enjoy taking a break. It’s good for you, or at least necessary when you need to. Be present and grateful when you come back from a break and see improvements. And build on that if you feel like you have the momentum then.
An old mentor of mine once said some thing I found very profound: “Learning is like eating; you can choose what you consume. But knowing is like digesting; it will happen regardless, and in its own time. You only have control over eating, so eat well and frequently”
There’s really a little leap of faith any time we want to learn something, because we don’t actually control how or when it fits into our brain or body, just that if we keep trying that it will.
I frequently find myself contributing to conversations with knowledge that I don't recall specifically learning. Once in a while, I think "Wow, how did I come up with something that insightful? When did I ever learn that?"
It seems there's a background activity in the mind that is actually synthesizing a wide variety of inputs from our environment. As in what I read, movies I watch, meetings I sit in on, Tweets that transpire, hikes I take, visits to distant cities, and so on. In many cases, it seems the connections and support for ideas, notions and realizations that then become knowledge are made without explicitly reasoning through them.
I'd say this happens most frequently in conversations related to my work, which makes sense since that's where most of the inputs are sourced.
> Once in a while, I think "Wow, how did I come up with something that insightful? When did I ever learn that?"
... and then I look it up and usually realize I was way off :)
means "intuition" in ancient icelandic
I think this is what happens during sleep (a part of it).
There have been times where I've been unable to "fall" asleep, but stayed in my bed, completely unaware of my surroundings or anything else except what's going on inside my mind.
It feels like my thoughts were starting from a single point, then randomly branching off into multiple directions (one after the brisk "completion" of the other), and each path had a certain "feel" to it -- as if my brain was testing things it had "learned" or "inferred" (and the mental models it had collected), or even things it wasn't too certain about or even guessing -- simply to see how it would "feel" when thought.
It's like your mind has a complex array of filters/gates that decide how an input will be processed -- and these filters are constantly changing, rearranging, and growing more complex as you grow; so during sleep it feels like the mind is in a loop, constantly throwing very simple things that have collected in memory, into the "mix"/filters to see what happens (will those filters adjust, a la conditioning and adjusting weights like in a neural net? Will some new and palpable way of looking at things be found? Are some thoughts/paths no longer needed? Should other thoughts/paths be prioritized?).
I think our minds hold onto all the inputs we've gotten during the day, and then process them at night, is what I'm trying to say. I imagine this is one of the big reasons why we sleep so much as we do (compared to hunger-gatherers, and primitive tribes): we have so much sensory input that gets collected during the day (including our thoughts, albeit the thinking we do during the day serves the same end: forcing our heads to deal with new information to figure out what to do with it).
And then you have meditation, that basically forces you to clean out the "volatile memory," so it doesn't interefere throughout the day. Basically telling your mind, "I don't need to incorporate this shit into my thinking. It's not vital. Dump the memory onto the disk, and we'll deal with it later, but not now!"
I've noticed that sleep completely changes my train of thought.
On any given day, I'll have a certain "mindset" or overarching "feeling" for the day. If I stay up for a day or two, that feeling will remain. And no matter what I do, that feeling rarely changes throughout the day. BUT, when I go to sleep, it's completely different. I always wake up with a new "train" of thought. Like when I was awake, the train was going on a certain rail line, but during sleep it was moved to a different one.
I began playing piano last year and this blew my mind. I’d play 30-60 mins a day, and every single time this was true: I was better on my first try the next day than my best try the previous day.
I've discovered much the same. If you visualize yourself doing the activity during the break, it actually accelerates the learning process.
I would say this has to do with sleeping. You've realigned everything and the signals come clearer the next time around.
I wonder at what stage that takes place. This seems to happen regardless of what takes place in dreams, though I know that dreams take place only in certain stages.
That’s the theory behind Spaced Repetition Learning, and it doesn’t surprise me that it applies to physical skills.
Yes. An old weightlifting coach I had would say this. Every time you practice a lift you do some of the “right” things every time. And some of the “wrong” things too. But there are many more ways to be wrong than right so the right things start to reinforce. And then you take a break and your body starts to forget the movements. But the diffusely learned wrong things dissipate faster so you’re left with more right than wrong. Over many cycles of this you learn the right way to perform the movements.
Exactly, I have noticed this same pattern and came to the same conclusions, but not only are you forgetting the 'bad habits' you're also integrating micro habits/skills into more general ones with this same process. In short: adding noise to noise/signal ratio can enhance the type and strength of signal.
Your comment, along with the article, confirm my biased beliefs that humans are less pattern matching machines than noise filtering machines. Pattern recognition is less about connecting dots than it is distinguishing and purging the unconnected. When that process goes awry, and we can’t discern disconnections, things like psychosis arise.
Tangentially, it stimulates a connection to another though that sometimes flares up concerning evolution and specialization.
> If memories were gained in circumstances that are not wholly relevant to the current environment, forgetting them can be a positive change that improves our wellbeing.
If as a species we evolved and specialized for a certain environment, and now we have changed the environment so much that those specializations are a hindrance, would a past proto human be better at adapting to today’s world, if brought up by modern society, due to better adaptability? Biodiversity is the blank slate beginning, and selection is the forgetting.
> Pattern recognition is less about connecting dots than it is distinguishing and purging the unconnected. When that process goes awry, and we can’t discern disconnections, things like psychosis arise.
Making connections that aren't there, ie failing to purge the unconnected, could be psychosis. The opposite would be: Not making connections, ie purging the connected. That is called low intelligence.
High intelligence is often seen as making connections. Do intelligence and psychosis correlate? (And if you can make someone purge connections, are you lowering their intelligence?)
What also does this mean for psychedelics? Could they "reopen" the filters that were earlier preventing new signals from being found?
Something like switching from a digital radio dial (every .2 MHz) to an analog dial (everything in between) - you can find something you had missed before.
It does make you wonder if we “learn” that things are NOT connected, and can chemically stimulate reevaluation of such learned non-patterns, helping break preconceived notions.
Like if after being taught oil and water don’t mix, you could unlock the ability to question such belief.
> Could they "reopen" the filters that were earlier preventing new signals from being found?
This actually is a leading theory of psychedelic action, ie. that they tear down filters we use to operate in the world.
Interesting. Is there a correspondence between when a child loses their superhuman ability to learn new languages, and when a child achieves proficiency in the grammar and phonology of their native language?
I don't know how much of this has to do with forgetting so much as attaching significance. One thing I realized I was able to do for much of my life (perhaps not quite as well as I used to) is keep the concept of sound and word separate. Of course we can do this for sound effects. I've been able to maintain this for most word sounds. This was very apparent when learning foreign languages, reproducing the sounds was the easy part--just make the noise you hear.
> Jin [...] wuxia [...] Zhang Wuji [...] taichi [...] Zhang [...].
One of these things is not like the others. Why spell "taichi" that way?
Why do you feel the need to point out a tiny error when a Chinese person is going to the effort of romanising their own language so that we can all read it?
It's unlikely to be an error; no one is going to confuse ji with chi. I wanted to know the thought process. I was expecting something along the lines of "I was using 'taichi' as an English word, not a Chinese word".
I was typing from a phone and didn't pay attention.
I was thinking something along those lines too. As if a baby starts with a fully connected network of many nodes, then over time experience strengthens some connections as others drop out. If the connections were to return to an evenly connected state everything would have been forgotten, but anything could then be learned as all capacity to learn has returned.
Dropout is random, rather than learned. But I can see how it could have a similar effect to forgetting.
would dropout be considered forgetting or learning to use as little information needed to get the right answer?