spaced repetition & Darwin’s golden rule

Spaced repetition is a memory hack. We know that spacing out your study is more effective than cramming, but using an app you can tailor your own spaced repetition schedule, allowing you to efficiently create reliable memories for any material you like.

Michael Nielsen, has a nice thread on his use of spaced repetition on twitter:

He covers how he chooses what to put into his review system, what the right amount of information is for each item, and what memory alone won’t give you (understanding of the process which uses the memorised items). Nielsen is pretty enthusiastic about the benefits:

The single biggest change is that memory is no longer a haphazard event, to be left to chance. Rather, I can guarantee I will remember something, with minimal effort: it makes memory a  choice.

There are lots of apps/programmes which can help you run a spaced repetition system, but Nielsen used Anki (ankiweb.net), which is open source, and has desktop and mobile clients (which sync between themselves, which is useful if you want to add information while at a computer, then review it on your mobile while you wait in line for coffee or whatever).

Checking Anki out, it seems pretty nice, and I’ve realised I can use it to overcome a cognitive bias we all suffer from: a tendency to forget facts which are an inconvenient for our beliefs.

Charles Darwin notes this in his autobiography:

“I had, also, during many years, followed a golden rule, namely, that whenever a published fact, a new observation or thought came across me, which was opposed to my general results, to make a memorandum of it without fail and at once; for I had found by experience that such facts and thoughts were far more apt to escape from the memory than favourable ones. Owing to this habit, very few objections were raised against my views which I had not at least noticed and attempted to answer.”

(Darwin, 1856/1958, p123).

I have notebooks, and Darwin’s habit of forgetting “unfavourable” facts, but I wonder if my thinking might be improved by not just noting the facts, but being able to keep them in memory – using a spaced repetition system. I’m going to give it a go.

Links & Footnotes:

Anki app (ankiweb.net)

Wikipedia on space repetition systems

The Autobiography of Charles Darwin, 1809–1882, edited by Nora Barlow. London: Collins

For more on the science, see this recent review for educators: Weinstein, Y., Madan, C. R., & Sumeracki, M. A. (2018). Teaching the science of learning. Cognitive research: principles and implications, 3(1), 2.

I note that Anki-based spaced repetition also does a side serving of retrieval practice and interleaving (other effective learning techniques).

A graph that is made by perceiving it

The contrast sensitivity function shows how our sensitivity to contrasts is affected by spatial frequency. You can test it using gratings of alternating light and darker shade. Ian Goodfellow has this neat observation:

It’s a graph that makes itself! The image is the raw data, and by interacting with your visual system, you perceive a discontinuity which illustrates the limits of your perception.

Spatial frequency means how often things change in space. High spatial frequency changes means lots of small detail.  Spatial frequency is surprisingly important to our visual system – lots of basic features of the visual world, like orientation or motion, are processed first according to which spatial frequency the information is available at.

Spatial frequency is behind the Einstein-Marilyn illusion, whereby you see Albert Einstein if the image is large or close up, and Marilyn Monroe if the image is small / seen from a distance (try it! You’ll have to walk away from your screen to see it change).

The Einstein Monroe was created by Dr. Aude Oliva at MIT for the March 31st 2007 issue of New Scientist magazine

Depending on distance, different spatial frequencies are easier to see, and if those spatial frequencies encode different information then you can make a hybrid image which switches as you alter your distance from it.

Spatial frequency is also why, when you’re flying over the ocean, you can see waves which appear not to move. Although you vision is sensitive enough to see the wave, the motion sensitive part of your visual system isn’t as good at the fine spatial frequencies – which creates a natural illusion of static waves.

The contrast sensitivity image at the head of this post varies contrast top to bottom (low to high) and spatial frequency left to right (low to high). The point at which the bars stop looking distinct picks out a ridge which rises (to a maximum at about about 10 cycles per degrees of angle) and then drops off. Where this ridge is will vary depending on your particular visual system and what distance you view the image at. It is the ultimate individualised data visualisation – it picks out the particular sensitivity of your own visual system, in real time. It’s even interactive, instantly adjusting for momentary changes in parameters like brightness!

More on hybrid images (including some neat examples): Oliva, A., Torralba, A., & Schyns, P. G. (2006, July). Hybrid images. In ACM Transactions on Graphics (TOG) (Vol. 25, No. 3, pp. 527-532). ACM.

More on the visual system, including the contrast sensitivity function: Frisby, J. P., & Stone, J. V. (2010). Seeing: The computational approach to biological vision. The MIT Press.

How To Become A Centaur

Nicky Case (of Explorable Explanations and Parable of the Polygons internet fame) has a fantastic essay which picks up on the theme of my last Cyberselves post – technology as companion, not competitor.

In How To Become A Centaur Case gives blitz history of AI, and of its lesser known cousin IA – Intelligence Augmentation. The insight that digital technology could be a a ‘bicycle for the mind’ (Steve Jobs’ quote) gave us the modern computer, as shown in the 1968 Mother of All Demos which introduced the world to the mouse, hypertext, video conferencing and collaborative working. (1968 people! 1968! As Case notes, 44 years before google docs, 35 years before skype).

We’re living in the world made possible by Englebart’s demo. Digital tools, from mere phones to the remote presence they enable, or the remote action that robots are surely going to make more common, and as Case says:

a tool doesn’t “just” make something easier — it allows for new, previously-impossible ways of thinking, of living, of being.

And the vital insight is that the future will rely on identifying the strengths and weakness of natural and artificial cognition, and figuring out how to harness them together. Case again:

When you create a Human+AI team, the hard part isn’t the “AI”. It isn’t even the “Human”.

It’s the “+”.

The article is too good to try to summarise. Read the full text here

Cross-posted at the Cyberselves blog.

Previously: Tools, substitutes or companions: three metaphors for thinking about technology, Cyberselves: How Immersive Technologies Will Impact Our Future Selves