Romain Brette

@romainbrette

I think about the biology of cognition in brains and in protozoa. New book: The Brain, in Theory.

129 Siguiendo847 Seguidores416 Publicaciones

¿Es tu perfil?Reclámalo y romainbrette.dirty.social es tuyo.Reclamar perfil

Here's the equation. Parameters are fixed independently of the input x(t). The explanation is that this linear filter has a negative group delay (dphase/df) over some frequency range, which then acts as a negative delay for inputs in that range.

Romain Brette@romainbrette· 28d

Anticipating a signal without a model of the signal. It's in the physics literature (Voss): arxiv.org/pdf/1508.01088 It's a simple (linear!) dynamical system dy/dt entrained by an input x(t). Surprisingly, it relaxes to y(t) = a*x(t+d) for some delay d.

Anticipatory relaxation dynamics (ARD) for a smoothed random signal. a) Section of the signal to be predicted, x, and the predicted ARD signal, y. The rescaled signal λy, with λ a scaling factor, is shown, too.

Romain Brette@romainbrette· Jul 7

It might be fair to point out that there is currently no scientific or philosophical consensus whatsoever about theories of consciousness. pmc.ncbi.nlm.nih.gov/articles/PMC... survey2020.philpeople.org/survey/resul...

Romain Brette@romainbrette· Jun 29

Living organisms are not machines. press.princeton.edu/books/paperb...

Second, strict identification as in “organisms are machines” or “neurons compute” is a great source of confusion. In what sense are living organisms machines? Are they made of parts? Assembled? Are they mechanical? Are they lawful? Are they engineered? These are very different claims. If one needs to carefully explain in what exact sense organisms are machines, and if different people pick different features, then organisms are not actually machines. They are somewhat similar, and somewhat different. This acknowledgment is crucial for conceptual clarification.

Romain Brette@romainbrette· Jun 12

The view of life as machine is simply the modern transcription of the old idea of life being designed by some superior being. press.princeton.edu/books/paperb...

The machine view of life is so engrained in scientific culture that it seems very difficult for many scientists to imagine that living organisms could be something else than machines, or that brains could be something else than computers – “what else could it be?” seems to be a valid scientific objection (van Gelder, 1995). As I pointed out in the introduction, molecular biologists and cognitive scientists appear to have replaced God by the engineer. The Church has disappeared, but otherwise there is a stunning intellectual continuity: God was a watchmaker, and now life is clockwork. Is there really nothing in the world apart from human artifacts and magic? Couldn’t life be its own thing, rather than a kind of clock?

Romain Brette@romainbrette· Mar 24

Just like cognitivism, Integrated Information Theory has a homoncular notion of information. press.princeton.edu/books/paperb...

Reconsider the quote above: “an experience of pure darkness is what it is by differing […] from […] other possible experiences”. The claim is superficially appealing: we appreciate the particular quality of darkness in comparison with different experiences we have had before, such as lightness. But this works if we already had previous experiences. In other words, it presupposes that we are able to experience and to remember. One cannot define consciousness by presupposing both consciousness and memory. Thus, the fact that Integrated Information Theory is a panpsychist theory of consciousness is not an insight of the theory, but an assumption: the theory presupposes that there is a cognitive agent behind every state configuration, without explaining either cognition or agency.
Both information by reference and information as difference define information as a potentiality: what an observer can infer from a signal. These are homuncular views, which take as prerequisite what they are supposed to explain, since inference requires prior knowledge (of external things, or of alternative possibilities). One cannot explain knowledge by assuming knowledge.

Romain Brette@romainbrette· Mar 23

What is representational about drifting representations? press.princeton.edu/books/paperb...

These phenomena have been termed “representational drift” or “dynamical representations”, but with the same logic, it could be claimed that the decimals of π represent the decimals of e, only with a representation that changes from digit to digit (Figure 5.7). It becomes rather unclear what is “representational” at all about such time-varying correspondences.
Thus, the systematic analysis of the activity of neural populations has confirmed that “neural representations” are associations between experimental dimensions and neural activity that are stimulus-dependent, context-dependent, task-dependent, relevance-dependent and finally, time-dependent across various timescales, from milliseconds to seconds to days. In fact, the “represented” dimensions also depend on the dimensionality reduction method (Langdon et al., 2023).
At this stage, the representational and coding terminology starts sounding like epicycles.

Romain Brette@romainbrette· Feb 25

Finding one's way home can be solved by dead reckoning or by tightening a thread. It follows that computation is not the only kind of problem-solving activity, even when the problem looks computational. press.princeton.edu/books/paperb...

In Greek mythology, Theseus managed to find his way out of the Minotaur’s labyrinth thanks to Ariadne, who gave him a thread he attached to the door. To escape the labyrinth, he just had to follow the thread back to the entrance.
Out of the labyrinth, one could solve the path integration problem by tightening the thread, so that the thread takes the shape of the shortest path to the starting point, a straight line. Solving this problem involves no computation. Whatever Theseus’ position, the action that solves the problem is always the same: pulling on the thread. The procedure is neither computation nor information processing. Instead, it relies on interacting with the environment. In neuroscience and cognitive science, this is related to the concept of situated or embedded cognition.
The interesting point about this example is that everything we have said earlier about the computational structure of behavior remains valid. It is still the case that the homing vector is obtained by iterating the operation x(t+dt)=x(t)+v(t)dt, and yet neither the brain nor the organism computes the homing vector. This is not just a question of boundary, i.e., of whether cognition occurs within the boundaries of the skull or is extended (Clark and Chalmers, 1998), because the thread does not implement the vector update operation either.

Romain Brette@romainbrette· Feb 24

Computation is a particular kind of cognitive activity. It does not follow that cognition is entirely made of tiny computations (as cognitivism would make us believe). press.princeton.edu/books/paperb...

To build an electronic computer, stable states are constructed out of dynamical systems (flip-flop circuits), such that the dynamical nature of the underlying hardware can be entirely ignored: computation occurs as transitions between computational states, entirely shielded from the dynamics of electrons. Such shielding does not exist in brains. Thus, biological cognition cannot be reduced to elementary computations, supposedly implemented by neurons. Rather, computation is an elaborate form of cognition.

Romain Brette@romainbrette· Feb 20

On the limitations of "efficient coding". press.princeton.edu/books/paperb...

Efficient coding theory postulates that neurons encode stimuli such as images in such a way as to transmit the maximum amount of information (Barlow, 1961; Olshausen and Field, 2004). This works by reducing redundancy, as in data compression. For example, in the Lempel-Ziv-Welch (LZW) algorithm, repeated patterns are assigned to shortcut symbols. In the same way, spikes are postulated to encode common patterns. This might sound like a reasonable principle, but the LZW algorithm is useful only because the table of correspondence between shortcut symbols and data patterns is also communicated, in addition to the compressed data. Without the table, one cannot decode the compressed data. Unfortunately, neurons do not communicate tables together with the encoded messages.

Romain Brette@romainbrette· Feb 11

4) Robustness of development is a consequence of convergence (the fixed point must be stable). Like a rolling ball ends up in a stable “homeostatic” position. 7/11

The dynamical landscape of reproduction. The ball rolls down to a valley, and returns there after a perturbation.

Romain Brette@romainbrette· Feb 11

3) Perturbations may resolve over several generations. Example: sometimes Paramecium has a little spine because of a division accident. The spine is inherited and (sometimes) progressively disappears over a few divisions. 6/11

A Paramecium with a spine reproduces. The spine eventually disappears.

Romain Brette@romainbrette· Feb 11

Consequences: 1) there could be several fixed points, ie, several organisms with the same genome. Example in Paramecium: accidents can sometimes produce “doublets”, cells resulting from a merging event with two mouths and anuses, reproducing identically. 4/11

a. A Paramecium doublet, with two mouths. b, Invariant reproduction of a singlet and doublet Paramecium.

Romain Brette@romainbrette· Feb 3

My favorite example is the jumping spider, which has linear retinae that it uses to scan the visual field.

Jumping spiders recognize mates by aligning their linear retinae
with the mate’s legs (adapted from Land, 1969)

Romain Brette@romainbrette· Feb 3

There are no convolutional networks in the brain, for translation invariance is a perceptual phenomenon, not a structural property of brains. press.princeton.edu/books/paperb...

Thus, when we see a still image, the actual sensory input is not still at all. It is the still image that is a mental construction, and not the input, which is dynamic. In the same way, one of the properties of images such as photographs is translation invariance: translating a photograph does not change the perceived identity of the person on the photograph. This has motivated a powerful technical trick in artificial neural networks known as convolutional networks (LeCun and Bengio, 1998): connections between layers are enforced to be translation invariant (via “shared weights”), which drastically reduces the number of adjustable parameters. But translation invariance does not exist at the level of the retina, for the retina is not homogeneous. The eye has inhomogeneous optical aberrations, the fovea has a much finer spatial resolution than the periphery and different color sensitivity, and the visual field is sampled by a mosaic of cells of different types, meaning that two neighboring cells typically have very different properties (see (O’Regan and Noë, 2001)). There is no translation invariance at the interface between the nervous system and the optical environment. Again, this invariance appears at the psychological level: if the photograph is moved, one sees the same person. But this does not occur physiologically by having shared synaptic weights, or translation-invariant weights.

Romain Brette@romainbrette· Feb 2

It is often said that modern science, especially physics, explains phenomena in terms of efficient causes ("billiard-ball causality"). I'm not sure why, but this is a complete myth. Physics explains phenomena in terms of constraints, formalized by equations. press.princeton.edu/books/paperb...

When the scientist wants to predict what happens when you reduce the volume of a container at fixed temperature, she uses the constraint of the ideal gas law to infer that the pressure will increase. Of course, we might want to explain the phenomenon in terms of the collisions of atoms, but these are narratives rather than science.
Newton’s laws are also formal expressions of constraints. For example, the second law says that the acceleration of an object times its mass equals the total force exerted on that object. From this constraint, we can infer the trajectory of an object, for example in a gravity field. Dynamics is secondary to the constraint on acceleration. The various conservation laws of physics are examples of general constraints.
To know whether an object would float or sink, we do not examine the motion of individual molecules in the fluid. Instead, we use Archimedes’ principle, which stipulates that an immersed object is subjected to a force opposite to the weight of the fluid that the body displaces. This is a global relational constraint (relation between the object and its environment), and yet, physicists are generally at ease claiming that the buoyant force causes the object to move up or down in the water.

Romain Brette@romainbrette· Jan 30

"Neural representations" are the epicycles of neuroscience. press.princeton.edu/books/paperb...

Thus, the systematic analysis of the activity of neural populations has confirmed that “neural representations” are associations between experimental dimensions and neural activity that are stimulus-dependent, context-dependent, task-dependent, relevance-dependent and finally, time-dependent across various timescales, from milliseconds to seconds to days. In fact, the “represented” dimensions also depend on the dimensionality reduction method (Langdon et al., 2023).
At this stage, the representational and coding terminology starts sounding like epicycles.

Romain Brette@romainbrette· Jan 28

Brain modularity is a concept inspired by how we make machines. But brains are not made by people. press.princeton.edu/books/paperb...

This is what an engineer would typically do: to build a robot, one would design perception modules, typically one per sensory modality, planning modules, and motor control modules (but see Brooks (1986) for an alternative way of building robots). The reasons for this modularity are cognitive and social. Cognitively, this allows one to focus on one simple problem at a time, following Descartes’ rule of analysis (Descartes, 1637): to divide the problem into smaller, more intelligible, pieces ("Diviser chacune des difficultés que j'examinerais, en autant de parcelles qu'il se pourrait et qu'il serait requis pour les mieux résoudre"). Socially, it also allows work to be divided between different people, or even different companies: one in charge of each module. These modules can then be reused in different contexts, different machines that combine modules in new ways. For this to work, the input-output properties of modules are well-specified, for example by stating that a module’s output represents sound direction. What the output represents should not depend on the context in which the module is embedded.
Thus, there are excellent reasons for engineers to use modular design. But brains are not made by people, let alone by human societies. However appealing the functional argument for computational modularity might be, it is hard to reconcile with the known physiology and anatomy of nervous systems.

Romain Brette@romainbrette· Jan 27

The idea of action as a way to meet your prediction (active inference/FEP) does not work, for the simple reason that you can always make many predictions, so this rhetorical trick simply displaces the problem from action selection to prediction selection. press.princeton.edu/books/paperb...

Of course, the rhetorical trick of active inference is precisely to call the goal a prediction. So, the runner predicts that she will arrive quickly at the finish line. In this way, the person acts so as to meet her “prediction.” But this is a rhetorical move with no explanatory power. It can work only as long as one decides to name as “prediction” exactly the goals of the person and forgets about all the other predictions that she might make. For example, we might grant that the runner predicts that she will win the race, although that is obviously false for many self-aware mediocre runners. But she would also predict that the race will start soon, that she might fall while running, that she might lose the race. The runner might also see the clouds and predict that it will rain. In any situation, you can predict many things: some events that you want to happen, others that
you want to avoid, and yet others that you might not care about. Therefore, stipulating that you act so as to meet your predictions cannot work, since there are several predictions at any given time.

Romain Brette@romainbrette· Jan 26

The fallacy of machine consciousness relies on a semantic confusion about the notion of "mental state". A mental state is not something like a physical state or computational state, but a kind of activity. press.princeton.edu/books/paperb...

Consider the following thought experiment inspired from the TV series
Bewitched (Brette, 2019b). In that series, Samantha, the house wife, is actually a witch. She can twitch her nose and every one freezes except her. Then she twitches her nose and every one unfreezes, without noticing that anything happened. For them, time has efectively stopped. What happens during that time is not a continuous experience of the same mental state. Rather, there is no experience, no mental image at all, and it is as if time had jumped from one instant to another. This is because an experience is not a thing but an activity (Erdin and Bickhard, 2018; Zahnoun, 2020). Despite the common terminology, a “mental state” is nothing like a physical state.

Romain Brette@romainbrette· Jan 23

GenAI, an allegory. [Cascade by MC Escher]

Cascade by MC Escher. A perspective illusion where water appears to run perpetually around a closed path with a cascade.

Romain Brette@romainbrette· Jan 15

This is more than an unfortunate manner of speaking. Linguists have
pointed out for a long time that language shapes our thought, in particular metaphors (Lakof and Johnson, 1980). In this case, conceptualizing information as a thing hides a fundamental feature of perception: it is a constructive process, not a matter of extracting and filtering concepts from the environment. Consider for example a nose. A nose can be big or small, pointy, hairy, and so on, but what kind of physical object is a nose? A nose has no clear molecular delimitation, and it even includes holes. The delimitation is one made by our cognitive systems. More generally, objects are cognitive concepts shaped by our interactions with the environment. Therefore, contrary to Marr’s claim, to perceive the world is not a matter of finding out what is out there, of inferring a preexisting objective description hidden by our limited sensory apparatus or degraded by “noise.” Rather, perceptual objects are cognitive constructions of subjects interacting with the world. This fundamental point dis appears in the mainstream view of information: information by reference.

Romain Brette@romainbrette· Jan 15

Information: the epistemic phlogiston of neuroscience (or biology). Apparently there is a special kind of substance in this world called "information", which brains extract, store in the firing rates of neurons, and move around between brain areas. press.princeton.edu/books/paperb...

Linguistically, talking about “information” as if it were a thing is a case of hypostatization, as Zahnoun has pointed out for the related concept of representa tion (Zahnoun, 2020): we use the grammatical category of nouns for something that is not substantive, like an action or a property, as when we say: “I am going for a walk.” There are no such things as walks in the world. In the same way, we say that we “acquire information”: it simply means that we inform ourselves, not that there actually is some kind of epistemic phlogiston that we pick up in the world and put in our brain. Surely, you need letters to read, just like you need a ground to walk on. But the ground is not a walk.

Romain Brette@romainbrette· Jan 9

One reason why the brain (or a living organism) should not be conceived as a machine is that its normativity (goals) is grounded in its material existence, ie "implementation" is not secondary. press.princeton.edu/books/paperb...

Machines are defined by their functional specification, the relations be-
tween their parts, in de pen dently of their material existence. This is a key aspect of computationalism: cognition and consciousness are determined by the relations between functional states, at an abstract level, in de pen dently of the material “implementation” of those relations. In other words, the “hardware” plays no role in the specification of the “software,” it only supports its execution. But as we have seen in chapter 2, this is not the case of living systems, because the normativity of living systems is grounded in the physics of this world: it is because of thermodynamics that living systems need to feed, and therefore that they have goals, that they take actions, that they anticipate; in other words, that there is such a thing as “behav ior.” Therefore, Marr’s “computational level” is in fact grounded in the material level, which is then improperly called “implementation.”

Romain Brette@romainbrette· Dec 31

Not everything useful is computation. Example: the clock. press.princeton.edu/books/paperb...

An elementary example is a clock. We can certainly say that a clock implements a computation, namely counting. But this is not what makes it a clock. What makes it a clock is that each tick takes exactly one second, and this is not obtained by computation but from the physical properties of the device. For example, in a traditional clock (figure 4.10), it is the dynamics of the pendulum that sets the tick frequency.

Romain Brette@romainbrette· Dec 29

(quote from my book:)

The machine view of life is so ingrained in scientific culture that it seems very difficult for many scientists to imagine that living organisms could be something else than machines, or that brains could be something else than computers—“what else could it be?” seems to be a valid scientific objection (van Gelder, 1995). As I pointed out in chapter 1, molecular biologists and cognitive scientists appear to have replaced God with the engineer. The Church has disappeared, but otherwise there is a stunning intellectual conti- nuity: God was a watchmaker, and now life is clockwork. Is there really noth- ing in the world apart from human artifacts and magic? Couldn’t life be its own thing, rather than a kind of clock?

Romain Brette@romainbrette· Jul 23

*par ex, le développement des caractères sexuels mâles du rat dépend du comportement dit de "léchage anogénital" de la mère. Du coup c'est "l'environnement" du fils, qui est en partie les gènes de la mère, donc en partie du fils, bref la distinction gènes/environnement n'a juste aucun sens.

Romain Brette@romainbrette· May 28

Here's another extract from my book, with a quote of Darwin:

The engineer starts from the desired functionality, then designs and tunes a structure that fulfills this functionality. In contrast, evolution is a blind historical process: a structure gets created by chance, and might then be conserved and possibly refined if it serves a useful functionality; or some existing structure might change and take on a new functionality. A central argument of Darwin in The Origin of Species (Darwin, 1859) is precisely that we find striking anatomical similarities across different species despite the diversity of lifestyles, which only makes sense if we assume a common ancestor: “What can be more curious than the hand of a man, formed for grasping, that of a mole for digging, the leg of the horse, the paddle of the porpoise, and the wing of the bat, should all be constructed on the same pattern, and should include the same bones, in the same relative positions?”.

Romain Brette@romainbrette· May 27

Against "reverse-engineering the brain": (The Brain, in Theory, chapter 1)

Yet, if we were to explicitly ask a modern neuroscientist whether the brain is actually an engineered device, she would certainly strongly object. Brains are not the result of intelligent design. This is a religious view of life that has been discredited by Darwinism. Why then are we to “reverse-engineer” brains, if brains were not engineered in the first place?
This terminology is typically excused by adding that brains are engineered by evolution, not by God. But Darwin’s insight is precisely that evolution is not a case of engineering. Engineering is the use of knowledge to solve technical problems. It presupposes an external mind that plans and assembles machines according to a preexisting goal. But evolution has no goals, plans or knowledge; in other words, it is not an engineer.

Romain Brette@romainbrette· May 22

Sure! Some context maybe (previous paragraph):