Current Projects

Check out what we're working on

How do neurons see the world?

Typical neuroscience experiments start by assuming we know the set of variables that drive neural activity. But what if neurons are tuned to variables we would never have guessed? What if, as with social interaction, the stimulus set is too complex to be boiled down to a few dimensions. With Jeff Beck, we’re developing models that infer stimulus categories directly from data, allowing us to “tag” images and movies based on neural responses.

Neural responses are sums of sensitivities to binary image "tags."
In an example dataset, the model correctly tagged monkey faces, whole monkeys, and monkey body parts.

Opening up the skull

For most neuroscientists, studying the brain means either using noninvasive brain imaging techniques like EEG or fMRI in humans or using more precise but invasive methods in animal models. However, when patients with Parkinson’s Disease or epilepsy undergo brain surgery, we have a rare opportunity to study brain activity at the most detailed level in human beings. Together with collaborators in neurosurgery, neurology, and biomedical engineering we’re investigating the processes underlying self-control, social interaction, and language with a precision rarely available in humans.

Eye tracking unplugged

Where we look speaks volumes about what we’re thinking. For over a century, psychologists and neurobiologists have used the movements of the eyes and measurements of pupil size to study the mind, but the need for experimental control has limited our ability to study eye movements in naturalistic settings. In P[λ]ab, we are pairing new advances in eye tracking technology with methods in computer vision and machine learning to tackle the challenge of studying eye movements in real-world settings, with applications ranging from treatment of acute fear to how we view art.

Mapping gaze between three and two dimensions.
Gaze mapping free viewing of art.
Three dimensional reconstruction of viewer position.