In my work, I study generalization: how a learning agent can use related past experience to improve inferences in novel systems and situations
No two moments are the same, yet as humans we are able to flexibly apply past experience in order to make good predictions and actions in novel and unfamiliar environments. This ability—generalization—is a core component of our cognition; some have even claimed a Universal Law. In my research, I develop computational models and mathematical formalizations of generalization in order to understand human inductive inferences better. In particular, I am interested in relational generalization: how to move beyond those things that look similar, and towards those that are abstractly or analogically the same.
In modern machine learning, powerful algorithms and hardware have recently been developed using deep learning. These learners, however, are only able to perform a single task well, after many training data and cycles, and generalize poorly. From an engineering point of view, this is unsatisfying: retraining algorithms for every problem, depending on the availability of a large dataset is an expensive solution to all of our problems. From a scientific point of view, I hope to use what I learn from studying humans—who generalize well, and can infer and act well after only a small amount of interaction with a new problem—to build better inductive biases into modern machine learners, and improve their performance, generalization, robustness, and efficiency.
In my work, I study discovery and models of algorithmic science
Scientific reasoning is one peak of human endeavour: we make deep insights into the nature of reality by creative exploration, careful thought, and rigorous modeling and experimentation that can improve our lives and alleviate disease. I build computational models for algorithmic science that help us understand these cognitive processes, and accelerate them by artificial aids. One research focus is the psychology of exploration and theory-testing behaviours. Another is the optimization problems encountered in specific scientific fields. And a third is the mathematics required to model the process of invention and discovery.