Building the Computational Mind for the “Swiss Army Knife” of Microscopes

The data flowing from those instruments already represents a fundamental shift in how biology can be practiced. For the first time, researchers can watch in vivo biochemistry unfold inside cells living within their native tissues, inside a living organism.

What comes next, he believes, could be transformative: a vision language model that reasons natively over biology, connecting what it sees with molecular identity, experimental context, and prior biological knowledge to determine which observations matter and which experiments should come next.

“Connected to automated microscopes, sample handling, and perturbation systems, that capability could provide the foundation for self-driving biological laboratories — and fundamentally change the rate at which we can make discoveries,” said Upadhyayula.

###

Lawrence Berkeley National Laboratory (Berkeley Lab) is committed to groundbreaking research focused on discovery science and solutions for abundant and reliable energy supplies. The lab’s expertise spans materials, chemistry, physics, biology, earth and environmental science, mathematics, and computing. Researchers from around the world rely on the lab’s world-class scientific facilities for their own pioneering research. Founded in 1931 on the belief that the biggest problems are best addressed by teams, Berkeley Lab and its scientists have been recognized with 17 Nobel Prizes. Berkeley Lab is a multiprogram national laboratory managed by the University of California for the U.S. Department of Energy’s Office of Science. 

DOE’s Office of Science is the single largest supporter of basic research in the physical sciences in the United States, and is working to address some of the most pressing challenges of our time. For more information, please visit energy.gov/science.