NeuroTrailblazers banner

MICrONS Visual Cortex

Overview

The Machine Intelligence from Cortical Networks (MICrONS) project represents one of the most ambitious efforts in modern neuroscience: the construction of a millimeter- scale connectome of mouse visual cortex paired with functional recordings from the same tissue. Funded by the Intelligence Advanced Research Projects Activity (IARPA) under the NIH BRAIN Initiative, MICrONS set out to answer a deceptively simple question — does how neurons are wired predict what they do?

The project produced a 1 mm³ volume of mouse visual cortex spanning the boundaries of primary visual cortex (V1) and two higher visual areas (AL and LM), imaged at 4 nm XY and 40 nm Z resolution. The reconstructed volume contains more than 80,000 neurons and over 500 million synapses. Critically, before the tissue was prepared for electron microscopy, approximately 75,000 neurons within the same volume were functionally characterized using two-photon calcium imaging in the living mouse. This dual-modality approach — recording what neurons do in life, then mapping how they are connected in death — defines MICrONS as the flagship project of “functional connectomics.”

The Multi-Modal Approach: Why It Matters

The Core Insight

Traditional connectomics provides a wiring diagram: neuron A connects to neuron B with N synapses. Traditional systems neuroscience provides functional descriptions: neuron A responds to vertical bars moving leftward. These two descriptions live in different worlds. MICrONS bridged them by ensuring that the same physical neurons appear in both the functional recordings and the EM reconstruction.

This is not merely a technical convenience. It enables a fundamentally new type of analysis: given that neuron A prefers vertical gratings and neuron B prefers horizontal gratings, are they more or less likely to be synaptically connected than a random pair? Do neurons with similar tuning properties form preferential subnetworks? Does connectivity predict correlated activity?

Two-Photon Calcium Imaging

Before EM preparation, mice were head-fixed and presented with a battery of visual stimuli (drifting gratings, natural movies, locally sparse noise) while neural activity was recorded using genetically encoded calcium indicators (GCaMP6s) and two-photon microscopy. The imaging spanned multiple sessions over several weeks, capturing responses from approximately 75,000 neurons across all cortical layers accessible to two-photon imaging.

Each neuron was characterized by its:

Co-Registration Challenge

Matching neurons between in vivo calcium imaging and post-mortem EM volumes is a non-trivial registration problem. The tissue undergoes dehydration, embedding, and sectioning for EM, which introduces distortions. The MICrONS team developed a multi-step registration pipeline that aligned two-photon imaging volumes to the EM volume using blood vessel landmarks, cell body positions, and iterative non-rigid transformations. The accuracy of this co-registration determines the reliability of all subsequent structure-function analyses.

Technical Pipeline

EM Acquisition

The EM data was acquired using a combination of automated tape-collecting ultramicrotomy (ATUM) and multi-beam scanning electron microscopy (mSEM). The tissue block was serially sectioned at approximately 40 nm thickness, with sections collected on tape and subsequently imaged at 4 nm pixel resolution. The resulting dataset is approximately 2 petabytes of raw image data — one of the largest EM datasets ever produced.

Key technical challenges included:

Segmentation

Neuron segmentation was performed using deep learning models, including flood-filling networks and related architectures, trained on manually annotated ground truth data from the volume itself. The segmentation pipeline produced an initial over-segmented representation that was subsequently agglomerated using learned affinity predictions.

Synapse Detection

Synapses were detected using a separate deep learning model trained to identify the characteristic ultrastructural features of chemical synapses: presynaptic vesicle clouds, synaptic clefts, and postsynaptic densities. The model produced both the location and the directionality (pre vs. post) of each synapse, enabling construction of a directed connectivity graph.

Proofreading and CAVE

Proofreading was performed using the CAVE (Connectome Annotation Versioning Engine) infrastructure and the Spelunker interface, a browser-based proofreading tool. While the full volume has not been exhaustively proofread (the scale makes complete manual review impractical), targeted proofreading has been applied to neurons of particular scientific interest — especially those with matched functional data.

Key Scientific Findings

Structure-Function Correlations (Turner et al. 2022)

The central finding of the MICrONS project, reported by Turner et al. in Cell (2022), is that synaptic connectivity and functional similarity are correlated — but the relationship is more nuanced than simple models predicted.

Key results include:

Pyramidal Cell Morphometry

The MICrONS dataset enabled the most detailed quantitative analysis of cortical pyramidal cell morphology to date. Measurements of dendritic arbor extent, spine density, axonal branching patterns, and soma size revealed systematic variation across layers and areas that correlates with known functional differences.

Inhibitory Circuitry

Inhibitory interneurons — which comprise roughly 15-20% of cortical neurons — were analyzed in detail. Different interneuron classes (basket cells, chandelier cells, Martinotti cells, and others) showed distinct connectivity motifs: basket cells preferentially target the perisomatic region of pyramidal cells, while Martinotti cells target distal dendrites. These wiring specificity patterns had been inferred from paired recordings and light microscopy but were confirmed here at a population level.

Connectivity Motifs

Analysis of small network motifs (patterns of connectivity among groups of 3-4 neurons) revealed non-random structure. Reciprocal connections between excitatory neurons are more common than expected by chance. Certain three-neuron motifs (e.g., chains and convergent patterns) are over-represented, suggesting structured information routing.

Data Access

The MICrONS dataset is publicly available through several channels:

Working with the Data

Typical analysis workflows involve:

  1. Querying the CAVE client for neurons of interest (by cell type, layer, or region).
  2. Retrieving synapse tables to construct connectivity matrices.
  3. Matching EM-identified neurons to their functional signatures from the calcium imaging dataset.
  4. Computing structure-function metrics (e.g., correlation between connectivity strength and signal correlation).

The dataset’s size (approximately 2 PB) means that most researchers work with derived data products (segmentations, synapse tables, skeleton representations) rather than raw imagery.

Challenges and Lessons

Scale and Computational Demands

The MICrONS dataset pushed the boundaries of computational infrastructure. Segmenting a 2 PB volume required thousands of GPU-hours. Synapse detection added further compute. Proofreading, even when targeted rather than exhaustive, required person-years of effort. These costs are a reminder that connectomics remains one of the most resource-intensive endeavors in biology.

The Limits of a Single Volume

A 1 mm³ volume captures only a tiny fraction of the mouse brain. Axons frequently exit the volume, meaning that long-range connections are truncated. This limits analysis to local circuitry and prevents a full accounting of each neuron’s input-output relationships. Future projects (such as MouseConnects) aim to address this limitation by imaging larger volumes.

The Functional Connectomics Paradigm

MICrONS demonstrated that combining structural and functional data yields insights that neither modality provides alone. A wiring diagram without function is an underconstrained puzzle. Functional recordings without wiring are missing the mechanistic substrate. The integration of both is more powerful than the sum of its parts — and likely represents the future of the field.

Proofreading Completeness

Unlike FlyWire, which achieved near-complete proofreading of an entire brain, MICrONS has been proofread selectively. This means that analyses must account for residual segmentation errors, and findings may be biased toward well-proofread regions or cell types. The tension between thoroughness and feasibility is a persistent challenge in large-volume connectomics.

Discussion Questions for Instructors

  1. Why is the co-registration between calcium imaging and EM volumes so critical? What would happen to the scientific conclusions if the registration contained systematic errors?
  2. The structure-function correlation in MICrONS is “real but modest.” What does this mean for our understanding of cortical computation? Is connectivity destiny, or merely one factor among many?
  3. Compare the proofreading strategy of MICrONS (targeted) with FlyWire (exhaustive). Under what circumstances is each approach appropriate?
  4. The MICrONS volume spans the border between V1, AL, and LM. How might areal boundaries within the volume complicate or enrich the analysis?
  5. If you could add one additional data modality to MICrONS (e.g., gene expression, neuromodulator receptor distribution, developmental lineage), which would you choose and why?

Key References