Skip to slides

NEUROTRAILBLAZERS · TEACHING MATERIALS

Connectome Analysis and NeuroAI

Reading version. Text reflows with your screen and zoom. Figures retain their available captions. Expand teaching notes for additional context and, where supplied, visual descriptions.

Contents · 18 slides
  1. 1. Connectome Analysis and NeuroAI
  2. 2. Session outcomes (60 minutes)
  3. 3. Pedagogical arc
  4. 4. Motivation and framing
  5. 5. Representation framing
  6. 6. Limits of reverse-engineering claims
  7. 7. From connectome to model: the strongest claim available
  8. 8. Motif search context
  9. 9. A motif, written as a reviewable query
  10. 10. Complexity constraints and feasibility
  11. 11. Historical benchmark caution
  12. 12. Comparative analysis caveats
  13. 13. The error-sensitivity check you should always run
  14. 14. Misconceptions to correct
  15. 15. Activity
  16. 16. Rubric checkpoint
  17. 17. The feed-forward motif
  18. 18. References and attribution

Slide 1 of 18

H01 electron microscopy with object segmentation and original 2 µm scale bar

Human cortex · H01
Object segmentation over electron microscopy

H01 release · Lichtman Lab / Harvard & Connectomics at Google · CC BY 4.0
Shapson-Coe et al. (2024) · doi:10.1126/science.adk4858

Technical Course · Unit 09

Connectome Analysis and NeuroAI

Choosing the null is the scientific step; running the test is bookkeeping.

Slide 2 of 18

Session outcomes (60 minutes)

Slide 3 of 18

Pedagogical arc

Slide 4 of 18

Motivation and framing

Structure can constrain models; it does not automatically explain intelligence.

Source: neuroAI source deck (2021 techtalk), Techtalk S10. Historical/context visual.

Figure description and teaching notes

Instructor script: "Hold this motivating question against an asymmetry. Machine learning has given connectomics far more than the reverse so far — dense segmentation, synapse detection, error detection and proofreading candidate generation are all learned systems, and none of the petascale datasets would exist without them. Saying that plainly is part of writing about NeuroAI credibly."

Slide 5 of 18

Representation framing

Define representation before inference.

Source: neuroAI source deck (2021 techtalk), Techtalk S11. Historical/context visual.

Figure description and teaching notes

Before any statistic, six construction choices (unit §1): what is a node (cell, type, compartment); what is an edge (and its synapse threshold); what is the weight; is it directed; which cells are included; where is the boundary. Each changes the answer. A graph is a versioned artifact with recorded parameters, not a script someone ran once. Inclusion criteria are the highest-leverage and least-reported of the six.

Slide 6 of 18

Limits of reverse-engineering claims

Teach boundary statements as required output.

Source: neuroAI source deck (2021 techtalk), Techtalk S12. Historical/context visual.

Figure description and teaching notes

What a connectome does not give machine learning (unit §5): not weights — synapse count is a proxy for strength, and sign, short-term dynamics, plasticity state and neuromodulatory context are absent; not dynamics — a static diagram from one animal at one moment; not a runnable brain; and not, so far, a competitive advantage in mainstream deep learning.

Slide 7 of 18

From connectome to model: the strongest claim available

Hypothesis → query → null comparison → interpretation → reproducibility package.

Source: neuroAI source deck (2021 techtalk), Techtalk S13. Historical/context visual.

Figure description and teaching notes

The image is the techtalk's framing of an embodied agent; the teaching point is the pipeline beneath it. The strongest current result type is a connectome-constrained model: fix connectivity from the measurement, fit what remains, predict responses that are then tested. This has been done in the fly visual system. That is the version where the connectome removes free parameters — which is exactly what makes the model falsifiable — rather than decorating a figure.

Slide 8 of 18

Motif search context

A motif definition, a host graph, and the query results. Candidate motifs are not validated mechanisms.

Source: neuroAI source deck (2021 techtalk), Techtalk S24. Historical/context visual.

Figure description and teaching notes

A motif is enriched only relative to a null. Ask what would count as the uninteresting explanation — degree heterogeneity, spatial proximity or cell-type composition — and require the null to preserve it.
Worked example (unit §2): 100 neurons, 1,200 edges, 210 reciprocal pairs. Erdős–Rényi expects 72.7 -> 2.9x enrichment. Degree-preserving expects ~150 -> 1.4x, z = 5.0. Degree- and distance-preserving expects ~185 -> 1.14x, z = 1.8, p ~ 0.07. Same data: "2.9-fold enrichment, p < 10^-6" or "no detectable effect", depending on a choice made before any test ran. Pre-register the null, or report under all three.

Slide 9 of 18

A motif, written as a reviewable query

Human-readable queries reduce hidden assumptions.

Source: neuroAI source deck (2021 techtalk), Techtalk S42. Historical/context visual.

Figure description and teaching notes

The real value of a declarative motif query is that the motif definition becomes an explicit, reviewable artifact instead of a description in prose — which turns "pre-register the motif and the null" into a practical instruction. Note what it does not do: it returns counts against whatever graph you built, carrying every construction choice, including a synapse threshold that may have quietly removed most of your edges.

Slide 10 of 18

Complexity constraints and feasibility

Search time against edge count for several motifs. Computational limits are part of methodological validity.

Source: neuroAI source deck (2021 techtalk), Techtalk S31. Historical/context visual.

Figure description and teaching notes

Subgraph isomorphism is the computational core, but in practice the hard part is statistical rather than algorithmic. There are 16 directed triad classes; testing all 16 at alpha = 0.05 expects about one false positive, and triad counts are strongly correlated with one another — so treating them as independent overstates confidence. That argues for permutation-based inference, which respects the dependence. Report how many tests you ran, including the ones you did not report.

Slide 11 of 18

Historical benchmark caution

Use old benchmark values as context, not current truth.

Source: neuroAI source deck (2021 techtalk), Techtalk S32. Historical/context visual; benchmark claims are historical unless independently revalidated.

Figure description and teaching notes

Read benchmarks the way the atlas advises: scores on small, clean volumes systematically overstate performance on production data with artifacts, rare morphologies and volume boundaries. The question for a project is not leaderboard position but error rate on your tissue — a pilot sub-volume of your own data.

Slide 12 of 18

Comparative analysis caveats

Cross-dataset claims require aligned preprocessing and null assumptions.

Source: neuroAI source deck (2021 techtalk), Techtalk S44. Historical/context visual.

Figure description and teaching notes

Comparisons are the most durable result type in this field — across development, as in the C. elegans developmental series, or across species — because a shared reconstruction bias partly cancels between the two sides. The condition is that both sides were built with the same construction parameters and, where relevant, the same materialization version; otherwise the comparison measures the pipeline rather than the biology.

Slide 13 of 18

The error-sensitivity check you should always run

  1. State your measured merge and split rates (Unit 08 validation).
  2. Apply random merges and splits at those rates to your graph.
  3. Recompute the motif statistic across many perturbed graphs.
  4. Report the spread as an error band on the effect size.
Figure description and teaching notes

Why this matters (unit §3): merges fuse two partner lists and manufacture triangles among partners never connected through one cell — they inflate dense motifs superlinearly in the error rate. Splits mostly remove edges, deflating all motifs roughly proportionally. The two do not cancel; the residual bias points toward more dense motifs, the direction of the interesting result.
Instructor script: "If the band crosses the null expectation, your result is not robust to your own measured error rate. Say so before a reviewer does. It is a few dozen lines of code."

Slide 14 of 18

Misconceptions to correct

Figure description and teaching notes

On the second: someone objects that a distance-preserving null "throws away the biology". It depends on the hypothesis. Testing for specific reciprocal wiring beyond generic spatial structure: control distance. Comparing reciprocity between two circuits: a within-circuit distance null may over-control. Asking what generates the reciprocity: compare generative models rather than pick one null. Write out in words what would count as the uninteresting explanation before choosing.

Slide 15 of 18

Activity

Design one analysis card with:

Slide 16 of 18

Rubric checkpoint

Slide 17 of 18

The feed-forward motif

One of the 16 directed triad classes, drawn on its own.

Source: Wikimedia Commons user Marashie, File:Feed-forward_motif.GIF. CC BY-SA 3.0.

Slide 18 of 18

References and attribution