Why this unit
Proofreading is the scientific QC layer that determines whether downstream analyses are trustworthy.
Learning goals
- Classify and correct merge/split/boundary errors.
- Tie corrections to explicit quality metrics and logs.
Core technical anchors
- Metrics: VI, edge precision/recall, ERL, synapse-centric F1.
- Priority strategy for high-impact error correction.
- Human-machine workflow separation: discovery, adjudication, finalization.
Method deep dive: production proofreading loop
- Candidate triage:
Rank errors by estimated downstream impact (edge loss, motif distortion, cell identity risk).
- Local correction:
Resolve merge/split/boundary errors with 2D/3D contextual validation.
- Global consistency:
Recheck branch continuity and synaptic partner plausibility.
- Metric update:
Recompute targeted QC metrics after each correction batch.
- Release gate:
Promote only segments that pass predefined quality thresholds.
Recommended QC thresholding strategy
- Use block-level dashboards for VI and edge precision/recall, not just whole-volume means.
- Track ERL by cell class to detect morphology-dependent blind spots.
- Maintain synapse-centric precision/recall for biologically relevant correctness.
- Require explicit uncertainty tags for unresolved defects rather than silent acceptance.
Frequent failure modes
- Over-fixing low-impact errors:
Prioritize corrections that materially change downstream conclusions.
- Inconsistent adjudication:
Maintain standard operating examples for merge/split edge cases.
- Metric gaming:
Pair global metrics with qualitative audits of biologically important structures.
- Human-fatigue drift:
Rotate reviewers and monitor disagreement trends over time.
Practical workflow
- Detect candidate errors in 2D and 3D context.
- Classify error type (merge, split, boundary ambiguity, identity confusion).
- Correct labels and record decision rationale.
- Validate continuity and synaptic context after correction.
- Log quality metrics for reproducibility and team review.
Visual training set (draft)
RIV-ULTRA S06: orientation cue for robust proofreading context.
RIV-ULTRA S09: synapse-oriented features relevant to correction decisions.
RIV-ULTRA S11: vesicle and organelle cues for ambiguity resolution.
RIV-AXDEN S13: axon-vs-dendrite differentiation for identity checks.
RIV-AXDEN S18: edge-case morphology for high-risk correction review.
RIV-AXDEN S22: advanced cue set for difficult boundary calls.
Module14 L2 S03: method overview context for processing/QC integration.
Module14 L2 S08: graph/pipeline transition context.
Module14 L2 S09: automated detection context for human-machine workflows.
Module14 L2 S10: quality-relevant processing stage.
Module14 L2 S13: evaluation/metrics context for QC reporting.
Attribution: Pat Rivlin training materials for `RIV-*` visuals; outreach visuals from module14 lesson2 extraction. Some planned IDs were unavailable in extracted thumbnails and were replaced with nearest available alternatives.
Discussion prompts
- Which error types most strongly alter downstream network conclusions?
- Where should human review be mandatory, even with strong model performance?
- What QC metadata is minimally required to make proofreading decisions auditable?
Course links
Quick activity
Take one candidate merge/split case and write a short correction log with before/after rationale and one QC metric.
Draft lecture deck