CryoSPARC Live™: The advantages of on-the-fly processing in cryo-EM

Modern cryo-EM datasets are typically several terabytes in size and often take over a day to collect. With traditional batch-based processing, users must wait for all files to be available on their local machine before beginning to process them. Moreover, processing must be performed entirely in serial, forcing later steps to wait until earlier steps (like motion correction) have completed.
This talk covers the advantages of using CryoSPARC Live™, an on-the-fly processing system built in to CryoSPARC™. Movies are processed as they arrive, and later steps (like particle curation, 2D classification, and 3D refinement) can be performed in parallel with motion correction. This dramatically improves throughput, in some cases producing a high-quality 3D map even before all movies have been preprocessed.
A version of this talk was originally presented at the Pacific Northwest Center for CryoEM (PNCC) in May 2024. Demonstration data is from EMPIAR 10424 (www.ebi.ac.uk/..., originally published by Nakane and colleagues.
More information about CryoSPARC Live is available at guide.cryospar....
Chapters
00:00 Introduction
00:31 Streaming vs. conventional processing
06:31 Why perform live processing?
09:03 Creating a session
22:22 The CryoSPARC Live user interface
29:54 Detecting and resolving data issues while collecting
36:47 Returning to conventional CryoSPARC and conclusion
38:04 CryoSPARC Live 2D Classification demo
41:06 CryoSPARC Live template picking demo