Cellpose: a generalist algorithm for cellular segmentation

Segmentation
Machine learning
Tools

Accurate deep learning-based cellular segmentation tool that works for a wide variety of images, and includes an easy to use GUI.

Author

Carsen Stringer, Tim Wang, Michalis Michaelos, Marius Pachitariu

Published

Jan 2021

Abstract

Many biological applications require the segmentation of cell bodies, membranes and nuclei from microscopy images. Deep learning has enabled great progress on this problem, but current methods are specialized for images that have large training datasets. Here we introduce a generalist, deep learning-based segmentation method called Cellpose, which can precisely segment cells from a wide range of image types and does not require model retraining or parameter adjustments. Cellpose was trained on a new dataset of highly varied images of cells, containing over 70,000 segmented objects. We also demonstrate a three-dimensional (3D) extension of Cellpose that reuses the two-dimensional (2D) model and does not require 3D-labeled data. To support community contributions to the training data, we developed software for manual labeling and for curation of the automated results. Periodically retraining the model on the community-contributed data will ensure that Cellpose improves constantly.

paper | talk | news article | preprint | code | original tweeprint

Thread:

  1. Releasing Cellpose, a generalist algorithm for cellular segmentation. Try it now directly on the website www.cellpose.org, or install the GUI with pip install cellpose:


  1. We developed Cellpose as a generalist algorithm, because many small and big problems in biology require cell segmentation, and there just isn’t enough time to write a new pipeline for every type of data.


  1. We trained Cellpose on a diverse set of 608 images, collected and segmented by us. See the t-SNE plot of image styles below.


  1. Out-of-the box, Cellpose can segment a large variety of images from different types of microscopy, different tissues and different stains or fluorescent tags. It can even segment rocks, jellyfish and sea urchins.


  1. The GUI lets you manually segment your own images at a speed of 300-600 objects per hour. Cellpose doesn’t need super precise outlines.


  1. Send us your manual segmentations and we’ll include them in the next Cellpose release, making the model better for yourself and everyone else! P.S. thanks for sending us your segmentations, they are now in the “cyto2” model!


  1. Also you can perform 3D segmentation without 3D training data!


  1. Check out the [paper] for much more: nucleus segmentation, comparisons to previous state-of-the-art methods, a cell size prediction network etc.
Janelia
Powered by Quarto. © Marius Pachitariu & Carsen Stringer lab, 2023.