NP-SAM: Implementing the Segment Anything Model for Easy Nanoparticle Segmentation in Electron Microscopy Images

16 May 2023, Version 1
This content is a preprint and has not undergone peer review at the time of posting.

Abstract

Despite the numerous existing (semi)automated workflows for image segmentation of electron microscopy pictures of nanoparticles for statistical size and shape determination the prevalent approach to particle counting still is doing so in cumbersome manual fashion. Here, we present an easily implementable, low entry barrier workflow for nanoparticle segmentation, which eliminates the need for manual particle counting. It is based on the recently released segment anything model and widely distributed, well maintained, python libraries. We explore the impressive zero shot performance of the segment anything model and present approaches for subsequent filtering of outputs to minimize over and under segmentation on a range of different electron microscopy images of nanoparticles. Furthermore, we introduce a novel methodology for handling partial overlap between nanoparticles, which comprise one of the biggest obstacles for many automated segmentation algorithms. Our presented workflow is easily adaptable, and we encourage the community to further build on the work we present here.

Keywords

(Scanning) Transmission Electron Microscopy
Nanoparticle Segmentation
Size Distribution
STEM
SAM
Segment Anything Model

Supplementary materials

Title
Description
Actions
Title
Supporting Information for - NP-SAM: Implementing the Segment Anything Model for Easy Nanoparticle Segmentation in Electron Microscopy Images
Description
Elaboration of how to use NP-SAM, information about materials and methods, additional information on how to implement and adapt filters as well as investigations of the effect of different parameters on computational time.
Actions

Supplementary weblinks

Comments

Comments are not moderated before they are posted, but they can be removed by the site moderators if they are found to be in contravention of our Commenting Policy [opens in a new tab] - please read this policy before you post. Comments should be used for scholarly discussion of the content in question. You can find more information about how to use the commenting feature here [opens in a new tab] .
This site is protected by reCAPTCHA and the Google Privacy Policy [opens in a new tab] and Terms of Service [opens in a new tab] apply.