Self-Refining Segment Anything Model for Nuclei Segmentation as Contrastive Learning Approach to Label-Efficient Pathological Imaging

Abstract

Background/Objectives: Precise nuclei instance segmentation is a prerequisite for reliable digital pathology, yet the scarcity of pixel-level annotations remains a significant bottleneck for deep learning models. Methods: We propose a self-evolving framework for robust nuclei segmentation that uses only sparse point annotations, extending the Segment Anything Model (SAM). To overcome the limitations of static pseudo-labels, our method introduces a self-evolving labeling strategy via Exponential Moving Average (EMA), which adaptively refines learning targets. We also integrate instance-aware contrastive learning using point prompts as spatial anchors and implement a consensus-based filtering mechanism between prompt-guided and prompt-free decoders. Results: Extensive evaluations on CPM17, MoNuSeg, and the challenging CoNSeP datasets demonstrate that our framework achieves state-of-the-art performance across various backbones, including ViT-B and ViT-H. Conclusions: By enabling a seamless transition from general-purpose foundation models to specialized histopathology experts, this self-refining approach delivers a highly efficient, accurate solution for automated diagnostic workflows in clinical settings.