Is it possible to fine-tune it to extract single-category objects based only on mask prompt

If I don't give SAM any point or box prompts, but only give it mask as prompts. How to fine-tune SAM to accurately segment objects in the fuzzy large-scale mask I gave.