Inconsistent predictions when using custom ML backend with overlapping labels

Hi all!

I am integrating a custom ML backend with Label Studio to auto-suggest labels during annotation. :slightly_smiling_face:It works well for simple single-label tasks; but when using overlapping labels (multi-label classification); the predictions are inconsistent sometimes only one label shows up / confidence scores are missing entirely. :thinking:

I suspect the issue might be with how the backend formats multiple predicted labels or with how Label Studio interprets overlapping annotations from the model. :innocent: I followed the ML backend example, but the docs donโ€™t cover multi-label /overlapping scenarios in depth. Checked Label Studio Documentation โ€” Write your own ML backend with JIRA Course documentation guide for reference.

Has anyone successfully set up a backend that returns multiple predicted regions or tags for the same object/text span? :thinking: Would love a working example or advice on the right payload format to ensure consistency in pre-labeling.

Thank you !! :slightly_smiling_face: