Are there any examples for multi label classification

DL4J
1

are there any examples for multi label classification ?

2

I think there are no Multi Label Classification examples at the moment. However, going from a multi class classification to a multi label classification is pretty simple:

  1. Use a multi-hot encoding instead of a one-hot encoding for the labels
  2. Use sigmoid instead of softmax activations on the output layer
  3. Use an appropriate loss function for your task, you could try something like MultiLabelLoss

For other ways of doing it, see Multi-label classification - Wikipedia.

3

thank you , let me try

4

If each ‘label’ has multi-class instead of binary-class, i suppose it must use multi-output with MCXENT LossFunction on each output. Am i right ?
For example, to classify 5 kinds of food (5 labels) that each food has 1 of 7 colors (class of label), then there are 5 outputs for the model, and each output is corresponding to ont-hot of 8 values (value 0 for not that label, value 1~7 for the 7 colors).

5

In that case, yes - you would use ComputationGraph with multiple output layers.
The first output layer would have nOut(5) + softmax + MCXENT
The second output layer would have nOut(8) + softmax + MCXENT

1 Like
6

hi treo,
here is my code : GitHub - blackwingf/multilabel: multilabel classification
TextCNN4MultiIntentCommand is modified from CnnSentenceClassificationExample according to your advice .
The code of multi-hot representation locates in MultiLabelSentenceIterator Line 340.
The final prediction seems ok.
Am I right?