xlm.tasks.lm1b

detokenizer_lm1b_string(x)

Detokenizer for the LM1B dataset. Same as the one used in SEDD and MDLM.