xlm.commands.cli_demo

instantiate_model(cfg, datamodule, tokenizer)

Instantiate a model from checkpoint or config.

Supports two modes

1. Load a model from full training checkpoint using lightning_module.load_from_checkpoint(cfg.generation.ckpt_path)
2. Load a model from model only checkpoint using lightning_module.model.load_state_dict(torch.load(cfg.generation.model_only_checkpoint_path))

Parameters:

Name	Type	Description	Default
cfg	DictConfig	Hydra config	required
datamodule	Any	Datamodule instance	required
tokenizer	Any	Tokenizer instance	required

Returns:

Name	Type	Description
Harness	Harness	The instantiated model

generate(cfg)

Generate text using the CLI demo interface.

main(cfg)

Main function for CLI demo.