Skip to content

XLM

flops_estimation

Initializing search

dhruvdcoder/xlm-core

Home
Guide
Models
Developers
API Reference
Reference

XLM

dhruvdcoder/xlm-core

Home
Guide
Guide
- Quick Start
- Push to Hub
- Conceptual Overview
  Conceptual Overview
  - Data Pipeline
  - Metrics
- External Models
- Custom Commands
- Extract Checkpoint
- Evaluate
- FAQ
Models
Models
- Overview
- ARLM
- ILM
- MDLM
- MLM
Developers
Developers
- CONTRIBUTING
- Dependencies
- Testing
  Testing
API Reference
Reference
Reference
- xlm
  xlm
  - xlm
  - backbones
    backbones
    
    backbones
    
    dream
    dream
    
    dream
    
    configuration_base
    
    modeling_dream
    
    tokenization_dream
  - commands
    commands
    
    commands
    
    cli_demo
    
    extract_checkpoint
    
    extract_model_state_dict
    
    generate_star_graphs
    
    hydra_callbacks
    
    lightning_eval
    
    lightning_generate
    
    lightning_main
    
    lightning_prepare_data
    
    lightning_train
    
    push_to_hub
    
    scaffold_model
    
    split_owt
    
    train_tokenizer
  - datamodule
  - external_models
  - flags
  - generative_perplexity
  - harness
  - log_predictions
  - metrics
  - model
  - modules
    modules
    
    modules
    
    ddit_simple
    
    ddit_simple_v2
    
    encoder
    
    gpt2_transformer
    
    position
    
    regression
    
    rotary_transformer
  - noise
  - tasks
    tasks
    
    tasks
    
    cfg
    
    composite_eval
    
    gram_graph_coloring
    
    gram_n_queens
    
    lm1b
    
    math500
    
    owt
    
    qm9
    
    safe_molgen
    
    star
    
    sudoku
    
    sudoku_extreme
    
    uniref50
  - utils
    utils
    
    utils
    
    batch_size
    
    checkpoint_with_thinning
    
    data
    
    ddp
    
    debug
    
    ema
    
    file_friendly_progress_callback
    
    flops_estimation
    
    fsdp_diagnostics_callback
    
    fsdp_grouping
    
    hf_hub
    
    imports
    
    model_loading
    
    nn
    
    omegaconf_resolvers
    
    on_exception_checkpoint
    
    os
    
    rank_zero
    
    rich_utils
    
    saving_utils
    
    seed
    
    signal
    
    slurm
    
    speed_monitor_callback
    
    tensorboard_logging
    
    text
    
    tqdm
    
    wandb
  - version
- arlm
  arlm
- mlm
  mlm
- ilm
  ilm
  - ilm
  - datamodule_ilm
  - loss_ilm
  - metrics_ilm
  - model_ilm
  - nn
  - predictor_ilm
  - types_ilm
- mdlm
  mdlm

`xlm.utils.flops_estimation`

Generic FLOP estimates (Dream modeling helpers; see also gpt2_transformer MFU).

Made with Material for MkDocs