Skip to content

distributions

Exposes distributions for use with sample, observe, and intervene methods in LLaMPPL models.

Currently supported distributions:

  • Bernoulli(p: float) -> bool
  • Geometric(p: float) -> int
  • LogCategorical(logits: array) -> int
  • TokenCategorical(lm: llamppl.llms.CachedCausalLM, logits: array) -> llamppl.llms.Token
  • Transformer(lm: llamppl.llms.CachedCausalLM) -> llamppl.llms.Token
  • LMContext(lm: llamppl.llms.CachedCausalLM, prompt: list[int]).next_token() -> llamppl.llms.Token
  • LMContext(lm: llamppl.llms.CachedCausalLM, prompt: list[int]).mask_dist(mask: set[int]) -> bool