Skip to content

util

Utility functions

log_softmax(nums)

Compute log(softmax(nums)).

Parameters:

Name Type Description Default
nums

a vector or numpy array of unnormalized log probabilities.

 required

Returns:

Type Description

np.array: an array of log (normalized) probabilities.
Source code in llamppl/util.py 
11
12
13
14
15
16
17
18
19
20
def log_softmax(nums):
    """Compute log(softmax(nums)).

    Args:
        nums: a vector or numpy array of unnormalized log probabilities.

    Returns:
        np.array: an array of log (normalized) probabilities.
    """
    return nums - logsumexp(nums)