8000 Bug in entropy calculation? · Issue #83 · xjdr-alt/entropix · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
Bug in entropy calculation? #83
Open
@artus-LYTiQ

Description

@artus-LYTiQ

current_entropy = -jnp.sum(current_prob * jnp.log2(jnp.clip(current_prob, 1e-10, 1.0))) is operating on a single probability value.
Shouldn't you calculate entropy over a distribution?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0