8000 Release v0.3.0 · ml-explore/mlx · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

v0.3.0
Compare
Choose a tag to compare
@awni awni released this 16 Feb 19:57
· 820 commits to main since this release
v0.3.0
bf7cd29
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Highlights:

  • mx.fast subpackage
  • Custom mx.fast.rope up to 20x faster

Core

  • Support metadata with safetensors
  • Up to 5x faster scatter and 30% faster gather
  • 40% faster bfloat16 quantizated matrix-vector multiplies
  • mx.fast subpackage with a fast RoPE
  • Context manager mx.stream to set the default device

NN

  • Average and Max pooling layers for 1D and 2D inputs

Optimizers

  • Support schedulers for e.g. learning rates
  • A few basic schedulers:
    • optimizers.step_decay
    • optimizers.cosine_decay
    • opimtizers.exponential_decay

Bugfixes

  • Fix bug in remainder with negative numerators and integers
  • Fix bug with slicing into softmax
  • Fix quantized matmuls with non 32 multiples
Assets 2
Loading
0