8000 lab train errors out on 16GB M1 Mac · Issue #380 · instructlab/instructlab · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
lab train errors out on 16GB M1 Mac #380
New issue
New issue
Closed
Closed
lab train errors out on 16GB M1 Mac#380
Labels
bugSomething isn't workingdocumentationImprovements or additions to documentation
@alinaryan

Description

@alinaryan
alinaryan
opened on Mar 7, 2024

hitting this error on an M1 mac while running lab train:

libc++abi: terminating due to uncaught exception of type std::runtime_error: [METAL] Command buffer execution failed: Insufficient Memory (00000008:kIOGPUCommandBufferCallbackErrorOutOfMemory)

Tried increasing the VRAM with sudo sysctl 'debug.iogpu.wired_limit=12345' and still saw the same issue.

There seems to be a memory spike that kills the process:

Screenshot 2024-03-06 at 2 34 30 PM

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingdocumentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions
      0