8000 Finetune with Trajectory Condiiton · Issue #28 · alibaba/Tora · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
Finetune with Trajectory Condiiton #28
Open
@OrangeSodahub

Description

@OrangeSodahub

Hi, thanks for your great contributions! I have a question, when you initialized from pretrained weights, and you add the addition trajectory condiiton (as embedding added to time embedding), then through the AdaLN. I want to make sure that you trained all the parameters of the model? Since you changed the embedding input to the AdaLN. Have you tried other finetuned settings, such as freeze part of the parameters.

In my case, I freeze the pretrained weigths and only train the trajectory condiiton weights, it totally failed. And training all parameters leads to extremely low efficiency.

Any suggestions would be appreciate!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0