hidden_activation vs hidden_act in config.json

#10

by heheda - opened Sep 22, 2024

Meta Llama org Sep 22, 2024

Llama 3.1 uses hidden_act to specify the activation function, while this model uses hidden_activation. Can you change the hidden_activation to hidden_act to help vllm reuse the code of llama 3.1?

ArthurZ

Meta Llama org Sep 22, 2024

For sure

heheda

Meta Llama org Sep 22, 2024

Thanks!

heheda changed discussion status to closed Sep 22, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment