Abhay kumar's picture

2 7 5

Abhay kumar

akanyaani

·

AI & ML interests

LLMs, GenAI, Transformers

Recent Activity

upvoted an article 11 days ago

Alyah ⭐️: Toward Robust Evaluation of Emirati Dialect Capabilities in Arabic LLMs

liked a Space 22 days ago

tiiuae/tiny-h1-blogpost

upvoted a paper 29 days ago

Learnable Multipliers: Freeing the Scale of Language Model Matrix Layers

View all activity

Organizations

authored 2 papers 10 months ago

ZClip: Adaptive Spike Mitigation for LLM Pre-Training

Paper • 2504.02507 • Published Apr 3, 2025 • 88

A Refined Analysis of Massive Activations in LLMs

Paper • 2503.22329 • Published Mar 28, 2025 • 14

authored 2 papers 11 months ago

Komodo: A Linguistic Expedition into Indonesia's Regional Languages

Paper • 2403.09362 • Published Mar 14, 2024 • 11

Variance Control via Weight Rescaling in LLM Pre-training

Paper • 2503.17500 • Published Mar 21, 2025 • 5