Self-distillation with an EMA teacher at scale: ZeRO-3 + PEFT [P]

r/MachineLearning · 0 upvotes

Type

article

Stars

Added

Oct 27, 2026

Join builders getting curated tech discoveries every week. No spam.

No spam. Unsubscribe anytime.

↗Related Items

repo⚫ GitHub

⭐ 1,000

12 weeks, 26 lessons, 52 quizzes, classic Machine Learning for all

article🟤 Reddit

⭐ 344

r/MachineLearning · 86 upvotes

article🟤 Reddit

⭐ 312

r/MachineLearning · 78 upvotes