Continue reading...
把强模型的输出喂给弱模型，弱模型能快速获得类似能力——这个逻辑本身成立，Lambert 没有否认。但他指出了一个没人说清楚的问题：蒸馏的天花板到底在哪里，取决于你想要的是什么类型的能力。
，这一点在51吃瓜中也有详细论述
Range queries ask "what's inside this box?" But sometimes the question is "what's nearest to this location?" This is the nearest neighbor problem, and you don't know how big your search radius should be. The nearest point might be right next to you or far away.
Indie director Jim Jarmusch has forged his reputation on intimate and immaculately cool character-driven dramas like Dead Man, Broken Flowers, Only Lovers Left Alive, and the unconventional zombie dramedy The Dead Don't Die. He has a way of taking famous actors and transforming them in ways we've never seen before. So frankly, we were giddy about this combination of ensemble cast and Jarmusch before we even got to the plot.*