The Strawberry has landed! OpenAI has released o1-preview, its latest impressive demo, just in time for the current funding round. [Press release] The new hotness in Strawberry is chain-of-thought …
When the setup is “we run each query multiple times” the default position is that it costs more resources. If you claim they use roughly the same amount you need to substantiate that claim.
Like, that sounds like a pretty impressive CS paper, “we figured out how to run inference N times but pay roughly the cost of one” is a hell of an abstract.
Kay mate, rational thought 101:
When the setup is “we run each query multiple times” the default position is that it costs more resources. If you claim they use roughly the same amount you need to substantiate that claim.
Like, that sounds like a pretty impressive CS paper, “we figured out how to run inference N times but pay roughly the cost of one” is a hell of an abstract.
“…we pay for one,
suckersVCs pay for the other 45”