• V0ldek@awful.systems
    link
    fedilink
    English
    arrow-up
    9
    ·
    edit-2
    2 months ago

    Kay mate, rational thought 101:

    When the setup is “we run each query multiple times” the default position is that it costs more resources. If you claim they use roughly the same amount you need to substantiate that claim.

    Like, that sounds like a pretty impressive CS paper, “we figured out how to run inference N times but pay roughly the cost of one” is a hell of an abstract.