sanitation@lemmy.today to Programmer Humor@programming.dev · 1 day agoNew compression techniquelemmy.todayimagemessage-square152fedilinkarrow-up11.03Kfile-text
arrow-up11.03KimageNew compression techniquelemmy.todaysanitation@lemmy.today to Programmer Humor@programming.dev · 1 day agomessage-square152fedilinkfile-text
minus-squareSorryQuick@lemmy.calinkfedilinkarrow-up3·13 hours agoSaves input tokens and uses more output because of OCR, and output is priced way higher.
minus-squareRooster326@programming.devlinkfedilinkarrow-up3·8 hours agoIt’s an accounting trick. It uses a different budget…
minus-squareboonhet@sopuli.xyzlinkfedilinkarrow-up1·edit-211 hours agoAlso if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol
Saves input tokens and uses more output because of OCR, and output is priced way higher.
It’s an accounting trick. It uses a different budget…
Also if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol