sanitation@lemmy.today to Programmer Humor@programming.dev · 20 hours agoNew compression techniquelemmy.todayimagemessage-square142fedilinkarrow-up1950file-text
arrow-up1950imageNew compression techniquelemmy.todaysanitation@lemmy.today to Programmer Humor@programming.dev · 20 hours agomessage-square142fedilinkfile-text
minus-squareShellMonkey@piefed.socdojo.comlinkfedilinkEnglisharrow-up35·17 hours agoOn a similar note, I saw a story a bit back of someone saving input tokens by feeding the bot an image of a wall of text rather than the text itself and having it read the image via OCR. Satire and reality are too hard too distinguish these days.
minus-squareSorryQuick@lemmy.calinkfedilinkarrow-up3·6 hours agoSaves input tokens and uses more output because of OCR, and output is priced way higher.
minus-squareRooster326@programming.devlinkfedilinkarrow-up1·33 minutes agoIt’s an accounting trick. It uses a different budget…
minus-squareboonhet@sopuli.xyzlinkfedilinkarrow-up1·edit-24 hours agoAlso if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol
minus-squaretopperharlie@lemmy.worldlinkfedilinkarrow-up3·9 hours agoI mean, back in my days (👴) people sent a photo pasted into a word document, so things haven’t change that much…
minus-squareskisnow@lemmy.calinkfedilinkEnglisharrow-up8·14 hours agoI see this one all the time on LinkedIn, the management rubes love it
On a similar note, I saw a story a bit back of someone saving input tokens by feeding the bot an image of a wall of text rather than the text itself and having it read the image via OCR.
Satire and reality are too hard too distinguish these days.
Saves input tokens and uses more output because of OCR, and output is priced way higher.
It’s an accounting trick. It uses a different budget…
Also if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol
I mean, back in my days (👴) people sent a photo pasted into a word document, so things haven’t change that much…
They still do
I see this one all the time on LinkedIn, the management rubes love it