Share this comment
"Thus far, the closest thing to a killer app is probably coding assistace, but the income there isn’t massive enough to cover costs of the chips, legal etc."
I was writing out this very sentence in my mind before reading your paragraph.
Now, this is not to brag about my own anticipation of your point (only *very* tangentially), but rather …
"Thus far, the closest thing to a killer app is probably coding assistace, but the income there isn’t massive enough to cover costs of the chips, legal etc."
I was writing out this very sentence in my mind before reading your paragraph.
Now, this is not to brag about my own anticipation of your point (only *very* tangentially), but rather to reinforce that there is actually no money AT ALL in coding assistance:
Downloading starcoder (or something similar) from Huggingface takes literally minutes and depending on how much UI you need, deployment is another 30 minutes or so. If you have a GPU with 8+ GB of VRAM - and chances are if you are an *actual* coder, you have *more* VRAM than that - it eats 80 Watts (or so) when generating, but it won't generate all the time, so the cost is substantially less than 80 Wh*200*8 = how much is ~128 kWh in the US? 20$ or so? (You have the GPU anyways, so don't factor it in...)
No, coding is not profitable, and that's not even counting in that these things make costly mistakes (*duh*, I know...).