It’s not always easy to distinguish between existentialism and a bad mood.

  • 20 Posts
  • 678 Comments
Joined 3 years ago
cake
Cake day: July 2nd, 2023

help-circle











  • The one-shotting phenomenon (or how a positive initial experience with the technology seems to lead to a heavily biased view of its merits) should probably be considered a distinct cognitive bias at this point.

    Turns out a lot of bright people can’t deal with a technology being utterly subjective in its efficiency, and also how that’s specifically the part that reduces it to being so narrowly useful as to force the existential question, given the insane resource burn and the socioeconomic disruption that’s part and parcel, even if like Doctorow you think that their rape and pillage of artist’s rights and intellectual property in general isn’t an especially big deal.

    Also, local LLMs are hardly extricable from the whole mess, they are basically a byproduct, and updated versions only will keep coming as long as their imperial size online counterparts remain a viable concern.


  • In the original post he kept referring to Ollama like it was an LLM instead of a server app that hosts LLMs so I’d say the jury’s out on that.

    edit: Also, throughout this piece he keeps equivocating between local LLMs and their behemoth online counterparts with their heavily proprietary tooling that occasionally wraps them into a somewhat useful product.

    I think he assumes that because he can load up a modest speech-to-text model locally and casually transcribe several hours of video resources in somewhat short order (this was apparently his major formative experience with modern AI) it works the same with e.g. coding.

    Like, hey gpt-oss please make sense of these ten thousand lines of context without access to a hundred bespoke MCP intermediaries and one or three functioning RAG systems as I watch the token generation rate slow to a trickle while the context window gradually fills up.


  • Usually, you wake up on a lifeless beach that’s adorned with some sort of abandoned marble temple. It’s supposed to be beautiful, but instead it’s really sad. Almost unbearably sad. So much so that you want to get away from it. So you crawl downward into these vents going below the horrible temple, and suddenly it’s like you’re moving through the innards of an incomprehensible machine that’s thudding away, thud, thud, thud. And as you get deeper, the metal sidings are carved with scrawled ominous curses and slurs directed toward you, and you hear the voices, louder than before, and you somehow know these people are in pain because of you. It keeps getting colder. Color drains from the world. And you see the crowd through the slats of the vents: pale and emaciated men, women, and children from centuries to come, all of them pressed together for warmth in some sort of unending cavern. What clothes they have are torn and ragged. Before you know it, their dirty hands and dirty fingernails lurch through the grates, and they’re reaching for you, tearing at your shirt, moaning terrible things about their suffering and how you made it happen, you made it, and you need to stop this now, now, now. And next they’re ripping you apart, limb from limb, and you are joining them in the gray dimness forever.



  • The bitcoin whitepaper certainly goes hard if you are dumb, it’s goldbug conspiratonomics meets technosolutionism except the proposed solution is the least efficient and most easily trackable and hijackable system possible.

    Also I loved how ethereum pioneered all the worst and most felonious aspects of crypto by introducing the ability to create shitcoins, and smart contracts, a feature that just cranked the attack surface to infinity with no mitigations.