• Architeuthis@awful.systems
    link
    fedilink
    English
    arrow-up
    2
    ·
    7 hours ago

    And GPT-4.5 is terrible for coding, relatively speaking, with an October 2023 knowledge cutoff that may leave out knowledge about updates to development frameworks.

    This is in no way specific to GPT4.5 but remains a weirdly undermentioned albatross about the neck of the entire LLM code-guessing field, probably because the less you know about what you told it to generate the likelier you are to think it’s doing a good job, and the enthusiastically satisfied customer reviews in social media that I’ve interacted with certainly seemed to skew toward less-you-know types.

    Even when the up-to-date version release happened before the cut-off point you are probably out of luck, since the newer version is likely way underrepresented in the training data compared to the previous versions that people may have been using for years by that point.