stopthatgirl7@kbin.social to Technology@lemmy.world · 2 years agoEverything Made By an AI Is In the Public Domaindoctorow.medium.comexternal-linkmessage-square143fedilinkarrow-up1692arrow-down133file-text
arrow-up1659arrow-down1external-linkEverything Made By an AI Is In the Public Domaindoctorow.medium.comstopthatgirl7@kbin.social to Technology@lemmy.world · 2 years agomessage-square143fedilinkfile-text
minus-squareillusoryMechanist@lemmy.worldlinkfedilinkEnglisharrow-up3·2 years agoDoes this mean we can, indeed, train AI on ChatGPT/other AI outputs?
minus-squareNatanael@slrpnk.netlinkfedilinkEnglisharrow-up9·2 years agoFYI there’s studies showing that repeatedly training ML on ML outputs degrades quality sharply after 4-5 cycles
minus-squareNatanael@slrpnk.netlinkfedilinkEnglisharrow-up6·2 years agoMachine Learning in this context
minus-squarePrager_U@lemmy.worldlinkfedilinkEnglisharrow-up1arrow-down1·2 years agoThat is a used method for training other LLMs, I believe OpenAssistant did this.
minus-squareassassin_aragorn@lemmy.worldlinkfedilinkEnglisharrow-up1arrow-down1·2 years agoDoesn’t that break the models?
minus-squareNatanael@slrpnk.netlinkfedilinkEnglisharrow-up2·2 years agoIt does after 4-5 cycles yeah, built in algorithmic biases gets amplified to a degree that it breaks the model
Does this mean we can, indeed, train AI on ChatGPT/other AI outputs?
FYI there’s studies showing that repeatedly training ML on ML outputs degrades quality sharply after 4-5 cycles
What does ml stand for
Machine Learning in this context
That is a used method for training other LLMs, I believe OpenAssistant did this.
Doesn’t that break the models?
It does after 4-5 cycles yeah, built in algorithmic biases gets amplified to a degree that it breaks the model