ekZepp@lemmy.world to Technology@lemmy.mlEnglish · 1 month agoStudy Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrongfuturism.comexternal-linkmessage-square130fedilinkarrow-up1622arrow-down118
arrow-up1604arrow-down1external-linkStudy Finds That 52 Percent of ChatGPT Answers to Programming Questions Are Wrongfuturism.comekZepp@lemmy.world to Technology@lemmy.mlEnglish · 1 month agomessage-square130fedilink
minus-squareslacktoid@lemmy.mllinkfedilinkEnglisharrow-up2arrow-down3·1 month agoWe need a comparison against an average coder. Some fucking baseline ffs.
minus-squareanachronist@midwest.sociallinkfedilinkEnglisharrow-up8·1 month ago“Self driving cars will make the roads safer. They won’t be drunk or tired or make a mistake.” Self driving cars start killing people. “Yeah but how do they compare to the average human driver?” Goal post moving.
minus-squareslacktoid@lemmy.mllinkfedilinkEnglisharrow-up1·1 month agoThe issue is the powers that be arent comparing chatgpt to a reference manual. Rather another human being.
minus-squarehayes_@sh.itjust.workslinkfedilinkarrow-up5·1 month agoWhy would we compare it against an average coder? ChatGPT wants to be a coding aid/reference material. A better baseline would be the top rated answer for the question on stackoverflow or whether the answer exists on the first 3 Google search results.
minus-squareslacktoid@lemmy.mllinkfedilinkEnglisharrow-up1·1 month agoCause people arent looking at chatgpt as an accurate simple code generator, rather a junior dev.
We need a comparison against an average coder. Some fucking baseline ffs.
“Self driving cars will make the roads safer. They won’t be drunk or tired or make a mistake.”
Self driving cars start killing people.
“Yeah but how do they compare to the average human driver?”
Goal post moving.
The issue is the powers that be arent comparing chatgpt to a reference manual. Rather another human being.
Why would we compare it against an average coder?
ChatGPT wants to be a coding aid/reference material. A better baseline would be the top rated answer for the question on stackoverflow or whether the answer exists on the first 3 Google search results.
Or a textbook’s explanation
Cause people arent looking at chatgpt as an accurate simple code generator, rather a junior dev.