"Synthetic samples fail to meet research standards"

View profile for Ben Resnik

Political Technology Leader | Making Emerging Tech Work for Democrats

"Overall, the performance of our 'synthetic sample' is too poor to be useful for all of our research questions...Further, we have demonstrated synthetic samples generate such high errors at the subgroup level that we do not trust them at all to represent key groups in the population." Ell. Oh. Ell. https://lnkd.in/ebajB7Hq

View profile for Ben Resnik

Political Technology Leader | Making Emerging Tech Work for Democrats

LLMs 👏 do 👏 not 👏 think 👏 like 👏 people. Political folks, remember this the next time you're pitched on "simulated" focus-group or polling response tools. You aren't getting an answer to your question. You're getting a system that looks for old focus group clips it thinks are *similar*, then plays back the recording it thinks fits best. https://lnkd.in/ewuqUWey

To view or add a comment, sign in

Explore content categories