OpenAI may have tested GPT-4 on its training data, violating the cardinal rule of ML, and GPT-4's exam performance says little about its real-world usefulness

OpenAI may have tested GPT-4 on its training data, violating the cardinal rule of ML, and GPT-4's exam performance says little about its real-world usefulness

Upworthy

Published

OpenAI didn’t release much information about GPT-4 — not even the size of the model — but heavily emphasized its performance on professional licensing exams and other standardized tests. For instance, GPT-4 reportedly scored in the 90th percentile on the bar exam. So there’s been much speculation…

#openai #codeforces #horacehe #gpt #melaniemitchell #mba #memorization #emilybender #benchmarks #jargon

Full Article