Take AI Capabilities with a Grain of Salt

You’ll see people claiming these models can reason all over social media. Watch out for motives. The companies who create these things are tryinging to sell you their service. It’s the same for those who are attracting eyeballs or selling themselves as experts. It’s important to know the capabilities of these models if you’re going to put them to serious use.

13/ Overall, we found no evidence of formal reasoning in language models including open-source models like #Llama, #Phi, #Gemma, and #Mistral and leading closed models, including the recent #OpenAI #GPT-4o and #o1-series. Their behavior is better explained by sophisticated…

— Mehrdad Farajtabar (@MFarajtabar) October 10, 2024