Editing Blog/2024-11-08/Brown M&Ms (section)

== Gemini ==
{{Tweet
| name = Roshan George
| username = arjie
| text = Gemini is the shittiest LLM of all time. Of _all_ time. Like GPT-2 beats it.
| date = Nov 5, 2024
| ID = 1853845290106945984
}}

As an aside, Gemini is a magical tool that is hamstrung by its creators. Neither ChatGPT nor Claude.ai can read the ballot measure text because it is a non-OCR'd PDF scan. While both can read OCR'd PDFs and both can read images, neither managed to read PDFs that only contained images of text. Gemini, on the other hand, was well-equipped to do so. However, Google appears to have destroyed its ability to actually reason about this. I can tell why. They don't want the Google brand damaged by some misinterpretation of election content or some Gemini hallucination.

But it made Gemini unable to answer anything about the document. You have to use all sorts of tricks (give me a table of contents, skip the first 20 entries in it, ...) etc. 

But it does ultimately point to a couple of things:

* These AI tools are capable of a lot more
* For the moment, plaintext versions of these texts are useful for people to understand what's up