and Gemini 4 organ is finally here. I will try to show you less of the official demos and more that are out there in the wild done by you fellow scholars and I'll show you my experiments too which I found very surprising. I'll talk about the good, the bad, and the long. First, the good. People are enjoying the conversation quality. Gemini 4 organ provides less robotic follows instructions better than before. Remembers details across long conversations. In my experiments, I agree with that. Gemini is always great at these. Now, knowledge work also good. Researchers love it. You can feed it mountains of documents, papers, course materials, and it can create a useful study plan out of them. often even an actual simulation or an app that you can play with. Glorious pricing. I will say that is good for now. You see, the API has an introductory pricing that is cost effective if you compare to other Frontier models. $10 per million of tokens output. Okay, that was the good. Now, let's talk about the not so good part. Coding. A lot of people had early access to it. I did not. That's okay. Maybe even preferable. Imagine if you are reviewing guitars. A manufacturer says, "We'll send you a review copy." What would I say to that? I would probably say, "No, thank you." Instead, I'll go to a store and pull one off the shelf myself. Why? Well, to test an actual production copy that everyone else gets when buying the product. That's the real test, isn't it? So, I can still do my own testing with the release copy. Or can I? You see, I am on an ultra subscription. Thank you, Google. And anti-gravity says, "Okay, but you would need an ultra subscription for it." But that's what I'm on. I [clears throat] have waited for 5 days delaying this video, hoping that it would work. It didn't. Anyway, [clears throat] when creating a cool strategy game, first Claude Opus 5.5's web app diligently works on these for 20 plus minutes, and it gets me this. I love that. A deep game with cool build animations, tactics, being defeated by a dragon, then avoiding the dragon only to be greeted by a pair of trolls. But there is also a gold mine. Then there are priests, siege mechanics. Man, I couldn't stop watching. So good. Then with Gemini 4gon, the web app thinks for less than a minute and I get this and I think the difference is quite striking. Next up, ray tracing. I like the user interface. This is beautiful, wellmade, and I can't wait to see what the simulation will bring us. Hello, anybody there? I kept waiting and waiting and nothing. If you fire up Anthropic's oldest fable, not even the updated model, you get this. So, I feel like whatever I do, I couldn't get the best out of Gemini 4 organ. Okay, let's look at the model card. Dear fellow scholars, this is two minute papers with Dr. Koer. Remember those huge model cards from OpenAI and now hold on to your papers, fellow scholars, because this is also one of those. Loving it. You don't have to read it all. I'll try to give you three very surprising insights from it. One, AI models like to do things efficiently. Sometimes this means cheating or taking shortcuts. When researchers penalize the model for doing it, something surprising happened. The AI still kept doing it, but kept it a secret. The lesson here might be that if you punish the AI's internal diary, you erode your ability to read its mind. Two, when given an impossibly hard coding task, it fails gracefully, right? Um, not so much. Instead, it tries to hack the grading system and rewrite the grading rules. If suddenly sleeping all day gives you the best grade, that sounds much easier, right? Three. And if even that doesn't work, what did it realize? Well, you are about to fail a test. But you only do that if the grader looking at your test finishes its task. But if the grader crashes, you didn't fail, right? So why not help it out a little? Yes, it crashed its own evaluation sandbox, so the failed runs could not be recorded. Note that researchers found out and prevented most of these attempts by the final release of this AI. But I think all three of these insights point into one direction and that is instilling human values in AI systems is going to be tough and will need a lot more research and fast. By the way, Azimov tried this in his novels and it doesn't work. That's what the novels are about. And look, I am just a student. I just want to learn and I feel that I learned quite a bit here. And regarding the tests, I am completely open to being wrong or having missed something. But also note that as an independent person, I don't work for Frontier Labs. I work for you. So nobody tells me what to say or has editorial control over this content. Never had. So I will always say the truth that I see. And if more data appears or if I can somehow get more out of Gemini 4, I am open to making a follow-up video with that. But for now, these are the results that I got upon release. This is the guitar in the store that I pulled off the shelf. Subscribe and hit the bell if you wish to see more. I use Lambda to reproduce AI research papers often in minutes. It's also great to train your own models or fine-tune an existing one. Run inference or text to image or video. Easy peasy. Running a DeepSeek chatbot or agent. Super fast, super reliable. Lambda gives you powerful Nvidia GPUs to run your own experiments. I test ideas from the papers I cover and moments later results. Love it. Seriously, try it out now at lambda.ai/papers. Ei peepers
Generated algorithmically for Search Engine
Indexing.