Hard AI

I saw this tweet by Yan Lecun that LLM can not think abstract in a visual way https://twitter.com/ylecun/status/1769778223842226286  What he fails to realize, or maybe exactly what he realised is that you should not make an LLM answer a question directly. Instead it shuold always be wrapper: "What is the strategy for answering this prompt: {X}, having these tools at your disposal". And then the list of actions that can be done. Think of it if you got some liquid and was asked what it was. It would be dangourus to just taste it, and give an answer. Instead we will analyze it - find the pH value and what other tools we can use to find out what it is. And then take that knowledge, and give a result. So the job of the LLM is to do this analysis and continuously improve the prompt (short term memory) with more and better information. And of course also improve the state for the tools available (long term memory, the programmed world model). The prompt can both contain text, images...

Investments A new AI software engineer called Devin has been made. You can ask it to develop any piece of software, and even just link to a some web page, and ask it to implement stuff based on that. Looking at the Youtube comments from the announcement videos people asked if it could just be asked to make a better version of itself. Right now it probably can't but it is based on GPT-4, and can be switched out with a better LLM when that is available. Having a software engineer is one part, but a neccesary one, of the super intelligent AI I have described previously. Also, the Figure 01 robot has made progress and this is also based on a multi modal LLM. A video describing the progress is in this video:  AI Agents Take the Wheel: Devin, SIMA, Figure 01 and The Future of Jobs - YouTube The point of the video is that everything is based on LLM, and when an LLM improves everything improves. The CEO of Devin says that right now the tool is more expensive in ressources ...