Jul 23, 2023
These smaller LLMs like Llama-2–7B are in no way capable enough for doing agentic stuff like what we see in GPT-4. If you want to use agents, you will definitely need bigger models (talking about 65B and above) for appropriate agent behavior (e.g., ReACT execution) and performance.