#context-window

#context-window

Why is it that your existing employees initially outperform the new rockstar you've just hired? And why do you have a period of onboarding before a new hire gets up to speed? Institutional knowledge. The new rockstar knows how to do the job. That's why you hired them. But they need time to understand the company culture, processes, approaches, applications, their team, and customers and partners.

There is a plague in software development as of today, and it has become something we are gradually beginning to accept. It goes something like this: you're stuck on some code, so you deliver a code snippet to your favorite AI tool, hoping to debug it. You might get a solution, but then your AI tool introduces a new bug, which you suddenly have to spend time debugging.

The V3.1 has a longer context window, meaning it can consider a larger amount of information for any given query, allowing for longer conversations with better recall.