Context Windows Are Lying to You: How to Actually Use 128K Tokens
dev.to
Every model brags about context windows now. 128K tokens. 200K tokens. "Paste your entire codebase!" the marketing says. I tried it. I pasted 80K tokens of a Node.js project into Claude and asked it to find a bug. It found a bug — in a file I didn't care about, while ignoring the actual issue in the file I mentioned. Here's what I learned about context windows the hard way. The Attention Problem Large context windows don't mean the model pays equal attention to everything. Research