Evaluation on Lynx Tech Blog

Full Health Check of CPA Model Pool: Which of 80 Models Are Alive, Smart, or Running Naked

Sun, 23 Aug 2026 00:00:00 +0800

Last month I wrote an article testing six Claude Code models. This time I’m broadening the scope: my local CPA (local model gateway) has 80 models connected, and I did two things — first, sent real requests to each one to check liveness, then gave the survivors a puzzle-resistant intelligence test, and finally cross-validated against public leaderboards. Bottom line up front: listing a model ≠ it works. Of the 80 models, 59 are text models, and only about 30 could actually hold a conversat

Hands-on Test of Six Claude Code Models: Who’s Fast, Who’s Smart, and Who’s a Lottery

Sat, 15 Aug 2026 00:00:00 +0800

Claude Code’s model picker currently has six options sitting in it: qwen3.8-max, glm-5.2-fast-preview, glm-5.2, deepseek-v4-pro-0813, qwen3-coder-next, and grok-4.6. All of them are routed through my local CPA, a local model gateway, to their respective upstream providers. In day-to-day use, my impressions were vague: “this one feels faster,” “that one feels smarter.” Gut feel is unreliable, so I spent an evening putting them on the same starting line and benchmarked speed, thinking time, long-i