A good 2.8 TRILLION parameter design with a-1 million token perspective window. China’s Moonshot AI just disclosed Kimi K3.1 Expert, an excellent 3T-category design having a-1 MILLION-token context window. To your interior criteria, it advances over K3 from the 7.2 items to your economic modeling and you can 11.6 things for the financial lookup, and you will ratings ~4.2× K3 on the simulated team procedure. (more…)