From Silicon Valley to DC, the tech world is suddenly obsessed with one concept in AI: Distillation
- Get link
- X
- Other Apps
Earlier this year, Google AI lead Jeff Dean, on a podcast , discussed a concept that, at the time, was hardly spoken about outside of wonky tech circles: distillation. In talking about the development of Google's AI models, Dean said that he and colleagues discovered artificial intelligence distillation techniques because Google was looking to improve performance on its systems without relying on one large image recognition model. "Through distillation, which is a key technique for making the smaller models more capable, you have to have the frontier model in order to then distill it into your smaller model," Dean said in February. Five months later, distillation has suddenly become a hot-button topic from Silicon Valley to Washington, D.C., as techies and lawmakers debate whether the practice is turning into a national security threat and enabling China to catch the U.S. in the high-stakes AI race. Concern bubbled up late last week after Chinese lab Moonshot AI released Kimi K3 , and users quickly found it to be competitive with the best commercially available AI from Anthropic and OpenAI. Unlike the leading U.S. AI companies, which sell access to proprietary models, Moonshot and other Chinese labs are offering so-called open-weight models that allow users to download the technology, tweak it and run it wherever they want. Some government officials attribute Moonshot's ability to catch up so quickly to distillation, describing it as theft of American intellectual p...
【2025 New】Wireless Jet Fan Brushless Motor Turbo Air Blower For Car Cleaning With LED Light Digital Display Portable Outdoor Use
Special Price
🔥 Limited time offer! Grab your favorite item at an incredible price. Quality guaranteed!
Affiliate link — Commission earned at no extra cost to you
- Get link
- X
- Other Apps
Comments
Post a Comment