Not so Secret Sauce
https://www.theregister.com/2024/12/15/speculative_decoding/ speculative Decoding and specially designed chips that escape processing bottlenecks appear to have a huge impact of the response time for AI training / inferencing.
Linkup connects LLMs with premium content sources (legally) | TechCrunch
https://techcrunch.com/2024/11/28/linkup-connects-llms-with-premium-content-sources-legally/ Knowledge is power and the keys to those locks are important. Training data has been stolen by bug tech, and they will make sure that everyone else has to pay so much they won’t be able to train. Seems a bit anticompetitive and not the type of example we should be setting for our…
Read more