Not so Secret Sauce
https://www.theregister.com/2024/12/15/speculative_decoding/ speculative Decoding and specially designed chips that escape processing bottlenecks appear to have a huge impact of the response time for AI training / inferencing.
Linkup connects LLMs with premium content sources (legally) | TechCrunch
https://techcrunch.com/2024/11/28/linkup-connects-llms-with-premium-content-sources-legally/ Knowledge is power and the keys to those locks are important. Training data has been stolen by bug tech, and they will make sure that everyone else has to pay so much they won’t be able to train. Seems a bit anticompetitive and not the type of example we should be setting for our…
Read more
Make Your Own Expert
Sometimes it’s hard to see the big picture and other times, it’s difficult to remember all the details. Thank goodness they can remember it for us wholesale.