Just throwing a hypothetical in case we hit an algorithmic plateau of three nines of safety and have to start optimizing other parts of the stack. No idea is silly imo :)
You beat me to it :D love the podcast. Too bad they stopped uploading from a while ago. You got any suggestions of podcasts in similar space? Nothing ever could scratch the itch like Damn Interesting
Stop trying to promote slop on HN. Under "How does it work" you just put "CVNextLevel is a tool that helps you get imediate feedback on how to improve your CV." 1. fix the grammar 2.That did not give us any insight. If this was an one night attempt of an cash grab AI wrapper, it was a bad one.
I wish the password manager app allowed you to set a custom password to open the app. The iPhone password is something that people often share easily with those around them. With just the passcode, a person with bad intentions could easily gain access to all the passwords
>By fine-tuning only the adapter layers, the original parameters of the base pre-trained model remain unchanged, preserving the general knowledge of the model while tailoring the adapter layers to support specific tasks.
From a ML noob (me) understanding of this, does this mean that the final matrix is regularly fine tuned instead of fine tuning the main model ? Is this similar to how chatGPT now remembers memory[1] ?
Here [1] is a reference to the token/sec of Llama 3 on different apple hardware. You can evaluate if this is an acceptable performance for your agents. I would assume the token/sec would be much lower if the LLM agent is running along the side as the game would also be using a portion of the CPU and GPU. I think this is something that you need to test out on your own to determine its usability.
You can also look into lower parameter models (3B for example) to determine if the balance between accuracy and performance fits under your usecase.
>Is there a way to reliably package these models with existing games and make them run locally? This would virtually make inference free right?
I don't have any knowledge on game dev so I can comment on this but yes, packaging it locally would make the inference free.
Just want to add a recent experience I had on this issue. I accidentally deleted a bunch of photos on my Mac (including from "recently deleted") and didn't realize it deletes it from my emtire iCloud photo library. In a state of panic, I contacted apple and they were able to restore all the photos that were "permanently deleted " from the last 60 days. This surprised me quite a bit as I was not expecting them to get them back. Makes me think if any pictures on the cloud are truly deleted.
Sucks that they will announce who are affected by the end of April. Already struggling with anxiety, this is gonna make it difficult to concentrate on work.