gliched_robot·2 năm trước·discussIf anyone wants to try this out, here is the hugging-face spaces demo: https://huggingface.co/spaces/google/paligemma
gliched_robot·2 năm trước·discussLmsys devs have all the answers, I am not sure how this has not leaked yet. They must a strong NDAs.
gliched_robot·2 năm trước·discussI do not understand the taught process here. They are regulating it so fast. It's almost like regulating car before even engine is invented.
gliched_robot·2 năm trước·discussInference speed is not a great metric given the horizontal scalability of LLMs.
gliched_robot·2 năm trước·discussDisagree on Nvidia, most folks fine-tune model. Proof: there are about 20k models in huggingface derived from llama 2, all of them trained on Nvidia GPUs.
gliched_robot·2 năm trước·discussThis llama model some made it run on an iphone. https://x.com/1littlecoder/status/1781076849335861637?s=46
gliched_robot·2 năm trước·discussThe code it writes is getting worse eg. lazy and not updating the function, not following prompts etc. So we can objectively say its getting worse.
gliched_robot·2 năm trước·discussIf any one is interesting in seeing how 400B model compares with other opensource models, here is a useful chart: https://x.com/natolambert/status/1780993655274414123
gliched_robot·2 năm trước·discussIs this real? Seems suspicious given that its just one model not a family of models like llama and llama-2.