I just started working on some similar stuff, it’s been a dream forever but I never had time for the payoff to feel worthwhile. Would love to hear more about your Claude workflow and experience with Bevy, did you consider Godot?
Individuals at risk may spiral into psychosis that is triggered or exacerbated by their use of AI. The term when used correctly is completely literal and in no way implies that AI itself is conscious.
Isn’t the selection bias a bit strong, though? I don’t think social media is a reliable source of conclusions about the community as a whole, or even the people creating the content in the first place.
None of that seems like particularly nice behavior in retrospect. We could maybe also agree that the typical motivation behind taking things home was probably not to benevolently preserve historical records for future generations, although it’s nice that things worked out in this case.
This seems to be focused on general intelligence. I always assumed it was more about the ability to learn skills and abilities rather than increasing IQ.
You’re right of course. The LLM is a calculator continuously predicting a best-fitting next token based on the data it was trained on.
If its outputs resemble human reasoning, it’s because the encoding and training process managed to capture those patterns and use them to simulate fitting text. There is no real reasoning happening or second-order thought, other than a simulation of that happening through the mimicry of human writing.
LLMs can’t be prompted to perform actual reasoning, but they can be told to generate “thoughts” about what they’re doing that bring out more nuanced detail when they give their answers. This isn’t any more magical than writing out a more thoughtful prompt to get a conditioned answer, it’s just getting the LLM to flesh out the prompt engineering for you in the general direction you want it to go.
That seems rather fundamental to me, the idea that with some generic prompting the model tries to fit what it thinks reasoning looks like and can then take advantage of the additional context that would others be buried too deep to influence its answer.
I suspect that prompting the model to explore “thought” asks it to go down paths of linguistic connections that are related to the topic but not immediately connected to the answer in a way that would immediately influence the top predictions. Bringing summaries of those connections into the token context is a kind of zero-shot training on their relevancy to forming an answer.
To me this is less “reasoning” and more suggestive of the idea that some of the heuristics for data retrieval and question answering we collectively refer to as reasoning have broader applications.
Just to be clear, you’re agreeing with the author that it’s primarily a moral distinction? Since the shortage is impacting all patients equally it seems harsh to support it.
It would help to understand why you feel that it’s immoral; my interpretation is that you are saying it gives people an advantage at a cost that you don’t want to be forced into paying yourself in order to compete.
Wasn’t aware that Gleam was sponsored by fly.io, but it’s nice to see the investment in the ecosystem along with their support for Phoenix. Excited to see more developments for Gleam!
This is the real issue with privatized AI imo. The limitations and guardrails exposed to the end user do not apply to the developers, who can alter results in ways that would be difficult to detect at best and invisibly manipulative at worst.
Don’t humans work similarly? Without an understanding of how to reason through a problem, as children we are likely to give the first intuitive answer that comes to mind. Later we learn techniques of logic and reasoning that allow us to break down a problem into components that can be reasoned about.
What this seems to show is that the model does not yet have system-level or architectural guidance on when to employ reasoning, but must be explicitly reminded.
I suspect it could soon be feasible to fine-tune on code with limited open data through a bootstrapping approach.
Give it the source code, a test library and access to a dev environment and with some prompting it could start to experiment with increasingly complex use cases, learning from successful attempts. This would depend on the model’s ability to understand what a successful outcome is so it can define test cases, which might be harder if the output isn’t text but not impossible.
Being able to give a model expert knowledge on an undocumented library or language seems like it could help accelerate adoption of new technologies that might otherwise suffer from network effects as users get used to AI-assisted development. Not to mention automated testing, finding edge cases and making pull requests to fix them, security, etc.
A human taking time to experiment with their assumptions and gain experience with an unfamiliar subject is in a sense creating their own training data as well.