I'm wondering: are there any simulator games in which you have to take care of the stability of a nation-wide power grid? This whole situation has me interested in logistics of power distribution now.
I don't think I will ever use Lisp but I love the way this site documents different examples with all kinds of hardware. I wish there were more sites like these for other microcontroller/SoC languages like lua, mPython, Arduino derived boards etc.
As I sat down at my desk to start the work day and finish a dreaded task, my mind of course immediately drifted away and felt the urge to check some news on reddit or HW. I opened HW and this is the first title.
I am disappointed your comment did not have more responses because I'm very interested in deconstructing this argument I've heard over and over again. ("it just predicts the next words in the sentence").
While explanations of how GPT-style LLMs work involve a layering of structures which encode at the first levels some understanding of syntax, grammar etc. and then as the more levels of transformers are added, eventually some contextual and logical meanings are encoded.
I really want to see a developed conversation about this.
What are we humans even doing when zooming out? We're processing the current inputs to determine what best to do in the present, nearest future or even far future. Sometimes, in a more relaxed space (say a "brainstorming" meeting), we relax our prediction capabilities to the point our ideas come from a hallucination realm if no boundaries are imposed.
LLMs mimic these things in the spoken language space quite well.
I inferred this information by seeing the number of comments on HN (a relevant parameter in estimating the importance of an event imo), the time period 2009-2023 and then immediately after clicking seeing a tombstone.
This took me under 2-3 seconds.
The rest of the info I wasn't going time to spend on was the motives etc. It's not the first postmortem I see, I was just curious to why by skipping all of the boilerplate. Omegle is not important to me, but I know it was quite a phenomenon .
My point was that GPT failed blatantly at inferring this same easy task.
I didn't want to spend time reading that wall of text, so I wanted a summarized version of it. Asked ChatGPT (4) to do it for me and it told me that Omegle is not going to close.
My intuition told me otherwise, so the irony is that I spent more time than needed on this.
Sorry but I have to ask. In what kinds of contexts did you become experienced? Is LSD in at least a gray area anywhere on earth? The country I come from that is an illegal drug, but it being a neuroplasticity enhancer is what attracted my attention. I've also read about microdosing which can enhance focus or creativity.
Can it be prescribed for treating depression or other mental deficits or the approvals are not at that stage yet?
> The risk is more in the LLMs themselves, as whoever gets to control them gets to decide how people are going to experience the world. For the time being I might still double check all the answers I get from ChatGPT, but overtime the LLMs will get better and I'll get more lazy, thus making the LLMs the primary lens through which one views the world.
You've underlined the major risk these LLMs are for humanity. For a brief time in the history of human race, after information was democratized, most of us (at least educated people) had to use our own critical faculties to understand the world we live in. Now, that capacity will be outsourced to custom LLMs, most of them derived from other pre-trained with some ideological biases built-in. The informational Dark Ages of the technological era.
If they provide the tools to filter through the garbage, it'll probably be standardized in some way as an interface to the web. So just as HTML and its satellite technologies limit and standardize the representational aspect of information on the web, I think this AI-interface will severely limit the knowledge/wisdom aspect you can derive from information on the web. It's a hard thing to put my finger on, I hope you can understand what I'm saying.
I am aware of that. I like to think that millenials/gen-z at least knew a little how to sift through the fake information, and the gullible people were the elders.
But now with such obscene amounts of fake info at every corner, I think the internet and all source of information (even printed! - because printed at least would require significant effort) will loose credibility. Science will be the last bastion, and even that can easily be influenced by money.
For now, this is just funny, I laughed. But with the advent of all these new open-source LLMs, it will get worse.
If you thought people were gullible for falling for fake comments from bots, just wait for the near future. Post-factual/Post-Truth era truly begins. The internet that used to be a source of information is no more, only islands of truth will remain (like, hopefully, Wikipedia, but even that is questionable). The rest will be a cesspool of meaningless information. Just as sailors of the sea are experts at navigating the waters, so we'll have to learn to surf the web once again.
The funniest thing for me is how stupidly lazy are these jerks that employ GPT for such things. The printed book example really made me lol.
The simplest thing they could've done is use a service like quillbot to rephrase, just as I used here to rephrase my comment:
-----------------------
I chuckled. For now, this is just hilarious. However, it will grow worse when more new open-source LLMs emerge.
Just wait till the near future if you thought people were naive enough to believe counterfeit comments from bots. The post-factual/post-truth age has arrived. Only isolated truths will remain when the internet ceases to be a reliable source of knowledge (like, ideally, Wikipedia, but even that is debatable). The remaining material will be an ocean of useless data. We'll have to relearn how to navigate the web, just as seafarers are specialists at navigating the seas.
The most amusing thing to me is how exceptionally sloppy these idiots are that use GPT for such things.
From what I understood they used 175 seed tasks as an example for da-vinci which then generated the 52K instructions used to fine-tune LLama.
What I don't understand is how did they achieve giving this context to GPT, since afaik the context window is just 2048 tokens? It seems that it's not fine-tuning, but few-shot.
But that skill you're describing here is equally trainable and it probably will be in the near future, such that a specialized Artist AI will immediately guess what you're after, and if not, present you several iterations.
That Artist AI, in turn, will become a subset of a Market AI which will have access to a lot of data about what makes people tick, testing and deploying market strategies accordingly.
That Market AI, in turn, will be a subset of... you know where I'm going. All of this felt like Sci-Fi a while ago, but now you can almost taste it.
Nothing in the information space will be left untouched by the ML/AI revolution. I was a bit skeptical last years, but seeing this space evolve in the last 2-3 years left no question about it.
The only thing stopping this a Butlerian Jihad, probably. Actually, it probably can't be stopped.
Humanity as a whole seriously needs to start considering alternate incomes and ways to support people existing. We need to shift our perspective from the human individual as a value-producing asset to a right-to-exist-and-experiment-reality entity.
All of this is really awesome, but for me it's like admiring the exquisite beauty and calm of the blue sky in the center of a hurricane.
I'm still trying to adjust: am I too fatalistic or people are clearly ignoring of the tectonic shift that's happening?
Just your curious noematic entity.