One of the most important things for any profession is experience. Experience comes from learning from your own mistakes or those of others. Those with the best skills can be said to have learned a lot from previous mistakes.
So, how can someone become professional if they don’t learn from their own mistakes? In the case of AI; they will learn to become professional prompters and learn from the mistakes of bad prompts???
I prefer the former not the ladder.
The San Onofre Nuclear Generating Station had a similar vintage looking control room.
You can see a sad but cool image of the room as it’s being demolished on this nbc article.
My favorite space probe is the European Space Agency Philae.
It probes the comet 67P/Churyumov–Gerasimenko and actually landed on it. It was able to send back images of its surface.
Amazing!
Maybe a system running a local model is not so bad. The tokens per second will allow for that break?
Also, at what point does AI take over for all the thinking and white board planning?
AI should be a rubber duckie one can use to posit and assist when hit a brick wall. But if using it for all code generation, planning and troubleshooting then one is not in control; they’re just prompt drones…
Mine is just running a model on my laptop. It’s just amazing! I can ask it pretty much any question and it replies relatively FAST!
Before, we lacked advancements in technology because we were limited by hardware. This advancement is the opposite: our software and the math/algorithms have brought us this.
It’s possible to make it offline but one would still need a phone for the object recognition software…that software would have to be what stays offline.
Definitely doable.
I’m a little more hopeful that the future will allow for local (network free) frontier AI technology.
Being that I’m a tech enthusiast and computer science nerd I tend to live less on the bleeding edge of technology because of privacy infringing hardware. Take for example meta glasses. So many people have adopted them because they don’t care about privacy as much as I do. So they get to live with the latest and greatest.
Though, running a local LLM on my laptop (that is state of the art) has made me a little more hopeful that the future is around the corner. Who would have thought that one day we could run advanced AI on a laptop that’s able to do RAG and CAG.
I’m not sure if this comment is AI generated but I’d like to make a point either way.
Human biology is orders of magnitude more efficient than AI; that’s in regards to intelligence and processing the world around us.
It is not only more efficient but more complex but yet simple. Therefore, the complexity of our biology is a result of efficiency. An efficiency that allows us to process the world and achieve homeostasis in the most simple way. I’d like to see a machine achieve the same without having any type of vulnerability or weakness to corruption.
I just started messing with local LLMs and honestly I’m pretty impressed. I have a workstation laptop with an NVIDIA A1000 (6GB VRAM) and 96GB of RAM. I rarely used my gpu. Occasional CAD design or Machine Learning with OpenCV.
I ran llama3:latest and it ran pretty fast! I’m curious to see how Qwen would run on my system.