I have two. One is a simple one that only deepseek R1 has passed (in my opinion):
I have a 12 liter jug and a 6 liter jug. How do I get exactly 6 liters of water?
Answer (Deepseek): Fill the 6-liter jug completely to obtain exactly 6 liters of water.
Every other LLM I've tried include o3-mini-high: Fill the 12-liter jug completely. Pour it into the 6 liter jug.
Although o3 did get it right in the reasoning: It seems like the user has a 12-liter jug and a 6-liter jug. The simplest answer is to just fill the 6-liter jug directly with water—done! But maybe there's a catch, like needing to use both jugs somehow.
So it knows that the 12 liter jug is mentioned uselessly, but most LLMs HAVE to use the 12 liter jug since it's mentioned in the prompt.
Another Prompt I recently found via perplexity (that deepseek got correct on the first try, but other LLMs can only get it right if I add: "Think step by step before answering."
A 67-year-old woman with congenital bicuspid aortic valve is admitted to the hospital because of a 2-day history of fever and chills. Her current medication is lisinopril. Physical examination reveals a temperature of 38.5°C (101.3°F), blood pressure of 110/70 mmHg, and a heart rate of 100/min. Cardiac auscultation demonstrates a grade 3/6 systolic ejection murmur at the right upper sternal border. Blood cultures are obtained, and empiric antibiotic therapy is initiated. Which of the following is the most likely causative organism?
A) Staphylococcus aureus
B) Streptococcus viridans
C) Escherichia coli
D) Pseudomonas aeruginosa
E) Candida albicans
Me visiting a listing for a toaster means that I'm in the market for a toaster, doesn't necessarily imply I already bought one.
Also, with this data, they can potentially build a better model than Amazon's recommender model. Most consumers have a pattern when buying and there's a lot of money in figuring it out.
It failed my basic benchmark that only GPT4 passes:
Q: I have a 12 liter jug and a 6 liter jug. I need 6 liters of water. How do I do it?
Falcon180B: First, fill the 6-liter jug completely. Then, pour it into the 12-liter jug. Fill the 6-liter jug again, and pour it into the 12-liter jug until the 12-liter jug is full. At this point, there will be exactly 6 liters of water in the 6-liter jug, which you can then use.
Q: Using only a 6-liter jug, how can I get exactly 6 liters of water?
Falcon180B: You cannot get exactly 6 liters of water in a 6-liter jug because it would already be full. However, if you had another container that could hold at least 6 liters of water, you could follow these steps:
1. Fill the 6-liter jug with water.
2. Pour the water from the 6-liter jug into the other container.
3. Refill the 6-liter jug with water and pour it into the other container.
4. Repeat step 3 until you have poured 6 liters of water into the other container.
This way, you can get exactly 6 liters of water by combining the capacity of the 6-liter jug and the other container.
This day got a lot better! I have thousands of hours but had taken a break after I reached a rocket launch every minute with 100s of trains running around.
I guess this break will be over soon. I look forward to dropping a few more lifetimes playing this amazing game.
I use the following test to ensure I'm on GPT4 and not 3.5. (I noticed that it did fail at this test temporarily and then got it. Not sure why. Maybe it reverts back to 3.5 when under load?)
I have a 12 liter jug and a 6 liter jug. I want to measure 6 liters. How do I do it?
GPT4: You actually don't need to do anything because one of your jugs is already a 6-liter jug. If you fill it up to the top, you'll have exactly 6 liters of water.
GPT-3.5: To measure exactly 6 liters using a 12-liter jug and a 6-liter jug, you can follow the steps below:
Start with both jugs empty.
Fill the 12-liter jug completely with water.
Pour the water from the 12-liter jug into the 6-liter jug. This will leave you with 6 liters of water in the 12-liter jug.
Empty the 6-liter jug.
Pour the 6 liters of water from the 12-liter jug back into the empty 6-liter jug.
Now, you have 6 liters of water in the 6-liter jug.
At this point, you have successfully measured 6 liters using the 12-liter jug and the 6-liter jug.
I have home assistant running with quite a few esp32's running esphome with random sensors/bulbs scattered around the house.
My question is, what do you use the manage the automations? Do you use the native home assistant automation, or node-red, etc? I've even looked a bit into Room assistant[0]
It is true, that the amount of solar needed to power the entire US is about 0.5% of the land.
That doesn't mean there's no benefit in increasing the efficiency of panels and get dual use of the land. It also has the benefit of allowing for solar in more places where it's needed for more decentralized power.
I had written a comment but thought this article conveyed my thoughts better:
Just the idea of 'independent thought' itself is a contradiction:
Independent thinking connotes the idea of being able to think on your own, to convince oneself on the truthfulness or validity of information received, rather than being swayed by the opinion of others.
However, the premise on which the prevailing conception of independent thought is constructed is faulty.
A Thought is interconnected; no disassociated thinker lives on an island all by themselves.
Can we truly think on our own, independently, in the purest sense of the term? Aren’t our thoughts inevitably contaminated by the ideas, philosophies, and biases we have deliberately and subconsciously imbibed over the course of our lifetime?
Besides, it is hard or impossible to evaluate how “independent” our thoughts truly are, for the simple reason thoughts represent the accumulation of our lived and learned experiences.
Yes, imagination is an important component of thought; yet we do not imagine in a vacuum — we merely adapt and rearrange familiar realities to compose new patterns and entities.
Or to put it more charitably, don’t we all stand on the shoulders of giants — the teachers under whom we studied at their feet; the parents, families, and communities with whom we imbibed their cultural ethos?
Granted, some of the more enlightened among us might experience the occasional “quantum leap” in thought processes, thereby giving birth to innovative approaches to solving problems.
Likewise, when you scratch any of these “independent” thought sequences with the tip of a pencil, underneath you’ll find it is nothing more than existing knowledge repurposed by identifying and combining different patterns and connecting the dots.
Wow, Esphome on the front page. This project is what makes me feel like ironman.
The most used esphome is the one I have installed with a relay to my garage opener. I'm able to automatically conjure siri using 'hey siri' on my airpods and tell her to open my garage, while being on my motorcycle. The response time of my garage opening from having finished my sentence to siri is less than half a second! I drive right in, and I have a timer set on home assistant to hit the relay again after a minute so the garage closes automatically. Also have 5 esphomes with motion/temperature sensors.
All my automations are programmed using node-red. Everything is run using docker-compose.
Keep in mind, my home assistant or esphome is NOT open to the internet, and only controllable by apple devices from outside the network.
I think people that were told that they were special and that they'd amount to something great as children are the ones that suffer most from this mentality.
The expectation of performance was artificially inflated which leads to difficulty dealing with failure and constant feelings of dissatisfaction.
This goes along with Nassim Taleb's idea of Skin in the Game:
To learn you need ‘contact with the ground’:
Actually, you cannot separate anything from contact with the ground. And the contact with the real world is done via skin in the game-having an exposure to the real world, and paying a price for its consequences, good or bad.
Exactly! I expect to see nothing but negativity here regarding this.
Making intelligence out of silicon isn't easy. Let the computers learn this way during the transition period, and finally we can remove human drivers from the road.
More than 38,000 people die every year in crashes on U.S. roadways. And Tesla makes the safest cars:
The Insurance Institute for Highway Safety (IIHS), the main independent organization that conducts crash tests on vehicles in the US, released the result of its latest tests on the Tesla Model Y and confirmed that it achieved the highest possible safety rating.
I have a 12 liter jug and a 6 liter jug. How do I get exactly 6 liters of water?
Answer (Deepseek): Fill the 6-liter jug completely to obtain exactly 6 liters of water.
Every other LLM I've tried include o3-mini-high: Fill the 12-liter jug completely. Pour it into the 6 liter jug.
Although o3 did get it right in the reasoning: It seems like the user has a 12-liter jug and a 6-liter jug. The simplest answer is to just fill the 6-liter jug directly with water—done! But maybe there's a catch, like needing to use both jugs somehow.
So it knows that the 12 liter jug is mentioned uselessly, but most LLMs HAVE to use the 12 liter jug since it's mentioned in the prompt.
Another Prompt I recently found via perplexity (that deepseek got correct on the first try, but other LLMs can only get it right if I add: "Think step by step before answering."
A 67-year-old woman with congenital bicuspid aortic valve is admitted to the hospital because of a 2-day history of fever and chills. Her current medication is lisinopril. Physical examination reveals a temperature of 38.5°C (101.3°F), blood pressure of 110/70 mmHg, and a heart rate of 100/min. Cardiac auscultation demonstrates a grade 3/6 systolic ejection murmur at the right upper sternal border. Blood cultures are obtained, and empiric antibiotic therapy is initiated. Which of the following is the most likely causative organism? A) Staphylococcus aureus B) Streptococcus viridans C) Escherichia coli D) Pseudomonas aeruginosa E) Candida albicans