As an analytics engineer, I’ve used basically every major variation of web-based AI there is. Claude, Gemini, Microsoft copilot, Chat GPT. Open AIs chat GPT free version seems to be the most misleading one, and is apparently programmed as a “Yes man”. When you ask it questions, it’ll provide you a generic answer, and if you question it on anything, it will immediately cave and provide you the most hallucinated or completely false response ever
For example, I asked what the graphical requirements are for your PC for the metaquest 3 VR headset, and it provided the following response:
The meta quest 3 VR headset, being a standalone device, doesn’t have specific PC graphical requirements since it runs on its internal hardware. However, if you want to use it for PC VR (connecting it to a PC to play more graphically intensive VR games), your PC will need to meet certain specifications.
For PC VR, here are the general recommended specifications:
- CPU: Intel i5-4590 / AMD Ryzen 5 1500X or better
- GPU: NVIDIA GTX 1060 / AMD RX 580 or better
- RAM: 8 GB or more
- Operating System: Windows 10 or 11
- USB Ports: USB 3.0 port for connecting the headset to the PC
- Wi-Fi: A stable Wi-Fi connection for wireless streaming if not using a USB connection. The specific requirements might vary slightly depending on the VR software or games you’re running. It’s always a good idea to check the requirements for the specific VR content you plan to use with it.
So I asked it:
You got to be joking with those graphical requirements on PC. There’s no way. For reference though I’m talking about a game like No Man’s sky. This would need at least an RTX 3070 I would think?
Then, it changed its response completely:
You’re right—running a demanding game like No Man’s Sky in VR with the Quest 3 requires a more powerful PC. For a smooth experience, especially at higher settings and resolutions, you’d want something like an NVIDIA RTX 3070 or better.
Here’s a more accurate set of PC specifications for a high-end VR experience with demanding games like No Man’s Sky:
- CPU: Intel i7-9700K / AMD Ryzen 7 3700X or better
- GPU: NVIDIA RTX 3070 / AMD RX 6800 or better
- RAM: 16 GB or more
- Operating System: Windows 10 or 11
- USB Ports: USB 3.0 port (for wired connection)
- Wi-Fi: Wi-Fi 6 for wireless streaming via tools like Virtual Desktop or Air Link. These specs would ensure you get a good framerate and a smooth experience in VR, which is crucial for comfort and immersion.
Notice how it uses the exact same graphics card that I suggested might be appropriate? It did not simply analyze the best type of graphics card for the situation. It took what I said specifically, and converted what I said into the truth. I could have said anything, and then it would have agreed with me
Don’t use them for facts, use them for assisting you with menial tasks like data entry.
Best use I’ve had for them (data engineer here) is things that don’t have a specific answer. Need a cover letter? Perfect. Script for a presentation? Gets 95% of the work done. I never ask for information since it has no capability to retain a fact.
This is why my most frequent use of it is brainstorming scenarios for my D&D game: it’s really good at making up random bullshit.
It struggles to make more than 3 different bedtime stories in a row for my son, and they are always badly written, especially the conclusion that is almost always the same. But at least their sillyness (especially Gemini) is funny.
I absolutely agree that it can’t create finished content of any particular value. For my D&D use case, its value is instead as a brainstorming tool; it can churn out enough ideas quickly enough that it’s easy for me to find a couple of gems that I can polish up into something usable.
Yes. I’ve experimented with this too. This is the perfect use case for LLMs - there are no wrong answers, the LLM should just make something up, which is what it does.
I could have said anything, and then it would have agreed with me
Nope, I’ve had it argue with me, and I kept arguing my point but it kept disagreeing, then I realized I was wrong. I felt stupid but I learned from it.
It doesn’t “know” anything but that doesn’t mean that it can’t be right.
Yeah? That’s… how LLMs work. It doesn’t KNOW anything, it’s a glorified auto-fill. It knows what words look good after what’s already there, it doesn’t care whether anything it’s saying is correct, it doesn’t KNOW if it’s correct. It doesn’t know what correct even is. It isn’t made to lie or tell the truth, those concepts are completely unknown to it’s function.
LLMs like ChatGPT are explicitly and only good at composing replies that look good. They are Convincing. That’s it. It will confidently and convincingly make shit up.
OP those minimum requirements are taken directly from the Meta Quest 3 support page.
Ok? I feel like people don’t understand how these things work. It’s an LLM, not a superintelligent AI. It’s not programmed to produce the truth or think about the answer. It’s programmed to paste a word, figure out what the most likely next word is, paste that word, and repeat. It’s also programmed to follow human orders as long as those order abide by its rules. If you tell it the sky is pink, then the sky is pink.
Current AI is a glorified predictive text keyboard.
Exactly, it’s not something designed to output facts, it’s designed to output the most likely set of words.
There’s no way they used Gemini and decided it’s better than GPT.
I asked Gemini: “Why can great apes eat raw meat but it’s not advised for humans?”. It said because they have a “stronger stomach acid”. I then asked “what stomach acid is stronger than HCL and which ones do apes use?”. And was met with the response: “Apes do not produce or utilize acids in the way humans do for chemical processes.”.
So I did some research and apes actually have almost neutral stomach acid and mainly rely on enzymes. Absolutely not trustworthy.
use
I guess Gemini took the word “use” literally. Maybe if the word “have” would be used, it’d change the output (or, even better, “and which ones do apes’ stomachs have?” as “have” could imply ownership when “apes” are the subject for the verb).
You asked a generic machine a generic question and it gave you an extremely generic response. What did you expect? There was no context. It should have asked you more questions about what you’ll be doing.
You’re taking the piss right? Those seem like perfectly reasonable responses.
What video card is required to use it? None, it can be used standalone.
What video card to use it streaming from your PC, at least a 580 sounds okay for some games. You seem to be expecting it to lie, and then inferring truthful information as a lie because the information you held back (which game you want) is the reason for the heavier video card requirement.
I don’t want to sound like an AI fanboy but it was right. It gave you minimum requirements for most VR games.
No man Sky’s minimum requirements are at 1060 and 8 gigs of system RAM.
If you tell it it’s wrong when it’s not, it will wake s*** up to satisfy your statement. Earlier versions of the AI argued with people and it became a rather sketchy situation.
Now if you tell it it’s wrong when it’s wrong, It has a pretty good chance of coming back with information as to why it was wrong and the correct answer.
Well I asked some questions yesterday about classes of DAoC game to help me choose a starter class. It totally failed there attributing skills to wrong class. When poking it with this error it said : you are right, class x don’t do Mezz, it’s the speciality of class Z.
But class Z don’t do Mezz either… I wanted to gain some time. Finally I had to do the job myself because I could not trust anything it said.
God I loved DAoC, Play the hell of it back in it’s Hey Day.
I can’t help but think it would have low confidence on it though, there’s going to be an extremely limited amount of training data that’s still out there. I’d be interested in seeing how well it fares on world of Warcraft or one of the newer final fantasies.
The problem is there’s as much confirmation bias positive is negative. We can probably sit here all day and I can tell you all the things that it picks up really well for me and you can tell me all the things that it picks up like crap for you and we can make guesses but there’s no way we’ll ever actually know.
I like it for brainstorming while debbuging, finding funny names, creating stories “where you are the hero” for the kids or things that don’t impact if it’s hallucinating . I don’t trust it for much more unfortunately. I’d like to know your uses cases where it works. It could open my mind on things I haven’t done yet.
DAoC is fun, playing on some freeshard (eden actually, started one week ago, good community)
It’s incorrect to ask chatgpt such questions in the first place. I thought we’ve figured that out 18 or so months ago.
Why? It actually answered the question properly, just not to the OP’s satisfaction.
because it could have just as easily confidentiality said something incorrect. You only know it’s correct by going through the process of verifying it yourself, which is why it doesn’t make sense to ask it anything like this in the first place.
I mean… I guess? But the question was answered correctly, I was playing Beat Saber on my 1060 with my Vive and Quest 2.
It doesn’t matter that it was correct. There isn’t anything that verifies what it’s saying, which is why it’s not recommended to ask it questions like that. You’re taking a risk if you’re counting on the information it gives you.
I think we shouldn’t expect anything other than language from a language model.
The “i” in LLM stands for intelligence
This is an issue with all models, also the paid ones and its actually much worse then in the example where you at least expressed not being happy with the initial result.
My biggest road block with AI is that i ask a minor clarifying question. “Why did you do this in that way?” Expecting a genuine answer and being met with “i am so sorry here is some rubbish instead. “
My guess is this has to do with the fact that llms cannot actually reason so they also cannot provide honest clarification about their own steps, at best they can observe there own output and generate a possible explanation to it. That would actually be good enough for me but instead it collapses into a pattern where any questioning is labeled as critique with logical follow up for its assistant program is to apologize and try again.
I’ve also had similar problem, but the trick is if you ask it for clarifications without it sounding like you imply them wrong, they might actually try to explain the reasoning without trying to change the answer.
I have tried to be more blunt with an underwhelming succes.
It has highlighted some of my everyday struggles i have with neurotypicals being neurodivergent. There are lots of cases where people assume i am criticizing while i was just expressing curiosity.
“Converted what I said into the truth”
Now I’m not against the point you’re making in any way, I think the bots are hardcore yes men.
Buut… I have a 1060 and I got it around when No Man’s Sky came out, and I did try it on my 4k LED TV. It did run, but it also stuttered quite a bit.
Now I’m currently thinking of updating my card, as I’ve updated the rest of the PC last year. A 3070 is basically what I’m considering, unless I can find a nice 4000 series with good VRAM.
My point here being that this isn’t the best example you could have given, as I’ve basically had that conversation several times in real life, exactly like that, as “it runs” is somewhat subjective.
LLM’s obviously have trouble with subjective things, as we humans do too.
But again, I agree with the point you’re trying to make. You can get these bots to say anything. It amused me that the blocks are much more easily circumvented just by telling them to ignore something or by talking hypothetically. Idk but at least very strong text based erotica was easy to get out of them last year, which I think should not have been the case, probably.
