Why does AI give completely different answers to the same question

By Mike_UK · · 6 replies

Has anyone else noticed this or is it just me? I asked the same question to ChatGPT three times in one sitting and got three noticeably different answers. Not completely different but enough to make me question which one is actually correct. I get that these models are probabilistic and all that but from a practical standpoint it makes it hard to fully trust the output especially for anything important. I have started copy pasting my prompts into two different AI tools just to cross check and honestly that has helped a lot. But it feels like extra work that should not be necessary. Does anyone have a system for dealing with this or do you just accept it as part of using AI?

Editing your thread.
Reply
Add images Up to 2 images, 3MB each.
0/2
You must be signed in to reply.
Replies

PixieAcia_21

Yeah I’ve noticed this too. I think part of the problem is people expect AI to work like a search engine when it’s actually generating responses on the fly each time.

Jennifer_CA

Totally normal and you are definitely not alone in noticing it.The way I think about it now is that I stop expecting one perfect answer and instead treat the different responses as different perspectives on the same problem. Sometimes the variation actually surfaces something useful that a single answer would have missed.Still annoying when you just want a straight answer though 😂

Aliabhat

Cross checking across two tools is honestly the move and I do the same thing. ChatGPT and Perplexity together covers most things pretty well.The other thing that helped me was being way more specific in the prompt itself. The vaguer the question the more the output varies. Once I started treating it like I was briefing a junior employee rather than just asking a question the consistency improved a lot 😄

Related discussions

Popular in this category