Level 2 · Chat, but better

Can You Trust What AI Tells You?

Mostly yes, sometimes no, and here's how to tell the difference without becoming paranoid.

Here's the thing nobody explains up front: AI sometimes makes things up, and it does it with complete confidence.

It's not lying to you on purpose. AI works by predicting what words should come next, and when it doesn't know something, it doesn't say "I don't know" as often as it should. It fills the gap with something that sounds right. Tech people call this "hallucinating." I call it the confident-friend problem: it's like that friend who answers every question instantly, whether or not they actually know.

Once you know this, AI gets safer to use, not scarier. You just need to know when to double-check.

When to double-check

Some answers are low-stakes. If AI helps you brainstorm caption ideas and one is a dud, who cares. But slow down when the answer involves:

Specific facts. Names, dates, statistics, prices, phone numbers, addresses. This is where made-up answers hide best.
Anything legal, tax, or medical. Use AI to understand your options and prepare good questions, then confirm with a professional.
Quotes and sources. AI can invent a very real-sounding study or article. If it cites something, ask for the link and click it yourself.
Math with money. It's gotten much better, but check any number you're going to act on.

My rule of thumb: the more you'd be embarrassed or hurt if the answer were wrong, the more you check it. Brainstorming, drafts, and summaries of things you pasted in? Low risk. Facts you're repeating publicly or decisions with dollars attached? Verify.

Three habits that catch most mistakes

1. Ask it to show its confidence
"How sure are you about that? Tell me which parts are solid and which parts I should verify somewhere else."
2. Ask for the source
"Where does that come from? Give me a link I can check."
3. Push back once
"Are you certain? Double-check that answer before I rely on it."

That last one sounds silly, but it works. When you push back, AI re-examines instead of just predicting forward, and it will often correct itself. If the answer changes when you push, that's your sign to verify elsewhere.

The other half of trust: what you put in

Trust runs both ways. A good habit from day one: treat a chat like a conversation in a busy coffee shop. Fine for most things, not the place for secrets.

Never paste passwords, full credit card numbers, or your Social Security number. No chat ever needs these.
Be thoughtful with client details. If you'd need permission to share it with a colleague, swap in "my client" instead of their name. The advice comes out just as good.
Check one setting. Most AI tools have an option to not use your chats for training. In ChatGPT, Claude, and Gemini it's in the data or privacy settings and takes one minute to find. Worth doing.

The bottom line

You don't need to fact-check every sentence, and you definitely don't need to avoid AI. You need the same skill you already use with people: knowing which friend is great for ideas and which one you'd call for legal advice. AI is the ideas friend with an unusually big vocabulary. Enjoy it, use it every day, and verify the things that matter.

Start with prompts that keep you in the safe lane

The free Non-Techie Starter Kit sticks to the tasks where AI shines and mistakes are cheap.

Get the Starter Kit →

When you're ready for more

Questions like this are exactly what we cover live in the workshop, with plenty of room to ask yours. See the next workshop →