I Built a Personal Doctor Gem — Here's What It Actually Does

A Gemini Gems conversation interface showing a health question about medication side effects with a calm, clean design
Part of the "My AI Team" Series — Each post covers one specific Gem I use daily. See the full series overview.

I spend a lot of time thinking about network uptime and server reliability. My own health? Not so much. I'm the kind of person who googles a symptom, ends up reading about three different conditions, and closes the tab more confused than when I started.

A few months ago I built a Personal Doctor Gem in Gemini. It doesn't replace my actual doctor. But it does something useful: it helps me understand what I'm dealing with before I walk into an appointment, and it gives me a place to ask questions I'd feel awkward raising with a real physician.

What Is a Personal Doctor Gem?

It's a customized Gemini assistant configured to behave like a knowledgeable health advisor. You give it context about yourself — your age, any ongoing conditions, medications you take — and it uses that background every time you ask a question.

The result is more useful than a generic search. Instead of a list of possible conditions, you get a focused response that takes your specific situation into account.

Why I Built This Gem

Three situations kept coming up for me:

  • I'd get a blood test result and not understand what a specific marker meant for someone my age
  • I'd be prescribed a medication and want to understand the common side effects before starting it
  • I'd have a vague symptom and want to understand whether it warranted a doctor visit or could wait

In all three cases, I wanted a thoughtful answer, not a wall of search results. The Gem gave me that.

The Prompt I Use

Here's the core of my Gem's instructions:

You are my personal health advisor. You have broad medical knowledge and explain things clearly to a non-medical audience. When I ask health questions: - Give practical, clear answers based on current medical understanding - Flag anything that needs prompt attention from a real doctor - Ask clarifying questions when my symptoms or situation are vague - Always note that your answers are informational, not a diagnosis My background: male, early 50s, generally healthy, no major chronic conditions.

I update the background section whenever something relevant changes — a new prescription, a recent test result I want it to have context on.

Real Examples — What I Actually Ask It

Some recent questions I've put to this Gem:

  • "My LDL came back at 138. Is that a concern for someone my age with no family history of heart disease?"
  • "I just started taking a statin. What side effects should I actually watch for in the first few weeks?"
  • "I've had a tension headache for three days. What usually causes this and when should I see someone?"

For the LDL question, it walked me through borderline vs. high risk ranges, explained what other markers matter alongside LDL, and suggested the specific questions worth raising with my doctor. That kind of response would have taken me 45 minutes to piece together from search results.

What It's Good At (and Where It Falls Short)

Good at:

  • Explaining test results and what they mean in plain language
  • Describing medication side effects and interactions clearly
  • Helping you prepare useful questions for a real doctor visit
  • Identifying when something is likely minor vs. worth urgent attention

Where it falls short:

  • It cannot examine you, run tests, or make a real diagnosis
  • It doesn't know your full medical history unless you tell it
  • For anything serious, it consistently (and correctly) defers to a real physician

That last point is actually a feature, not a flaw. It keeps the tool honest about what it is.

Try It Yourself — Starter Prompt

If you want to build a similar Gem, here's a starting point:

You are my personal health advisor. Explain medical topics clearly for a non-specialist. Flag anything that needs a real doctor's attention. Always clarify that your answers are informational, not a diagnosis. My background: [your age, sex, any relevant conditions or medications]

Paste this into a new Gem at gemini.google.com, fill in your background, and test it with a real question you've been sitting on.

My AI Team Series

Related Posts

Sources & Further Reading

Do you use AI for health questions? What kinds of things do you find it actually helpful for? Let me know in the comments.