Why?
Why does my doctor look at me "that way" when I bring
in a stack of paper printed out from google search?
Well it's actually pretty simple if you think about it.
1. It sounds like you're doubting him and maybe you just want to check out what he's saying, questioning his knowledge base. Having been in the medical field for 20 plus years I have noticed that Physicians are questioned about their knowledge base 16 ways from Sunday by everybody from the janitor to the CEO and on a consistent and persistent basis truly it is amazing and I would find it insulting as well
2. I think most importantly the reason they make that face is because so much of what people take as “the internet said” is no one checks on where the information came from and what makes them any smarter than him?
I had a teammate working with me for a few years, she was a very smart girl, but she came to me with a process for something that we were working on and and there was an error in the page that she handed me that I recognized..
I had to stop for a minute and think about where I had specifically seen that error, and then I ran over to my terminal did my own searching and I turned to her and I said . “Did you get this off of “xyz.com “ ? She said ,”oh yeah that's where I search for everything..” Okay I understand that Ann had come from a financing background, she knew how financing worked on paper she knew how to make it look good on spreadsheets she knew how to present it so that it didn't look like it was as bad as it really is but the technical aspect of what we did and her internal knowledge meant she was going to have to learn a lot of background in order to be able to do our job well. So to speed things along s far every time she found something that she didn't understand she would run over to” xyz.com “and type it in and let it teach her. Honestly it's the way a lot of people learn today and it's a shame because I turned to her and I said , “Where do you think that information comes from?” She thought for a minute and then another minute and then another few minutes and from the expression on her face I could tell she clearly had never questioned the origin of this information before. “Well Jay, I I've never thought about it I don't know where it comes from..”
So not wanting her to think I as mad at her said, “ okay that's what I thought I'm not mad at you I just wondering tell you where it comes from.” I said,”Well this particular piece of information you have here has got an error in it and I know it because I wrote it.” She got bright red and so I continued, “That website is generated by people just like you and me who may not be experts on the subject that you're asking about but whatever they are going to give you is the answer that most of their customers have liked.” The answer is most certainly not the spelled the most properly not this formatted the best just the one that people seem to like the most.. Now if I were really ambitious I would Circle this and put it on my desk in the pile of things to do “one day.” Ann thought that would be a great idea. I said,” yeah it would be, but one day never seems to come..”
I know one of the things that's become very popular in contemporary conversation is AI, Artificial Intelligence, everybody's talking about it, everybody's doing it and it is indeed integrating itself into our Healthcare. Two of the largest software packages being sold to hospitals for Physicians clinicians and caregivers to markdown your statistics and your information everything from your blood pressure to your home address to who's going to pay the bill if you don't and there's an AI engine behind it that is working hard trying to make sure it fills in all the blanks as well as it can now. I will admit I was rather concerned when I realized what this could mean to US! So I did run a very basic OI search and was very pleased to find it got it right.. I was was happy with that, so I'm hoping that it will hep some parents who show up in the ER not knowing before hand anything about OI.
I like to learn, so I will admit I have been playing with “AI brains” in my own lab trying to find some that will work and do some of the smaller things that I don't ever seem to find the time to. Remember that “someday” that never seems to arrive? I'm hoping AI will help so today I was testing out a new process with a brand new brain, one that I hadn't had time to work with much. Something to realize is that “open source AI” like Open-AI and the like are important because that means that anyone, you or I, can grab a copy and play with it to our hearts content and not have to pay millions of dollars to create one from scratch.
The AI brain I was working with today, actually an LLM but abbreviations get confusing as you'll see, is one of the most talked about, and tested in use today. One of the reasons is that its pretty small, in comparison and supposedly very fast and very very accurate.
I've just had an hour long conversation this new brain and I have to say I'm not really impressed, I'm going to attach the conversation with the brain in a file so if you'd like to download it and read it you might find it entertaining you might find it funny.. You might just find it a learning experience like I did but because when I posed it the question “What is osteogenesis imperfecta” I've asked systems as simple as Siri and Alexa that question and all the big brains that you know about and I get varying degrees of response but they all not only target the COL1A1, COL1A2 etc and their relationship to collagen production and why we have such an issue with it .
In today's conversation the AI immediately abbreviated Osteogenesis Imperfecta to OP , not OI. I thought this was strange, but it was a minor error so I let it continue and it not only went off the road it went off the bridge and finally off the entire map. I think the AI went off on a tangent but it did find the genetic issue using OP. Unfortunately it was a genetic issue that signify the propensity for breast cancer, so when I asked about a 60-year-old white male with Osteogenesis it just doubled down.
I tried to draw attention without giving it the answer by questioning the OP idea, and all it did was repeat back the information it gave me the first time so then I started to drill down hard on it and really dug ITS heels in deep.
One thing I kept in the transcript was the times it was “thinking”, each thought was 30-90 seconds long and you'll see it went off and thought for a while until there was next to no relationship, but it was sticking to the information that it had given me. So I tried a different tact. I went after the abbreviation, but it still wouldn't change its mind. I finally gave up and said you know what you're probably right show me the resources that you used to find the connection between Osteogenesis Imperfecta and OP and BRAC1, BRAC2 genes..
NOTE I did spell it out every time land didn't use OI.
That way when somebody questions me I can say, but look right here it's in this article this study. But after a that it came back and said well there haven't been any articles or studies demonstrating that OP shows up in humans. This was where this whole conversation started so two or three times I asked for the sources two or three times it just kept hammering down on nope nope it's OP.
I finally got tired of it, it been an hour like I said and and once again the AI doubled down on the answer it gave me just make sure. I'm going to repeat exactly what I said earlier and hear it all this so remember when you're dealing with Google or Alexa or Claude or Grok or any of them not only do they hallucinate whatever that looks like, but they also not only can be wrong and can stand by that wrong answer till the death..

