Can Learning Machines Unlearn? (wired.com)

https://www.wired.com/story/machines-can-learn-can-they-unlearn/

How much data?

I’ve been thinking about this a lot. In our recent work designing predictive algorithms using linear regressions and neural networks, and similar approaches, we’ve discussed the use of EHR (electronic health record) data, and have had some success using such algorithms to reduce deaths from sepsis (blog post from 10/6/2021).

One of many problems, is “how much data?” And it has been interesting to work with our data science colleagues on creating a model, and then carefully slimming it down so that our models can run on smaller data sets, more efficiently, more quickly, with less computing power.

Forgetting?

A related problem is “when do we need to forget?” EHR data ages, the way clinicians record findings can change. Our understanding of diseases change. The diseases themselves change. (Delta variant, anyone?)

Will our models perform worse if we use data that is too old? Will they perform better because we gave them more history? Do our models have an “expiration date?”

The Wired.com article above talks about having to remove data that was perhaps illegally acquired, or perhaps after a lawsuit, MUST be removed from a database that powers an algorithm.

Humans need to forget. What about algorithms?

Isn’t human memory about selective attention, selective use of memory? Wouldn’t a human’s perfect memory be the enemy of efficient and effective thinking? I’ve read that recalling a memory slightly changes the memory. Why do we work this way? Is that better for us?

Is there a lesson here for what we are building in silico?

CMIO’s take? As we build predictive analytics, working toward a “thinking machine”, consider: what DON’T we know about memory and forgetting? Are we missing something fundamental in how our minds work as we build silicon images of ourselves? What are you doing in this area? Let me know.

Sepsis, Machine Learning and the Centaur (my SMILE conference talk)

Find out: What is a centaur and what does it have to do with healthcare? What are the criteria for a good machine learning project? What is the role of a virtual health center with predictive models? And most importantly: What ukulele song goes with machine learning?

Here are the slides for my talk given at SMILE (Symposium for Machine learning, ImpLementation and Evaluation). The slides are mostly self-explanatory. You can also watch my talk at YouTube. Here is a PDF of the entire deck.

Making clinicians worthy of medical AI, Lessons from Tesla… (statnews)

Novel idea: ensure docs KNOW how to operate AI (!) (image: ETHAN MILLER/GETTY IMAGES, via Statnews)

Here is a different take on AI in healthcare: train and only allow clinicians who understand the limitations of AI, to use AI. Make savvy clinicians better. Don’t give it to all clinicians.

This is a throwback to our experience with Dragon Speech recognition over the past decade: DON’T give Dragon speech to a clinician struggling with computer use; instead, give Dragon to a clinician who is computer-savvy and understands the limitations of Dragon.

But, (in the early years) give the non-computer savvy clinician an “opt out” to dictate their notes by dictaphone or telephone, and gradually bring them along.

Having given several non-computer savvy docs access to Dragon in those early years, our hair stood on end when we ended up reading their notes later: they were clearly NOT proof-reading their work and assuming the Dragon engine was perfect at transcription.

Back to the future.

CMIO’s take? Be careful out there, everyone, both on the road with Tesla, and in healthcare with AI.

Chimerealism

Mashing ideas together

Greg's Webvault

this is where Greg puts stuff he wants to keep

Discover WordPress

A daily selection of the best content published on WordPress, collected for you by humans who love to read.

Daring Fireball

CT Lin's CMIO Blog

ALiEM

CT Lin's CMIO Blog

HIStalk

CT Lin's CMIO Blog

the other fork in the road

navigating life via acute corners, wrong turns and dead ends