IBMs promises dont always line up with reality.
In an IBM commercial from 2016, an adorable, gap-toothed girl named Annabelle sits down on a couch to chat with Watson, the companys supercomputer. Reminding her that her birthday is coming up, it asks whether shell be having a cake. She cheerily responds that she will, even though she was too sick the year before. The data your doctor shared shows youre healthy, it tells her in its clipped voice, adding that it helps physicians identify cancer treatments. Watson, I like you, Annabelle chirps as the segment concludes.
Chatty and personable, the Watson of this commercialas in many of IBMs more celebrity-focused spotsseems designed to assuage public fears about malevolent artificial intelligence: This is a HAL 9000 who would happily open the pod bay doors for you, so long as you asked nicely. Even the computers namea reference to former IBM chairman Thomas J. Watsonalso evokes that of Sherlock Holmes bumbling colleague, arguably suggesting that A.I. is there to help advance our stories, not to replace the human mind.*
Thats a worthy ideal, and one that squares with the hopes of artificial intelligence researchers who believe advanced algorithms will facilitate human labor instead of supplanting it. It is, notably, the goal of IBMs Watson for Oncology, the ambitious project referenced in that commercial, which promises to let doctors Spend less time searching literature and [electronic medical records], and more time caring for patients. Despite the occasional, enthusiastic article proposing that the supercomputer will become the best doctor in the world, its goal has always been to ease the work of clinicians, not to supplant them.
The trouble is, Watson may not even be good at that relatively modest task.
In a lengthy and heavily reported article from Stat, Casey Ross and Ike Swetlitz write that the widely touted oncology system doesnt appear to be as useful as IBMs marketing suggests. As they put it, their reporting suggest[s] that IBM, in its rush to bolster flagging revenue, unleashed a product without fully assessing the challenges of deploying it in hospitals globally.
As Jennings Brown has written in Gizmodo, Watson has long been more a triumph of marketing than anything else, but Stat offers a deep dive into the supercomputers practical limitations. Among other things, Watson for Oncology fails to live up to the most sweeping promise of AI-assisted medical care: that it would help generate novel treatment regimens from individual patient data. To the contrary, Ross and Swetlitz explain, Watsons recommendations rely exclusively on training by human overseers, who laboriously feed Watson information about how patients with specific characteristics should be treated.
That training comes entirely from the work of physicians at Memorial Sloan Kettering Hospital in New York. After receiving a given patients medical records, Watson reportedly crawls through the database those doctors have created and provides a list of recommended treatment plans. It organizes these suggestions according to their probable efficacy, though the design of the system is such that it cannot explain why it weighs one over another.
Its here that the true problems begin to reveal themselves. According to one of Ross and Swetlitzs sources, for example, Watson sometimes suggests a chemotherapy drug for patients whose cancer has spread to the lymph nodes, even when it has been given information about a patient whose cancer has not spread to the lymph nodes.
In other cases, its recommendations show a clear geographic bias: Because its proposals derive from a single hospital, they fail to take the treatment protocols of other countries into account. Where Memorial Sloan Ketterings patients are, Ross and Swetlitz write, generally affluent, other hospitals may not have access to the same resources. Accordingly, Watson threatens to devolve into another example of algorithmic bias, normatively imposing judgments that apply to a specific population, whether or not they are optimal in other parts of the world.
Such considerations come to a head, Ross and Swetlitz suggest, in IBMs failure to empirically demonstrate that Watson improves medical care in any meaningful way. While some reporting does indicate that the computer can save clinical research time in certain contexts, no studies on Watson for Oncology have yet appeared in peer-reviewed publications. Where research has been conducted, its not always positive: Unpublished work from Denmark, for example, indicates only 33 percent agreement between the computers proposals and those of medical professionals. And even where the alignment is higher, Ross and Swetlitz write, [S]howing that Watson agrees with the doctors proves only that it is competent in applying existing methods of care, not that it can improve them.
As CNBC reports, a recent Gallup survey[found] that about one in eight workers, or 13 percent of Americans believe its likely they will lose their jobs due to new technology, automation, robots or AI in the next five years. Given that A.I. is likely to leave millions unemployed in the years ahead, its tempting to suggest that 87 percent of Americans arent worried enough. As Stats investigation shows, however, oncologists are probably safeat least for now.
*Correction, Sept. 6, 2017:This post originally misidentified the origin of the name of the IBM supercomputer Watson.
- Merck snaps up a German immuno-oncology upstart in a $603M bolt ... - Endpoints News - September 7th, 2017
- Startup that makes personalized cancer treatments gets $93 million in funding - SFGate - September 7th, 2017
- Moonlight Mixer to benefit oncology services - AdVantage News - September 7th, 2017
- Ramping back up on oncology, GSK takes an option on Adaptimmune's TCR cancer drug - Endpoints News - September 7th, 2017
- Advanced oncology treatment now available in Sterling - Journal Advocate - September 7th, 2017
- Ransomware Attack May Impact 19K Oncology Hematology Patients - HealthITSecurity.com - September 7th, 2017
- Zymeworks to Present at the European Society for Medical Oncology 2017 Congress and Hold Webcast to Review ... - Business Wire (press release) - September 6th, 2017
- OSE Immunotherapeutics Partners with Oncology Physician Network GERCOR to Conduct a Combination Phase 2 ... - Business Wire (press release) - September 6th, 2017
- MEI Pharma nabs rights to oncology candidate voruciclib - Seeking Alpha - September 5th, 2017
- EnGeneIC Announces Publication in The Lancet Oncology of First Clinical Study Employing EDV Nanocell Platform ... - Markets Insider - September 5th, 2017
- Performance by comedian David Lee Nelson raises money for oncology center - Do Savannah - September 5th, 2017
- Pembrolizumab Has Promising Activity in Extensive-Stage SCLC - Cancer Network - September 5th, 2017
- Endocyte Announces Presentation at the European Society for Medical Oncology (ESMO) - GlobeNewswire (press release) - September 5th, 2017
- 19000 Medical Oncology Hematology Consultants, PA records exposed in ransomware attack - SC Magazine - September 4th, 2017
- Belgian Biotech Grows its Immuno-Oncology Pipeline for Childhood Cancer - Labiotech.eu (blog) - September 4th, 2017
- Innovations in oncology explode as new treatments gain approval - Business Day (registration) - September 4th, 2017
- Cancer center takes in Houston patients statewide following Hurricane Harvey - KVUE - September 4th, 2017
- Oncology the current landscape and what it means for the future - pharmaphorum - September 4th, 2017
- To Fight Cancer, India Must Fast-Track Approvals For Oncology Drugs And Devices - Huffington Post India - September 4th, 2017
- Therapeutic Area: Oncology | Chiltern - September 3rd, 2017
- Best Oncology Conferences 2018 | Oncology Meetings USA ... - September 3rd, 2017
- Texas Oncology to cancer patients who have been displaced by ... - Star Local Media - September 3rd, 2017
- Oncurious to Buy VIB's Immun-Oncology Portfolio - BioPharm International - September 2nd, 2017
- Delaware oncology group hit by nearly month-long ransomware attack - Healthcare IT News - September 2nd, 2017
- For residents, by residents: Mentorship program focuses on radiation oncology - Radiology Business - September 2nd, 2017
- Gilead Sciences' Oncology M&A Strategy Explained - Motley Fool - September 2nd, 2017
- Performance of AstraZeneca's Oncology Segment in 2Q17 - Market Realist - September 2nd, 2017
- Shattuck-Takeda Partnership Will Involve Double-barreled Cancer-fighting Therapies - Immuno-Oncology News - September 2nd, 2017
- Guenther Koehne named chief of bone marrow transplantation and hematologic oncology at Miami Cancer Institute - The Cancer Letter Publications - September 2nd, 2017
- Pharmalittle: A generic rival for opioid treatment & an oncology setback for J&J - STAT - September 2nd, 2017
- BeiGene Announces Presentations at the European Society for Medical Oncology 2017 Congress - GlobeNewswire (press release) - August 31st, 2017
- Loxo Oncology to Present at Upcoming Investor Conferences - GlobeNewswire (press release) - August 31st, 2017
- 6 years after child's death, father buys lunch for oncology unit nurses - WKRN.com - August 31st, 2017
- Pediatric oncology nurses embrace a unique role - Atlanta Journal Constitution - August 31st, 2017
- AVEO Oncology: EU Approval Pop Is Just The Beginning - Seeking Alpha - August 31st, 2017
- BizVibe Announces Its List of the Best Oncology Pharmaceutical Companies for 2017 - Business Wire (press release) - August 31st, 2017
- ZIOPHARM Oncology Inc (ZIOP) Shares Needle Moving -2.94% - Morgan Research - August 31st, 2017
- Star team quietly raises $21M to launch the latest immuno-oncology ... - Endpoints News - August 31st, 2017
- Texas Oncology Available To Patients Impacted By Harvey - PR Newswire (press release) - August 30th, 2017
- Dell Medical School creates Department of Oncology - UT The Daily Texan - August 30th, 2017
- Six years after child's death, father buys lunch for oncology unit ... - NBC4i.com - August 30th, 2017
- Jazz, ImmunoGen partner on hematology, oncology drug development - BioPharma Dive - August 30th, 2017
- Five Prime cuts loose from InhibRx immuno-oncology deal - FierceBiotech - August 29th, 2017
- Bivarus and Community Oncology Alliance Collaborate to Improve ... - Business Wire (press release) - August 29th, 2017
- Kura Oncology to Participate in Citi's 12th Annual Biotech Conference - GlobeNewswire (press release) - August 29th, 2017
- Exceptional Registered Nurse and Radio Oncology Nurse, Jose Vicente Delgado, RN, BSN, will be Highlighted in the ... - PR NewsChannel (press release) - August 29th, 2017
- Unusual Activity Spotted in ZIOPHARM Oncology Inc (ZIOP) and Telecom Argentina SA (TEO) - Morgan Research - August 29th, 2017
- Oncology training for community nurses begin in Kumasi - Ghana News Agency - August 29th, 2017
- AVEO Oncology (AVEO) Granted European Union Approval for FOTIVDA (tivozanib) - StreetInsider.com - August 28th, 2017
- Ridley-Tree Cancer Center of Santa Barbara achieves four-year accreditation for radiation oncology services from ... - Markets Insider - August 28th, 2017
- Immuno-Oncology 360 Summit Confirms Program Line-up for February 7-9, 2018 - Benzinga - August 28th, 2017
- Options Traders Expect Huge Moves in ZIOPHARM Oncology (ZIOP) Stock August 28, 2017 - Zacks.com - August 28th, 2017
- Park Ridge news briefs: Oncologist, molecular biologist named to Maine South's alumni Wall of Honor - Chicago Tribune - August 28th, 2017
- 'Bras for a Cause' to benefit oncology patients - Sandusky Register - August 27th, 2017
- Oncology | Internal Medicine | ACP - August 26th, 2017
- Maury Regional adds five physicians - Columbia Daily Herald - August 26th, 2017
- Friday, August 25, 2017 - LWW Journals (blog) - August 26th, 2017
- Who Is Cancer Genetics? - Modest Money (press release) (blog) - August 25th, 2017
- Oncology probe was blocked - Independent Online - August 25th, 2017
- Samaritan awarded radiation oncology qualification for new cancer treatment option - WatertownDailyTimes.com - August 25th, 2017
- Champions Oncology Announces Strategic Collaboration with AstraZeneca to Develop Unique Cohorts of Patient ... - PR Newswire (press release) - August 25th, 2017
- Highlighting the hematology/oncology unit at Gundersen - News8000.com - WKBT - August 25th, 2017
- FDA Actions & Updates - LWW Journals (blog) - August 24th, 2017
- Equicare Health and Lexington Medical Center collaborate on oncology integration project - Markets Insider - August 24th, 2017
- A Look into Merck's Immunology and Oncology Portfolio - Market Realist - August 24th, 2017
- Hematologist Oncologist Now Serving Mid-Shore Cancer Patients - My Eastern Shore - August 24th, 2017
- Grid Therapeutics Signs Exclusive License Agreement to Develop a Novel Immuno-Oncology Antibody - Business Wire (press release) - August 22nd, 2017
- LabCorp Partners OmniSeq to Grow in Immuno-Oncology Space ... - Nasdaq - August 22nd, 2017
- BTG and SIO Expand Immuno-Oncology / Interventional Oncology Grant Programme - Markets Insider - August 21st, 2017
- Champions Oncology Announces Strategic Collaboration with AstraZeneca to Develop Unique Cohorts of Patient ... - Markets Insider - August 21st, 2017
- ZIOPHARM Oncology Inc (ZIOP) Share Performance Recap - FLBC News - August 19th, 2017
- Champions Oncology Announces Research Collaboration with The Addario Lung Cancer Medical Institute to Develop ... - Markets Insider - August 19th, 2017
- Teton Valley Hospital to provide oncology services - KIFI - LocalNews8.com - August 19th, 2017
- Is ZIOPHARM Oncology Inc (ZIOP) Building Momentum? - FLBC News - August 19th, 2017
- Can Stress Cause Cancer? | Massage Professionals Update - August 18th, 2017
- Champions Oncology (CSBR) Announces Research Pact with The Addario Lung Cancer Medical Institute - StreetInsider.com - August 18th, 2017
- Buy or Sell? Average Brokerage Ratings on Vantiv, Inc. (VNTV), Clovis Oncology, Inc. (CLVS) - StockNewsJournal - August 18th, 2017
- Bristol-Myers shares sink after another setback for its immuno-oncology franchise drugs - Endpoints News - August 18th, 2017
- Cell Line Development Services Markets, 2025 - Growing Incidence Rates of Oncology and Immunological Disorders ... - GlobeNewswire (press release) - August 18th, 2017
- Advanced oncology treatment now available in Sterling - Fort Morgan Times - August 17th, 2017