A model that reads slides and clinical text together to predict who will respond to immunotherapy.
MUSK is a vision-language pathology model from Stanford that uses masked multimodal pretraining to place image tokens and text tokens in one shared space, so the same network can read a slide and the words written about it. It was pretrained on 50M pathology images and 1B pathology-related text tokens, and the Nature 2025 paper reported that it predicted immunotherapy response and prognosis across cancers better than models built on images or text alone. The intended users are researchers and, in time, tumour boards deciding who will benefit from checkpoint inhibitors. All validation so far is retrospective, so whether these predictions change treatment decisions or outcomes has not been tested prospectively. For a newcomer: it reads slides and notes together to predict who will respond to immunotherapy, and that prediction has not yet been tested in a trial.
MUSK uses masked multimodal pretraining that unifies image and text tokens.
Query for this technology: (TITLE:"MUSK" OR ABSTRACT:"MUSK" OR TITLE:"Stanford, vision-language pathology" OR ABSTRACT:"Stanford, vision-language pathology") AND (cancer OR tumor OR tumour OR oncology OR carcinoma OR lymphoma OR leukemia OR leukaemia OR myeloma OR sarcoma OR melanoma OR glioma). Results are unfiltered search hits about MUSK (Stanford, vision-language pathology), not a curated reading list.
Shares AI in the oncology clinic: from narrow cleared tools to multimodal decision support, Pathology & radiology foundation models, Diagnostics roadmap: stains → gene panels → blood tests that decide treatment, AI in oncology roadmap: pattern readers → foundation models → agents in the workflow and the tags foundation-model, pathology.
Shares AI in the oncology clinic: from narrow cleared tools to multimodal decision support, Pathology & radiology foundation models, Diagnostics roadmap: stains → gene panels → blood tests that decide treatment, AI in oncology roadmap: pattern readers → foundation models → agents in the workflow and the tags foundation-model, pathology.
Shares AI in the oncology clinic: from narrow cleared tools to multimodal decision support, Pathology & radiology foundation models, AI in oncology roadmap: pattern readers → foundation models → agents in the workflow and the tags foundation-model, pathology.
Shares AI in the oncology clinic: from narrow cleared tools to multimodal decision support, Pathology & radiology foundation models and the tags foundation-model, pathology.
Shares Pathology & radiology foundation models, AI in oncology roadmap: pattern readers → foundation models → agents in the workflow and the tags foundation-model, pathology.
Shares Pathology & radiology foundation models, AI in oncology roadmap: pattern readers → foundation models → agents in the workflow and the tags foundation-model, pathology.
Shares Pathology & radiology foundation models, AI in oncology roadmap: pattern readers → foundation models → agents in the workflow and the tags foundation-model, pathology.
Shares Pathology & radiology foundation models and the tags foundation-model, pathology.
Open-source projects that implement or serve this technology, from OnCo's own catalogue: licence and last activity as the repository reported them on the day of the fetch. Listing is not endorsement; check the licence before reuse and the validation before clinical use.
Stanford's vision-language foundation model for precision oncology trained on pathology images and text.