Decoder-only model
A transformer that uses only the decoder, also called an autoregressive model. Built to generate text by predicting the next token in a sequence. The GPT models are the famous example.
A cardiology department uses a generative model to pull the ejection fraction out of echo reports and into a registry. A model of this kind writes its answer word by word as text, so when a report gives no value or states it ambiguously, it can still produce a plausible number that appears nowhere in the report. Ask whether every extracted value is automatically checked against the source text, and audit a sample against the original reports, including reports where the value is missing.
Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.
Sign in →