|
|
| | Ask HN: Could an LLM predict someone's speech 5 seconds ahead in realtime? | | 1 point by comova on Dec 17, 2024 | hide | past | favorite | 3 comments | | LLMs are in many ways text predictors. Could you have an LLM that runs in realtime, watching a speech on TV for example, and predicts what the person is going to say 5 seconds in advance based on what they are currently saying? My friend was thinking about this as a test for State of the Union but then we realized that the transcript is published ahead of time so it would not be that impressive. But maybe something like the inauguration speech? Especially if tuned on previous speeches from that person. |
|

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
|
Actually, in every way. But LLMs don't "predict" in the sense of predicting the future. They predict from probabilities based on training data. They auto-complete based on samples of words used in similar contexts before.
Since politicians tend to deliver stock messages, using a specific kind of language, and repeat themselves, an LLM may very well successfully auto-complete something as canned and, well, predictable as a state of the union address or inauguration speech. The vocabulary and space of novel thoughts will stay small in such contexts (more or less depending on the speaker). A bot to imitate almost any president since Lincoln would only need slightly more sophistication than a word processor.
LLMs would have less success "predicting" what I might say in a conversation unless I have written something similar before and that got into the training data.
Using an LLM to predict or simulate what someone might say introduces the temptation to confuse the prediction with what someone would actually say. Imagine talking to someone who interrupts to finish your sentences. They may get it right, more or less, probably not verbatim.