Not just that, remember it’s just an LLM. It quantifies which tokens (or words and letters, if you will) come up next. It doesn’t matter if it’s factual or fictional - if it’s good enough, it does that.
LLMs are very confident in lying. I once asked it if there is a magic method to catch magic method calls in PHP - it told me its __magic. Lo and behold, there is and never was such a method. That’s my first and last time I tried it, and there ain’t gonna be a second time in the near future.
Not just that, remember it’s just an LLM. It quantifies which tokens (or words and letters, if you will) come up next. It doesn’t matter if it’s factual or fictional - if it’s good enough, it does that.
LLMs are very confident in lying. I once asked it if there is a magic method to catch magic method calls in PHP - it told me its
__magic. Lo and behold, there is and never was such a method. That’s my first and last time I tried it, and there ain’t gonna be a second time in the near future.