Alex Ivanovs / Stack Diary:
research: ChatGPT can emit sequences memorized from its training data via a new “divergence attack” that prompts ChatGPT to repeat a word numerous times — Large language models, appreciate ChatGPT, are trained on vast amounts of text data from books, websites, and other sources.
Source link