• 목록
• 답변
• 글쓰기
• 게시판 리스트 옵션
  • 수정
  • 삭제

ChatGPT isn’t the first of its form, and it likely won’t be the final. The masking ensures that when generating the i-th phrase, the decoder only attends to the first i words of the sequence, preserving the autoregressive property important for producing coherent text. ChatGPT generates its answers one phrase at a time, Ouyang mentioned, and scans the phrases it’s already produced to determine on the next one.