동선생

BackgroundTransformer, introduced by Google in 2017 for natural language processing, is a language model that's leading innovation in the AI field. ChatGPT, which first enabled us to use AI through web and API interfaces, is also based on Transformer, as are the language models that companies like Google and Facebook are developing as competitors.Transformer is expected to achieve state-of-the-a..

What is Zero-shot prompting?In artificial intelligence, a "shot" refers to an example.Therefore, zero-shot means the AI processing a new task without examples, in other words, handling tasks it hasn't specifically learned.Zero-shot prompting refers to how AI like ChatGPT processes responses to prompts without specifically trained data or example answers.Simply put, AI performs the requested task..

What is Few-shot Prompting?In artifical intelligence, a "shot" refers to an exampleTherefore, Few-shot means a few examples.Few-shot prompting is a method that helps AI models better understand and perform new tasks by providing a small number of examples when the model needs to perform a new task.Few-shot prompting is broadly divided into:Instructions: Description of the task the model needs to..

This post heavily relies on the book 'Natural Language Processing with Pytorch':https://books.google.co.kr/books?id=AIgxEAAAQBAJ&printsec=copyright&redir_esc=y#v=onepage&q&f=falseCorpusAll NLP tasks begin with text data called a corpus(corpa in plural).A corpus typically includes raw text (in ASCII or UTF-8 format) and metadata associated with this text. While raw text is a sequence of character..