✨Overview

EasyEdit is a Python package built upon PyTorch for edit Large Language Models (LLM) like GPT-J, Llama, GPT-NEO, GPT2, T5(support models from 1B to 65B), altering the behavior of LLMs efficiently without negatively impacting performance across other inputs.

If you find EasyEdit useful, please kindly cite this paper.

@misc{yao2023editing,
      title={Editing Large Language Models: Problems, Methods, and Opportunities}, 
      author={Yunzhi Yao and Peng Wang and Bozhong Tian and Siyuan Cheng and Zhoubo Li and Shumin Deng and Huajun Chen and Ningyu Zhang},
      year={2023},
      eprint={2305.13172},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

Model Editing

Deployed models may still make unpredictable errors. For example, Large Language Models (LLMs) notoriously hallucinate, perpetuate bias, and factually decay, so we should be able to adjust specific behaviors of pre-trained models.

Model editing aims to adjust an initial base model's ( $f_{\theta}$ ) behavior on the particular edit descriptor $[x_e, y_e]$ efficiently, such as(The president of USA: Donald Trump -> Joe Biden):

$x_e$ : Who is the president of the US
$y_e$ : Joe Biden

without influencing the model behavior on unrelated samples. The ultimate goal is to create an edited model ( $f_{\theta}'$ ).

Colab Tutorial

You can go colab directly

colab link

NextInstallation

Last updated 1 year ago

@misc{yao2023editing, title={Editing Large Language Models: Problems, Methods, and Opportunities}, author={Yunzhi Yao and Peng Wang and Bozhong Tian and Siyuan Cheng and Zhoubo Li and Shumin Deng and Huajun Chen and Ningyu Zhang}, year={2023}, eprint={2305.13172}, archivePrefix={arXiv}, primaryClass={cs.CL} }