We compare ROME against several open sourced state-of-the-art model editors. All are implemented in their respective folders. Implementations other than FT/FT+L are adapted from third parties.
- Fine-Tuning (
ft
): Direct fine-tuning. - Constrained Fine-Tuning (
ft
): FT with$L_\infty$ norm constraint. Inspired by Zhu et al. [Paper] - Knowledge Neurons (
kn
): Dai et al. [Code] [Paper] - Knowledge Editor (
efk
): De Cao et al. [Code] [Paper] - Model Editor Networks with Gradient Decomposition (
mend
): Mitchell et al. [Code] [Paper]