I have a question about how to solve 'catastrophic forgetting" problem.

[qingyun1988]

I have read the comments #7666 (comment) and the article https://explosion.ai/blog/pseudo-rehearsal-catastrophic-forgetting

It seems to have two ways to resolve the 'catastrophic forgetting' problem.
One is 'Pseudo rehearsal' in which its key is to contains two data examples: revision_data and fine_turn_data. But I still have a few questions about it. Should the content and number of sentences in 'revision_data' be the same as those in 'fine_turn_data'? For example, let's say, there are two sentences 'I love you' and 'You hurt me' in 'revision_data' and the content of 'fine_turn_data' must be the same?

Another is nlp.rehearse() method in Spacy v3.0. But the code example here only contains nlp.rehearse() but nonlp.update():

Doesn't the nlp.rehearse() method need to update the changes? Do I need to add a line of code like this at the end：

optimizer = nlp.resume_training()
nlp.rehearse(examples, sgd=optimizer)

#add newline
nlp.update(examples, sgd=optimizer)

I'm a bit confused with these.