KeyError: 'normal' when adaptation using 5s data

[whitenoise-tzx]

Hi, I was trying to do adaptation using 5s training data, but the bug was like:

Training progress:  50%|##########################################                                          | 5000/10000 [02:07<02:14, 37.20it/s, Loss=0.00766, Mouth=10.6-25.0]Traceback (most recent call last):
  File "InsTaG-main/train_face.py", line 450, in <module>
    training(lp.extract(args), op.extract(args), pp.extract(args), args.test_iterations, args.save_iterations, args.checkpoint_iterations, args.start_checkpoint, args.debug_from, args.long, args.pretrain_path)
  File "InsTaG-main/train_face.py", line 199, in training
    loss += 0.01 * (1 - viewpoint_cam.talking_dict["normal"].cuda() * render_pkg["normal"]).sum(0)[head_mask^mouth_mask].mean()
KeyError: 'normal'

I performed 'data_utils/split.py' and set train_val_split = 25 * 5. In the adaptation script, I set n_views=-1

For all the test case that I tried, I noticed that this error only happens when training progress is 50%.

If I increase the n_views to 250, the error won't happen.

[Fictionarry]

Hi, n_views=-1 will skip the loading of normal priors, as shown below.

InsTaG/scene/dataset_readers.py

Lines 284 to 293 in a919a3b

	if "train" in transformsfile and N_views > 0:
	normal_path_candidates = glob.glob(os.path.join(path, 'sapiens/normal/sapiens_*'))
	normal_path_candidates.sort(reverse = True)
	normal_path = os.path.join(normal_path_candidates[0], str(frame['img_id']) + '.npy')
	talking_dict['normal_path'] = normal_path
	depth_path_candidates = glob.glob(os.path.join(path, 'sapiens/depth/sapiens_*'))
	depth_path_candidates.sort(reverse = True)
	depth_path = os.path.join(depth_path_candidates[0], str(frame['img_id']) + '.npy')
	talking_dict['depth_path'] = depth_path

So if you want to skip the geometry prior regularization, you may also specify --long during adaptation when using a long training video (seems not suitable for your situation), or modify the logic of the code. Otherwise, an N_views larger than 0 is required to be given.