Training with my own audios, does it works?

[bgondell]

I cloned the collab and uploaded a pair of audios with my voice, but when tried to generate a "hello world", did not work.

Not sure if it's a very specific demo, or can be trained for more examples.

Thanks!!

Command:
!python -m vall_e 'hello world' data/bruno/file_391.wav toy.wav

Output:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/local/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/content/vall-e/vall_e/__main__.py", line 43, in <module>
    main()
  File "/content/vall-e/vall_e/__main__.py", line 29, in main
    phns = torch.tensor([symmap[p] for p in g2p.encode(args.text)])
  File "/content/vall-e/vall_e/__main__.py", line 29, in <listcomp>
    phns = torch.tensor([symmap[p] for p in g2p.encode(args.text)])
KeyError: 'HH'

[ilanshib]

It might be that the training audio does not contain all phonemes so you need to extend the sample.