Primed audio samples from notebook

From the notebook, how would you change the mode from an ancestral_sample starting point to a primed audio file list? I tried adding these to the Hyperparams() hps instance, but it wasn't effective.

[SMarioMan]

I've created a modified notebook that adds support for primed audio by supplying an audio file in your Google Drive. Feel free to make a copy and try it out for yourself.
https://colab.research.google.com/drive/1OW4hnjsnAL7grjqYlCOLvNu97CRquP8I?usp=sharing
https://colab.research.google.com/github/SMarioMan/jukebox/blob/master/jukebox/Interacting_with_Jukebox.ipynb

I can make a pull request to add this to the main repository as well, if there is interest.

[diffractometer]

@SMarioMan thanks!

[jayjay300]

@SMarioMan Thanks a million for this. Really came in handy. Do you know possibly what modifications would need to be made to train a model on multiple audio samples to see what the output would be based on that? ie if I wanted to train it on a few songs by the same artist? Apologies if this is a rather simple question. I've worked with Stylegan in the past to create images and that was just setting the training to a directory and it would iterate through all images within.

[SMarioMan]

You should be able to provide a comma separated list of audio files instead of just one. I haven't tried that configuration myself, so you might need to put some effort in if it doesn't just work. You can also provide different lyrics, genre, and artist information for each sample by modifying the metas array to contain multiple dicts instead of repeating the same one for all samples.

[kcrosley-leisurelabs]

@SMarioMan might you know how to solve #64 vis-a-vis your Colab notebook (referenced above)? I've been wondering the same question about how to reload a previously interrupted "level 2" or "level 1" session that now needs further upsampling and I've been using your (most excellent) notebook to experiment with jukebox. Many thanks for your contributions here!

[SMarioMan]

@kcrosley-leisurelabs I have been working on integrating checkpoints for upsampling support within the notebook using code from #42. I haven't fully tested it yet, but if I get it working, I'll share it.

[kcrosley-leisurelabs]

@SMarioMan, that would be terrific (and I'd find it very instructive).

[diffractometer]

@SMarioMan that is super dope thanks. I'm using colab and building a new ubuntu box to try to make as similar env as the colab runtime, on paid plan, but I keep getting session drops anyway :(

[kcrosley-leisurelabs]

@diffractometer yeah, I experience similar issues at times (using Colab Pro), hence the ask. Just from an experimentation workflow perspective, it'd be a lot easier to generate Level 2 pieces and then choose only the most interesting to fully render at some other time.

[diffractometer]

@kcrosley-leisurelabs would that be like the example but skip the first level 1 phase? Let it render for a long time then iterate? I think I understand...

[kcrosley-leisurelabs]

@diffractometer, I just mean that you can tell at Level 2 whether a track is worth even bothering to render fully-upsampled, but given how diverse the output is from jukebox, I'd rather spend my time crate digging at Level 2 and then going back and deciding which ones are worth upsampling later (as longer tracks take so durn long to upsample).