Autotag existing music library and mark duplicates in Android

[SoumyBhow]

Hello all. As the title suggests I'd like to autotag and mark duplicates in my existing music library. I'm on Android and I've installed beets in Termux. I got all of my mp3s in a folder (/sdcard/Music) and they're not organized into sub folders by album. This is the content of my config.yaml so far:

directory: /sdcard/Music
library: /sdcard/Music/musiclibrary.db
import:
   copy: no
   write: yes

I haven't ran any commands yet since I'd like to confirm here before doing so. Should I just run beets import /sdcard/Music?

[sampsyo]

Hi! Is there any chance you could be a bit more explicit about what you’re worried about in particular? What you describe seems like a pretty standard setup, so I don’t see any red flags. But I’ve never run beets (or anything, really) directly on an Android device so far, so I’m not sure what to expect as a potential pitfall unique to that setting.

[SoumyBhow]

Alright so I took a backup and added the fetchart and fromfilename plugins to the config and ran beet import /sdcard/Music and this is what I got:

It doesn't seem to understand the files that aren't broken and it gets stuck on that last file in the end. And it just continues after that line where it asks for a letter without me inputting anything. What's happening here?

[sampsyo]

Importing something in verbose mode might reveal more details.

The prompts continue unabated while the prompt is still waiting for you because the importer process is happening in the background (concurrently).

In general, it can be easier for us to interpret proper pastes of text than screenshots, if you don't mind using GitHub's "code block" syntax in the future! Thanks!!

[SoumyBhow]

beet -v import /sdcard/Music/ > beet.log
user configuration: /data/data/com.termux/files/home/.config/beets/config.yaml
data directory: /data/data/com.termux/files/home/.config/beets
plugin paths:
Sending event: pluginload
library database: /sdcard/Music/musiclibrary.db
library directory: /sdcard/Music
Sending event: library_opened
Sending event: import_begin
state file could not be read: [Errno 2] No such file or directory: '/data/data/com.termux/files/home/.config/beets/state.pickle'
ignoring b'.thumbnails' due to ignore rule b'.*'
unreadable file: /sdcard/Music/Alex Pizzuti, Revealed Recordings - Feeling.mp3
 unreadable file: /sdcard/Music/Becky Hill, David Guetta, Benny Benassi - Remember - Benny Benassi Remix.mp3
unreadable file: /sdcard/Music/BIJOU, SPLASHWOE - Chop It Up.mp3
unreadable file: /sdcard/Music/Cat Dealers, Charlotte Haining - Nobody Does It.mp3
unreadable file: /sdcard/Music/Drama.mp3
unreadable file: /sdcard/Music/Fat_Reaper.mp3
unreadable file: /sdcard/Music/Fireworks_-_Radio_Edit.mp3
unreadable file: /sdcard/Music/Mo Falk - Chopper.mp3
unreadable file: /sdcard/Music/Plant, Gravy, Ravey.mp3
unreadable file: /sdcard/Music/Wanna_Dance_-_Original_Mix.mp3
Sending event: import_task_created
Sending event: import_task_start
Looking up: /sdcard/Music
Tagging Panda Eyes -
No album ID found.
Search terms: Panda Eyes -
Album might be VA: True
Evaluating 0 candidates.
Sending event: import_task_before_choice
Sending event: before_choose_candidate
Sending event: import_task_created
Sending event: import_task_start
Looking up: /sdcard/Music/SpotiFlyer
Tagging Calvin Harris -
No album ID found.
Search terms: Calvin Harris -
Album might be VA: True
Evaluating 0 candidates.
unreadable file: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim/False.mp3
unreadable file: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim/Memories_Of_You.mp3
unreadable file: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim/Occult_Princess.mp3
unreadable file: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim/Sumthin_Spicy.mp3
unreadable file: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim/WAITING.mp3
Sending event: import_task_created
Sending event: import_task_start
Looking up: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim
Tagging Similar Outskirts - Afterlife Vol. 1
No album ID found.
Search terms: Similar Outskirts - Afterlife Vol. 1
Album might be VA: True
Searching for MusicBrainz releases with: {'release': 'afterlife vol. 1', 'artist': 'similar outskirts', 'tracks': '142'}
Requesting MusicBrainz release 22d030dd-6bc6-4f25-85a4-36b535216588
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Similar Outskirts - Imagination EP (22d030dd-6bc6-4f25-85a4-36b535216588)
Computing track assignment...
...done.
Success. Distance: 0.91
Requesting MusicBrainz release 28379e7d-a033-4299-892f-b396b1531335
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Similar Outskirts - No Limits EP (28379e7d-a033-4299-892f-b396b1531335)
Computing track assignment...
...done.
Success. Distance: 0.91
Requesting MusicBrainz release 2cfc301e-e52d-4e1a-a238-deab8a9a2a6c
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Similar Outskirts - Daredevil EP (2cfc301e-e52d-4e1a-a238-deab8a9a2a6c)
Computing track assignment...
...done.
Success. Distance: 0.92
Requesting MusicBrainz release 36f77869-a081-4076-81b9-aaf912d65011
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Similar Outskirts - Thunderbolt (36f77869-a081-4076-81b9-aaf912d65011)
Computing track assignment...
...done.
Success. Distance: 0.95
Requesting MusicBrainz release eb799010-7fab-4de8-b3dd-e92c2f07254d
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Similar Outskirts - Technology (eb799010-7fab-4de8-b3dd-e92c2f07254d)
Computing track assignment...
...done.
Success. Distance: 0.95
Searching for MusicBrainz releases with: {'release': 'afterlife vol. 1', 'arid': '89ad4ac3-39f7-470e-963a-56509c546377', 'tracks': '142'}
Requesting MusicBrainz release f57c2ca2-cf3c-432b-a250-09849b332bab
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Turkuaz - Afterlife Vol. 1 (f57c2ca2-cf3c-432b-a250-09849b332bab)
Computing track assignment...
...done.
Success. Distance: 0.91
Requesting MusicBrainz release dba1785d-90f8-4c96-81eb-df3a1b95bafd
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Various Artists - Vol.1???! (dba1785d-90f8-4c96-81eb-df3a1b95bafd)
Computing track assignment...
...done.
Success. Distance: 0.85
Requesting MusicBrainz release 49bc5357-a5e9-4e49-85dc-cf4e91e0c0b8
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Various Artists - Vol. 1 (49bc5357-a5e9-4e49-85dc-cf4e91e0c0b8)
Computing track assignment...
...done.
Success. Distance: 0.91
Requesting MusicBrainz release 0beaaf6f-ec66-4395-a7e9-325a33dd1844
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Various Artists - Vol. 1 (0beaaf6f-ec66-4395-a7e9-325a33dd1844)
Computing track assignment...
...done.
Success. Distance: 0.90
Requesting MusicBrainz release d14fe9ae-f0b1-4fb1-90fa-dee72b245612
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Various Artists - Vol. 1 (d14fe9ae-f0b1-4fb1-90fa-dee72b245612)
Computing track assignment...
...done.
Success. Distance: 0.90
Evaluating 10 candidates.
^C^CTraceback (most recent call last):
  File "/data/data/com.termux/files/usr/lib/python3.10/site-packages/beets/util/pipeline.py", line 427, in run_parallel
    threads[-1].join(1)
  File "/data/data/com.termux/files/usr/lib/python3.10/threading.py", line 1093, in join
    self._wait_for_tstate_lock(timeout=max(timeout, 0))
  File "/data/data/com.termux/files/usr/lib/python3.10/threading.py", line 1109, in _wait_for_tstate_lock
    if lock.acquire(block, timeout):
KeyboardInterrupt

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/data/data/com.termux/files/usr/lib/python3.10/site-packages/beets/ui/__init__.py", line 1285, in main
    _raw_main(args)
  File "/data/data/com.termux/files/usr/lib/python3.10/site-packages/beets/ui/__init__.py", line 1272, in _raw_main
    subcommand.func(lib, suboptions, subargs)
  File "/data/data/com.termux/files/usr/lib/python3.10/site-packages/beets/ui/commands.py", line 973, in import_func
    import_files(lib, paths, query)
  File "/data/data/com.termux/files/usr/lib/python3.10/site-packages/beets/ui/commands.py", line 943, in import_files
    session.run()
  File "/data/data/com.termux/files/usr/lib/python3.10/site-packages/beets/importer.py", line 340, in run
    pl.run_parallel(QUEUE_SIZE)
  File "/data/data/com.termux/files/usr/lib/python3.10/site-packages/beets/util/pipeline.py", line 440, in run_parallel
    thread.join()
  File "/data/data/com.termux/files/usr/lib/python3.10/threading.py", line 1089, in join
    self._wait_for_tstate_lock()
  File "/data/data/com.termux/files/usr/lib/python3.10/threading.py", line 1109, in _wait_for_tstate_lock
    if lock.acquire(block, timeout):
KeyboardInterrupt

Fatal Python error: _enter_buffered_busy: could not acquire lock for <_io.BufferedReader name='<stdin>'> at interpreter shutdown, possibly due to daemon threads
Python runtime state: finalizing (tstate=0xb4000071eb42c000)

Current thread 0x00000071f12a0518 (most recent call first):
  <no Python frame>
fish: Job 1, 'beet -v import /sdcard/Music/ >…' terminated by signal SIGABRT (Abort)

This is what I got after doing -v. It got stuck at a point so I did Ctrl C twice to exit (You'll see at a point ^C^C)

[sampsyo]

Hmm, nothing obvious in there. It might be useful to look directly at one of those "unreadable" files. Using ffmpeg or some other tool to try decoding it, or just plain old file to see what it contains, could reveal what's going on with the files.

Also "very verbose" (-vv) may reveal more details.

[SoumyBhow]

user configuration: /data/data/com.termux/files/home/.config/beets/config.yaml
data directory: /data/data/com.termux/files/home/.config/beets
plugin paths:
Sending event: pluginload
library database: /sdcard/Music/musiclibrary.db
library directory: /sdcard/Music
Sending event: library_opened
Sending event: import_begin
state file could not be read: [Errno 2] No such file or directory: '/data/data/com.termux/files/home/.config/beets/state.pickle'
ignoring b'.thumbnails' due to ignore rule b'.*'
 unreadable file: /sdcard/Music/Alex Pizzuti, Revealed Recordings - Feeling.mp3
unreadable file: /sdcard/Music/Becky Hill, David Guetta, Benny Benassi - Remember - Benny Benassi Remix.mp3
unreadable file: /sdcard/Music/BIJOU, SPLASHWOE - Chop It Up.mp3
unreadable file: /sdcard/Music/Cat Dealers, Charlotte Haining - Nobody Does It.mp3
unreadable file: /sdcard/Music/Drama.mp3
unreadable file: /sdcard/Music/Fat_Reaper.mp3
 unreadable file: /sdcard/Music/Fireworks_-_Radio_Edit.mp3
 unreadable file: /sdcard/Music/Mo Falk - Chopper.mp3
unreadable file: /sdcard/Music/Plant, Gravy, Ravey.mp3
unreadable file: /sdcard/Music/Wanna_Dance_-_Original_Mix.mp3
Sending event: import_task_created
Sending event: import_task_start
Looking up: /sdcard/Music
Tagging Panda Eyes -
No album ID found.
Search terms: Panda Eyes -
Album might be VA: True
Evaluating 0 candidates.
Sending event: import_task_before_choice
Sending event: before_choose_candidate
Sending event: import_task_created
Sending event: import_task_start
Looking up: /sdcard/Music/SpotiFlyer
Tagging Calvin Harris -
No album ID found.
Search terms: Calvin Harris -
Album might be VA: True
Evaluating 0 candidates.
unreadable file: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim/False.mp3
unreadable file: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim/Memories_Of_You.mp3
unreadable file: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim/Occult_Princess.mp3
unreadable file: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim/Sumthin_Spicy.mp3
unreadable file: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim/WAITING.mp3
Sending event: import_task_created
Sending event: import_task_start
Looking up: /sdcard/Music/SpotiFlyer/Playlists/Color_Bass___Melodic_Riddim
Tagging Similar Outskirts - Afterlife Vol. 1
No album ID found.
Search terms: Similar Outskirts - Afterlife Vol. 1
Album might be VA: True
Searching for MusicBrainz releases with: {'release': 'afterlife vol. 1', 'artist': 'similar outskirts', 'tracks': '142'}
Requesting MusicBrainz release 28379e7d-a033-4299-892f-b396b1531335
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Similar Outskirts - No Limits EP (28379e7d-a033-4299-892f-b396b1531335)
Computing track assignment...
...done.
Success. Distance: 0.91
Requesting MusicBrainz release 22d030dd-6bc6-4f25-85a4-36b535216588
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Similar Outskirts - Imagination EP (22d030dd-6bc6-4f25-85a4-36b535216588)
Computing track assignment...
...done.
Success. Distance: 0.91
Requesting MusicBrainz release 2cfc301e-e52d-4e1a-a238-deab8a9a2a6c
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Similar Outskirts - Daredevil EP (2cfc301e-e52d-4e1a-a238-deab8a9a2a6c)
Computing track assignment...
...done.
Success. Distance: 0.92
Requesting MusicBrainz release 08bcca47-bdfa-4c9b-9c15-7572b8585c35
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Similar Outskirts - Stargazer (08bcca47-bdfa-4c9b-9c15-7572b8585c35)
Computing track assignment...
...done.
Success. Distance: 0.94
Requesting MusicBrainz release 7f9ddb6a-535f-4edd-bd3a-6ab260a070c8
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Similar Outskirts - Simulation (7f9ddb6a-535f-4edd-bd3a-6ab260a070c8)
Computing track assignment...
...done.
Success. Distance: 0.94
Searching for MusicBrainz releases with: {'release': 'afterlife vol. 1', 'arid': '89ad4ac3-39f7-470e-963a-56509c546377', 'tracks': '142'}
Requesting MusicBrainz release f57c2ca2-cf3c-432b-a250-09849b332bab
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Turkuaz - Afterlife Vol. 1 (f57c2ca2-cf3c-432b-a250-09849b332bab)
Computing track assignment...
...done.
Success. Distance: 0.91
Requesting MusicBrainz release dba1785d-90f8-4c96-81eb-df3a1b95bafd
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Various Artists - Vol.1???! (dba1785d-90f8-4c96-81eb-df3a1b95bafd)
Computing track assignment...
...done.
Success. Distance: 0.85
Requesting MusicBrainz release 0beaaf6f-ec66-4395-a7e9-325a33dd1844
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Various Artists - Vol. 1 (0beaaf6f-ec66-4395-a7e9-325a33dd1844)
Computing track assignment...
...done.
Success. Distance: 0.90
Requesting MusicBrainz release 49bc5357-a5e9-4e49-85dc-cf4e91e0c0b8
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Various Artists - Vol. 1 (49bc5357-a5e9-4e49-85dc-cf4e91e0c0b8)
Computing track assignment...
...done.
Success. Distance: 0.91
Requesting MusicBrainz release d14fe9ae-f0b1-4fb1-90fa-dee72b245612
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_track_extract
Sending event: mb_album_extract
Sending event: albuminfo_received
Candidate: Various Artists - Vol. 1 (d14fe9ae-f0b1-4fb1-90fa-dee72b245612)
Computing track assignment...
...done.
Success. Distance: 0.90
Evaluating 10 candidates.

The unreadable files seem to be broken. I tried opening some in an audio player and they don't work. As for the very verbose I think it just outputs the same thing as -v did... It kept getting stuck so I did Ctrl C to exit again..