Why does the write command need Internet access?

[arogl]

I am issuing the following command beet write and it fails with the below error, if I use beet write -p I do not get any errors.

I have tied disabling the deezer plugin, but it errors with the same issue.

I not deezer in Australia have discontinued free access, but sometime it works for a number of tracks, and other times it crashes on the first track.

I run beets from a git clone, updated daily.

Any help /ideas appreciated.

Kira Kosarin - Loving You Silently - Loving You Silently
  mb_artistid:  -> 7jksCPW6uDQiTDVbcyLV79
  mb_albumartistid:  -> 7jksCPW6uDQiTDVbcyLV79
Traceback (most recent call last):
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\urllib3\connectionpool.py", line 466, in _make_request
    self._validate_conn(conn)
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\urllib3\connectionpool.py", line 1095, in _validate_conn
    conn.connect()
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\urllib3\connection.py", line 652, in connect
    sock_and_verified = _ssl_wrap_socket_and_match_hostname(
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\urllib3\connection.py", line 805, in _ssl_wrap_socket_and_match_hostname
    ssl_sock = ssl_wrap_socket(
               ^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\urllib3\util\ssl_.py", line 465, in ssl_wrap_socket
    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\urllib3\util\ssl_.py", line 509, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\ssl.py", line 455, in wrap_socket
    return self.sslsocket_class._create(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\ssl.py", line 1042, in _create
    self.do_handshake()
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\ssl.py", line 1320, in do_handshake
    self._sslobj.do_handshake()
ssl.SSLError: [SSL: DECRYPTION_FAILED_OR_BAD_RECORD_MAC] decryption failed or bad record mac (_ssl.c:1000)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\urllib3\connectionpool.py", line 789, in urlopen
    response = self._make_request(
               ^^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\urllib3\connectionpool.py", line 490, in _make_request
    raise new_e
urllib3.exceptions.SSLError: [SSL: DECRYPTION_FAILED_OR_BAD_RECORD_MAC] decryption failed or bad record mac (_ssl.c:1000)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\requests\adapters.py", line 667, in send
    resp = conn.urlopen(
           ^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\urllib3\connectionpool.py", line 843, in urlopen
    retries = retries.increment(
              ^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\urllib3\util\retry.py", line 519, in increment
    raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.deezer.com', port=443): Max retries exceeded with url: /search?q=artist%3A%22Kira+Kosarin%22+album%3A%22Loving+You+Silently%22+track%3A%22Loving+You+Silently%22&order=RANKING (Caused by SSLError(SSLError(1, '[SSL: DECRYPTION_FAILED_OR_BAD_RECORD_MAC] decryption failed or bad record mac (_ssl.c:1000)')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Scripts\beet.exe\__main__.py", line 7, in <module>
  File "E:\Git\beets\beets\ui\__init__.py", line 1865, in main
    _raw_main(args)
  File "E:\Git\beets\beets\ui\__init__.py", line 1852, in _raw_main
    subcommand.func(lib, suboptions, subargs)
  File "E:\Git\beets\beets\ui\commands.py", line 2303, in write_func
    write_items(lib, decargs(args), opts.pretend, opts.force)
  File "E:\Git\beets\beets\ui\commands.py", line 2299, in write_items
    item.try_sync(True, False)
  File "E:\Git\beets\beets\library.py", line 903, in try_sync
    self.try_write()
  File "E:\Git\beets\beets\library.py", line 884, in try_write
    self.write(*args, **kwargs)
  File "E:\Git\beets\beets\library.py", line 857, in write
    plugins.send("write", item=self, path=path, tags=item_tags)
  File "E:\Git\beets\beets\plugins.py", line 507, in send
    result = handler(**arguments)
             ^^^^^^^^^^^^^^^^^^^^
  File "E:\Git\beets\beets\plugins.py", line 143, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Roaming\beets\beetsplug\popularity.py", line 47, in _on_write
    self._set_popularity(item, False)
  File "C:\Users\XXXXX\AppData\Roaming\beets\beetsplug\popularity.py", line 55, in _set_popularity
    response = requests.get(self.API_URL, params=payload)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\requests\api.py", line 73, in get
    return request("get", url, params=params, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\requests\api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\requests\sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\requests\sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python312\Lib\site-packages\requests\adapters.py", line 698, in send
    raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='api.deezer.com', port=443): Max retries exceeded with url: /search?q=artist%3A%22Kira+Kosarin%22+album%3A%22Loving+You+Silently%22+track%3A%22Loving+You+Silently%22&order=RANKING (Caused by SSLError(SSLError(1, '[SSL: DECRYPTION_FAILED_OR_BAD_RECORD_MAC] decryption failed or bad record mac (_ssl.c:1000)')))

beet config output

directory: \\?\E:\Music

import:
  copy: no
  move: yes
  write: yes
  detail: yes
  resume: ask
  quiet_fallback: skip
  timid: no
  log: \\?\E:\new_Music\beetslog.txt
  languages: en
ignore: .AppleDouble ._* *~ .DS_Store *.sfv *.srr *.nfo *.m3u *.ini *.log
art_filename: cover
pluginpath: C:\Users\arogl\AppData\Roaming\beets\beetsplug\

# --------------- Plugins ---------------

plugins:
  - abcalc
  - arttools
  - audit
  - badfiles
  - bandcamp
  - bpmanalyser
  - chroma
  - deezer
  - discogs
  - duplicates
  - edit
  - embedart
  - fetchart
  - filetote
  - fromfilename
  - importadded
  - info
  - inline
  - lastgenre
  - mbsync
  - missing
  - popularity
  - replaygain
  - scrub
  - spotify
  - similarity
  - unimported
  - zero
replace:
  '[\x00-\x1f]': ""
  ^\.\.\.: "\u2026"
  ^\.\.: "\u2025"
  ^\.: "\u2024"
  \.\.\.: "\u2026"
  \.\.\.$: "\u2026"
  \.\.$: "\u2025"
  \.\.: "\u2025"
  \.$: "\u2024"
  \s+$: ""
  ^\s+: ""
  "\u2010": "-"
  ":": "\u2236"
  /: "\uFF0F"
  \*: "\u2605"
  \|: "\u01C0"
  \u003F: "\uFF1F"
  "\u2019": "'"
  '"': "\u2033"
  \\: "\u29F5"
  <: "\u2039"
  ">": "\u203A"
  "<<": "\xAB"
  ">>": "\xBB"
  Florence And The Machine: Florence + The Machine
  Marina & The Diamonds: MARINA
  Marina and The Diamonds: MARINA
  Lauren Spencer-Smith: Lauren Spencer Smith
  "L\xF8l\xF8": "L\xD8L\xD8"
  "\u201CWeird Al\u201D Yankovic": Weird Al Yankovic
  Kaylen's Rain: Kaylens Rain
  Derek & Clive: Derek and Clive

# --------------- Performance ---------------

threaded: no
va_name: Various Artists
id3v23: no
time_format: "%Y-%m-%d %H:%M:%S"
format_raw_length: no

sort_album: albumartist+ year+ album+
sort_item: artist+ year+ album+ disc+ track+
sort_case_insensitive: yes

ui:
  terminal_width: 200
  length_diff_thresh: 10.0
  color: yes

  import:
    indentation:
      match_header: 2
      match_details: 2
      match_tracklist: 5
    layout: column

# --------------- Search ---------------

format_item: "\e[92m$artist\e[39m - \e[31m$album\e[39m - \e[93m$title\e[39m"
format_album: "\e[92m$albumartist\e[39m - \e[93m($year)\e[39m - \e[31m$album\e[39m"
paths:
  default: "%upper{%asciify{%left{$first_artist,1}}}/$first_artist/($year) $album%aunique{}/$album - $track - $artist - $title"
  singleton: Singles/$artist - $title
  albumtype:soundtrack: Soundtracks/($year) $album%aunique{}/$album - $track - $artist - $title
  "albumartist:\\\u201CWeird\\ Al\\\u201D Yankovic": W/Weird Al Yankovic/($year) $album%aunique{}/$album - $track - $artist - $title
  albumartist:various\ artists: Various Artists/($year) $album%aunique{}/$album - $track - $artist - $title
  albumartist:various: Various Artists/($year) $album%aunique{}/$album - $track - $artist - $title
  comp: Various Artists/($year) $album%aunique{}/$album - $track - $artist - $title
  ext:.pdf: "%upper{%asciify{%left{$first_artist,1}}}/$first_artist/($year) $album%aunique{}/$album - 00 - $artist - $title"
  paired_ext:.lrc: $albumpath/$medianame_new
  paired_ext:.txt: $albumpath/$medianame_new
item_fields:
  first_artist: 'import re

    artistlist = ["Beth Hart & Joe Bonamassa", "Bob Marley & The Wailers", "David Guetta & Cathy Guetta", "Elton John & Billy Joel", "H & Claire", "Hootie & the Blowfish", "Jakle & Hide"]

    artistlist += ["Joan Jett and the Blackhearts", "Jess & Matt", "Jon and Vangelis", "Lily & Madeleine", "Rihanna, Kanye West & Paul McCartney", "Simon & Garfunkel", "She & Him"]

    artistlist += ["The Mamas & the Papas", "Maddie & Tae", "Aly & AJ", "Derek & Clive" ,"Presley & Taylor", "Tones and I", "Jon and Vangelis"]

    return re.split(r''(?i)(,\s)|(;\s)|(\s&\s)|(\sfeat)|(\sft\.)|(\sft\ )|(\ X\ )'',albumartist,1)[0:1][0] if albumartist not in artistlist else albumartist

    '
zero:
  fields: comments lyrics
  comments:
    - EAC
    - LAME
    - from.+collection
    - ripped by
    - ExactAudioCopy
    - Exact Audio Copy
    - www.tr7music.me
    - WWW.ITUNESCLUB.COM
    - itunesvn.com
    - http://mzmusiczone.blogspot.com/
    - www.t.me/pmedia_music
    - PMEDIA NETWORK
  lyrics: [XXX, "\xA9 \xA4 @"]
  update_database: yes
  auto: yes
  keep_fields: []
scrub:
  auto: yes
replaygain:
  overwrite: no
  auto: yes
  backend: ffmpeg
  threads: 8
  parallel_on_import: no
  per_disc: no
  peak: "true"
  targetlevel: 89
  r128: [Opus]
  r128_targetlevel: 84
embedart:
  auto: yes
  maxwidth: 0
  compare_threshold: 0
  ifempty: no
  remove_art_file: no
  quality: 0
fetchart:
  auto: yes
  cautious: yes
  cover_names: cover front art album folder
  google_search: yes
  minwidth: 0
  enforce_ratio: no
  sources: filesystem coverart itunes albumart amazon fanarttv wikipedia google
  fanarttv_key: REDACTED
  google_API_key: REDACTED
  google_engine_ID: REDACTED
  maxwidth: 0
  quality: 0
  max_filesize: 0
  store_source: no
  high_resolution: no
  deinterlace: no
  cover_format:
  google_key: REDACTED
  google_engine: REDACTED
  lastfm_key: REDACTED
acoustid:
  apikey: REDACTED
copyartifacts:
  extensions: .pdf .txt .lrc .jpg .jpeg .png
  print_ignored: yes
check:
  import: yes
  write-check: yes
  write-update: yes
  convert-update: yes
  threads: 8
  tools:
    mp3val:
      cmd: mp3val {}
      formats: MP3
      error: '^WARNING: .* \(offset 0x[0-9a-f]+\): (.*)$'
      fix: mp3val -f -nb {}
    flac:
      cmd: flac --test {}
      formats: flac
duplicates:
  album: no
  checksum: ffmpeg -i {file} -f crc -
  copy: none
  count: no
  delete: no
  format: $album - $track - $artist - $title
  full: no
  strict: no
  move: none
  keys: [ffmpeg]
  path: no
  merge: no
  tiebreak: {}
  tag: ""

match:
  ignore_video_tracks: no
discogs:
  source_weight: 0.0
  apikey: REDACTED
  apisecret: REDACTED
  tokenfile: discogs_token.json
  user_token: REDACTED
  separator: ", "
  index_tracks: no
  append_style_genre: no
deezer:
  source_weight: 0.0
spotify:
  source_weight: 0.1
  mode: list
  tiebreak: popularity
  show_failures: no
  artist_field: albumartist
  album_field: album
  track_field: title
  region_filter:
  regex: []
  client_id: REDACTED
  client_secret: REDACTED
  tokenfile: spotify_token.json
importadded:
  preserve_mtimes: yes
  preserve_write_mtimes: no
lyrics:
  fallback: ""
  synced: yes
  sources: lrclib musixmatch genius
ftintitle:
  auto: yes
  drop: no
  format: feat. {0}
wlg:
  auto: yes
  force: no
  count: 4
  separator: ", "
  whitelist: beets
bandcamp:
  source_weight: 0.0
  art: yes
  lyrics: yes
  include_digital_only_tracks: yes
  search_max: 2
  exclude_extra_fields: []
  genre:
    capitalize: no
    maximum: 0
    mode: progressive
    always_include: []
  comments_separator: "

    ---

    "
badfiles:
  commands:
    flac: flac --test --warnings-as-errors --silent
acousticbrainz:
  auto: yes
lastgenre:
  auto: yes
  count: 3
  canonical: yes
  whitelist: yes
  min_weight: 10
  fallback:
  source: album
  force: yes
  separator: ", "
  prefer_specific: no
  title_case: yes
musicbrainz:
  host: musicbrainz.org
  ratelimit: 1
  ratelimit_interval: 1.0
  searchlimit: 20
  genre: yes
  user: arogl
  password: Redacted
  extra_tags:
    - year
    - catalognum
    - country
    - media
    - label
absubmit:
  auto: yes
  extractor: D:\win_prog\acousticbrainz-gui\streaming_extractor_music.exe
dates:
  prefix: "="
extrafiles:
  patterns:
    pdf: ["*.pdf"]
    artworkdir:
      - "[sS]cans/"
      - "[aA]rtwork/"
      - "[cC]over/"
      - "[cC]overs/"
      - "[sS]can/"
    lyrics: ["*.lrc", "*.txt"]
    images:
      - "*.png"
      - "*.jpeg"
      - "*.jpg"
      - "*.gif"
  paths:
    artworkdir: $albumpath/Artwork
bpmanalyser:
  auto: yes
  dry-run: no
  write: yes
  threads: auto
  force: no
  quiet: no
autofix:
  max_exec_time: 0
  tasks:
    missing_file_checker:
      enabled: yes
    year_fixer:
      enabled: yes
    audio_conversion:
      enabled: no
    tag_cleaner:
      enabled: no
    ab_data_fetcher:
      enabled: yes
    xtractor:
      enabled: no
    genre_finder:
      enabled: yes
oldestdate:
  auto: yes
  ignore_track_id: yes
  filter_on_import: yes
  prompt_missing_work_id: yes
  force: yes
  overwrite_date: no
  filter_recordings: yes
  approach: releases
yearfixer:
  auto: yes
filetote:
  pairing:
    enabled: yes
    pairing_only: yes
    extensions: .lrc .txt
  extensions: .pdf
  patterns:
    artworkdir: ["[sS]cans/", "[aA]rtwork/"]
  session:
    operation:
    beets_lib:
    import_path:
  filenames: ""
  exclude: ""
  paths: {}
  print_ignored: no
unimported:
  ignore_extensions: []
  ignore_subdirectories: []
chroma:
  auto: yes
pathfields: {}
album_fields: {}
missing:
  count: no
  total: no
  album: no
lastfm:
  user: ""
  api_key: REDACTED
similarity:
  per_page: 500
  retry_limit: 3
  json: similarity.json
  depth: 1
  force: no
arttools:
  aspect_ratio_thresh: 0.8
  size_thresh: 200
  max_file_size: 1048576
  additional_names: []
  collage_tilesize: 200
  collect_extract: yes
  collect_fetch_sources:
    - filesystem
    - coverart
    - itunes
    - amazon
    - albumart
    - wikipedia
    - google
    - fanarttv
    - lastfm
    - spotify
    - bandcamp
  chooseart_weightings:
    aspect_ratio: 1
    pixels: 0.8
    bytes: 0.2
  host: 127.0.0.1
  port: 8338
abcalc:
  force: no
  auto: no
edit:
  albumfields: album albumartist
  itemfields: track title artist album
  ignore_fields: id path

[wisp3rwind]

The request originates in the popularity plugin (which Google suggests is this https://github.com/abba23/beets-popularity?), which seems to be unmaintained for years and by design only fetches & sets the popularity on `write' (which seems like a questionable design decision).

[arogl]

@wisp3rwind Thanks for that.

Somedays we don't see the forest for the trees.