Exceptionally long duration of "Downloading index: library_index.tar.bz2" process

[DanMan32]

Describe the problem

I know a number of people have reported this problem for months but still it isn't solved.

When starting Arduino IDE 2.2.1, notification area shows "Downloading index: library_index.tar.bz2"
Progress bar stays at 50% for a really long time, like 1/2 hour.

I know it isn't an issue of accessing the Internet, as I am writing this connected to the Internet with Arduino stuck at that stage.
Even if I didn't have an Internet connection at the time, IDE should time out after maybe a minute and move on with its life.

While it is in this state, can't compile, as compile progress seems to wait for the index download to finish

Once I get past this, then successive launches of Arduino seems to be good either for the rest of the day or as long as I don't log out of Windows, haven't figured that part out yet.

To reproduce

Start Arduino IDE 2.2.1 for first time in a particular day

Expected behavior

Not get stuck for 10's of minutes with status "Downloading index: library_index.tar.bz2"

Arduino CLI version

How do I find Arduino-cli?

Operating system

Windows

Operating system version

Windows 11

Additional context

No response

Issue checklist

• I searched for previous reports in the issue tracker
• I verified the problem still occurs when using the nightly build
• My report contains all necessary details

[DanMan32]

Incidentally, I had found somewhere someone had a log output with full URL to the file. I had tried that in a browser, file downloaded instantly.

[DanMan32]

I found where arduino-cli is located:
C:\Program Files\Arduino IDE\resources\app\lib\backend\resources>
Ran 'arduino-cli core update-index', hesitated about 10 seconds, with seemingly successful results:
Downloading index: package_index.tar.bz2 downloaded

Even updated it to 0.34.2 but no improvement.

[DanMan32]

Went through the process of launching from PowerShell, the Downloading Index seems to take a long time doing these:

2023-09-29T04:39:13.570Z daemon INFO time="2023-09-29T00:39:13-04:00" level=info msg="Resolving include AutoConnect.h for arch esp32"
time="2023-09-29T00:39:13-04:00" level=info msg="  found better lib" lib=AutoConnect prio=6B1
2023-09-29T04:39:29.092Z daemon INFO time="2023-09-29T00:39:29-04:00" level=info msg="Resolving include WiFi.h for arch esp32"
time="2023-09-29T00:39:29-04:00" level=info msg="  found better lib" lib=WiFi prio=6B0
2023-09-29T04:39:45.007Z daemon INFO time="2023-09-29T00:39:45-04:00" level=info msg="Resolving include WebServer.h for arch esp32"
time="2023-09-29T00:39:45-04:00" level=info msg="  found better lib" lib=WebServer prio=6B0
[71480:0929/003958.469:ERROR:gpu_init.cc(523)] Passthrough is not supported, GL is disabled, ANGLE is
2023-09-29T04:40:01.671Z daemon INFO time="2023-09-29T00:40:01-04:00" level=info msg="Resolving include DNSServer.h for arch esp32"
time="2023-09-29T00:40:01-04:00" level=info msg="  found better lib" lib=DNSServer prio=6B0
2023-09-29T04:40:17.592Z daemon INFO time="2023-09-29T00:40:17-04:00" level=info msg="Resolving include EEPROM.h for arch esp32"
time="2023-09-29T00:40:17-04:00" level=info msg="  found better lib" lib=EEPROM prio=6B0
2023-09-29T04:40:34.431Z daemon INFO time="2023-09-29T00:40:34-04:00" level=info msg="Resolving include PageBuilder.h for arch esp32"
time="2023-09-29T00:40:34-04:00" level=info msg="  found better lib" lib=PageBuilder prio=6B1
2023-09-29T04:40:53.157Z daemon INFO time="2023-09-29T00:40:53-04:00" level=info msg="Resolving include FS.h for arch esp32"
time="2023-09-29T00:40:53-04:00" level=info msg="  found better lib" lib=FS prio=6B0
2023-09-29T04:41:12.586Z daemon INFO time="2023-09-29T00:41:12-04:00" level=info msg="Resolving include SPIFFS.h for arch esp32"
time="2023-09-29T00:41:12-04:00" level=info msg="  found better lib" lib=SPIFFS prio=6B0
2023-09-29T04:41:33.667Z daemon INFO time="2023-09-29T00:41:33-04:00" level=info msg="Resolving include SD.h for arch esp32"
time="2023-09-29T00:41:33-04:00" level=info msg="  found better lib" lib=SD prio=6A7
time="2023-09-29T00:41:33-04:00" level=info msg="  found better lib" lib=SD prio=6B0
2023-09-29T04:41:54.968Z daemon INFO time="2023-09-29T00:41:54-04:00" level=info msg="Resolving include SPI.h for arch esp32"
time="2023-09-29T00:41:54-04:00" level=info msg="  found better lib" lib=SPI prio=6B0
2023-09-29T04:42:15.144Z daemon INFO time="2023-09-29T00:42:15-04:00" level=info msg="Resolving include Preferences.h for arch esp32"
time="2023-09-29T00:42:15-04:00" level=info msg="  found better lib" lib=Preferences prio=6B0
2023-09-29T04:42:36.738Z daemon INFO time="2023-09-29T00:42:36-04:00" level=info msg="Resolving include Ticker.h for arch esp32"
time="2023-09-29T00:42:36-04:00" level=info msg="  found better lib" lib=Ticker prio=6B0
2023-09-29T04:42:58.281Z daemon INFO time="2023-09-29T00:42:58-04:00" level=info msg="Resolving include ArduinoJson.h for arch esp32"
time="2023-09-29T00:42:58-04:00" level=info msg="  found better lib" lib=ArduinoJson prio=6A7
2023-09-29T04:43:28.337Z daemon INFO time="2023-09-29T00:43:28-04:00" level=info msg="Resolving include HTTPClient.h for arch esp32"
2023-09-29T04:43:28.340Z daemon INFO time="2023-09-29T00:43:28-04:00" level=info msg="  found better lib" lib=HTTPClient prio=6B0
2023-09-29T04:43:58.304Z daemon INFO time="2023-09-29T00:43:58-04:00" level=info msg="Resolving include WiFiClientSecure.h for arch esp32"
time="2023-09-29T00:43:58-04:00" level=info msg="  found better lib" lib=WiFiClientSecure prio=6B0
2023-09-29T04:44:35.127Z daemon INFO time="2023-09-29T00:44:35-04:00" level=info msg="Resolving include HTTPUpdate.h for arch esp32"
time="2023-09-29T00:44:35-04:00" level=info msg="  found better lib" lib=HTTPUpdate prio=6B0
2023-09-29T04:45:07.932Z daemon INFO time="2023-09-29T00:45:07-04:00" level=info msg="Resolving include Update.h for arch esp32"
2023-09-29T04:45:07.933Z daemon INFO time="2023-09-29T00:45:07-04:00" level=info msg="  found better lib" lib=Update prio=6B0
2023-09-29T04:45:39.087Z daemon INFO time="2023-09-29T00:45:39-04:00" level=info msg="Resolving include pcf8574.h for arch esp32"
time="2023-09-29T00:45:39-04:00" level=info msg="  found better lib" lib=pcf8574 prio=6A7
2023-09-29T04:46:11.881Z daemon INFO time="2023-09-29T00:46:11-04:00" level=info msg="Resolving include Wire.h for arch esp32"
time="2023-09-29T00:46:11-04:00" level=info msg="  found better lib" lib=Wire prio=6B0
2023-09-29T04:46:49.620Z daemon INFO time="2023-09-29T00:46:49-04:00" level=info msg="Resolving include Adafruit_ADS1X15.h for arch esp32"
time="2023-09-29T00:46:49-04:00" level=info msg="  found better lib" lib="Adafruit ADS1X15" prio=6A7
2023-09-29T04:47:21.647Z daemon INFO time="2023-09-29T00:47:21-04:00" level=info msg="Resolving include Adafruit_I2CDevice.h for arch esp32"
time="2023-09-29T00:47:21-04:00" level=info msg="  found better lib" lib="Adafruit BusIO" prio=3EB
2023-09-29T04:47:57.713Z daemon INFO time="2023-09-29T00:47:57-04:00" level=info msg="Resolving include ESPTelnet.h for arch esp32"
time="2023-09-29T00:47:57-04:00" level=info msg="  found better lib" lib="ESP Telnet" prio=3EB

I get the same stalling with information similar to above when compiling.

[RL-Fields]

I am also having this issue. The only "fix" I have found is to open Arduino with the internet disconnected as per the instructions in this thread with a similar issue arduino/arduino-ide#1483

I also found a direct download URL of the bz2 file, which downloaded instantly, but am not sure what to do with it once downloaded
https://downloads.arduino.cc/libraries/library_index.tar.bz2

I'm on Windows 10 and Arduino 2.2.1

[Helienzo]

I also have this issue on Arduino IDE 2.2.1 running on windows 10.

The downloading Index bar freezes at roughly 60% and never finishes. I tried to reinstall and clean out all temp, hidden, library and other folders related to Arduino.

It sometimes works for one start after the cleanup but as soon as I restart the application the problem returns.

The only way to get the IDE to work is to start it without internet connection.

[ArneKol]

I have the exact same problem, following to see if a fix is found.

Anything I can do to help?

[umbynos]

Does this happen also with the CLI?

[njordan77]

having the same annoying issue on 2.3.2.....also with previous releases as written above. always looking for index files with no progress at all.

[niiiksh]

Same thing. Really annoying tool Arduino IDE became worse and unstable these days. 1 of 10. 🤮

[umbynos]

Could you please install the arduino-cli . And try to run arduino-cli update?

[njordan77]

did download the cli command (exe file) and executed within the ARD2 folder....not sure if this is good or not, seemed to download two index files.

EDIT:
didn't change anything. still stuck with an ESP32 index file in the GUI

[umbynos]

Yeah, It's expected that is downloading two index files.
Question is: Is the duration of the download of the index with the cli command reasonable? Or did you experience the same problem of the IDE2 GUI?

Do you have some antivirus software running?

[njordan77]

@speed....the download of these two index files is finished within 1-2secs. so no delay at all.

yes, Win11 and Bitdefender Security.
AND its a zip-file version, so i did not install via setup.

[umbynos]

Could you please try to temporarily disable the antivirus and update the indexes using the IDE GUI?

[niiiksh]

Could you please try to temporarily disable the antivirus and update the indexes using the IDE GUI?

I’ve disabled Windows Security and still downloading index for a very long time! What a bug did you test your program with Windows 11 with latest update?

[ATOMNFT]

I am also having this issue. The only "fix" I have found is to open Arduino with the internet disconnected as per the instructions in this thread with a similar issue arduino/arduino-ide#1483

I also found a direct download URL of the bz2 file, which downloaded instantly, but am not sure what to do with it once downloaded https://downloads.arduino.cc/libraries/library_index.tar.bz2

I'm on Windows 10 and Arduino 2.2.1

put files inside C:\Users\User\AppData\Local\Arduino15\

[ubidefeo]

Please, everyone, help us track this issue and hunt down the cause.

Downloading files to Arduino15 will of course work, because that's what the IDE and CLI do behind the scenes, but we'd love to be able to find this issue which we can't reproduce.

If anyone assumes that's the solution we'll have an outstanding bug.
Thank you for your collaboration
u.

[LouDnl]

Same issue here, unable to use the IDE. Tried putting file and contents manually in said location, same issue.

The notification is even still there if I completely delete the Arduino15 folder from AppData. Everything else gets downloaded and installed just fine while this message is still here.

After a while it magically dissapeared

[niiiksh]

Tip for developers of Arduino IDE: just don’t download these indexes never! 😆

[rinzlerz]

I also encounter this issue. What are the steps necessary to solve this issue?

[ATOMNFT]

I also encounter this issue. What are the steps necessary to solve this issue?

Not sure if this helps. But I have rectified the issue using these entries in additional board manager. Since I have added these the error/hang has not taken place again. When the message pops up in lower right corner it stays for a max of like 3-4 mins then its gone. Everything updates as it should and no compiling/flashing issues.

http://arduino.esp8266.com/stable/package_esp8266com_index.json
https://raw.githubusercontent.com/espressif/arduino-esp32/gh-pages/package_esp32_dev_index.json

[magn2998]

Im on Windows and fixed this by trying several things.
Most didn't work, but will list all in case they all need to be done before working.

1. Uninstalled Windows Store version and downloaded from Arduino webpage - Didn't solve it
2. Ran the "arduino-cli core update-index" cmd from AppData/Local/Programs/Arduino IDE/resources/app/lib/backend/resources - Didn't solve it
3. Ran the "arduino-cli update" from same location as above - Didn't solve it
4. Ran application as administrator - Solved it

Maybe this is a simple "Run as admin" solution?
This was also done over a longer period (but below 30 min.) so maybe time just solved it...