[FIX] If more than 25 files are uploaded at once, the emacs client becomes unresponsive or the server responds with an error

[yuzhou721]

Describe the bug

Such as the title

To Reproduce

Steps to reproduce the behavior:
After setting up the directory, execute khoj--server-index-files

Screenshots

message buffer

khoj.el: Failed to update allcontent index. Status: http 400. Response: {"detail":"There was an error parsing the body"}
error in process sentinel: url-http-async-sentinel: Output file descriptor of app.khoj.dev is closed
error in process sentinel: Output file descriptor of app.khoj.dev is closed

Platform

• Server:
  • Cloud-Hosted (https://app.khoj.dev)
  • Self-Hosted Docker
  • Self-Hosted Python package
  • Self-Hosted source code
• Client:
  • Obsidian
  • Emacs
  • Desktop app
  • Web browser
  • WhatsApp
• OS:
  • Windows
  • macOS
  • Linux
  • Android
  • iOS

If self-hosted

• Server Version [e.g. 1.0.1]:

Additional context

Sending a lot of files with url.el doesn't seem very stable, could you change it to curl?
If possible I can submit a RP

[yuzhou721]

Found two issues:

1. File name encoding issue (Chinese characters in file names will cause errors on the backend)
2. Tried sending in batches, able to send all 20 at a time.