Chinese character set issues during batch upload process #15
Description
The batch load process is not properly escaping non-UTF8 character sets. The process stops when it hits one of these records (e.g. if there are 20 records in the csv and the 4th one has a bad character, it processes the first 3 and stops on the 4th. This makes it easy to locate a bad URL because the message displays the successfully loaded records ... the first 3 in this example)
The character that sparked the issue is in the following URL (the character in the '/I?387' section):
http://www.apabi.com/uc/pub.mvc?pid=book.detail&metaid=5419-7554-0/I·387
The user is able to update the URL via the edit PID screen (see PID 176454). This however requires them to update on an individual basis making the process inconvenient.
The batch process should handle these URL values in the same way that the UI does.