CSV -> XLSX conversion fails with an error

[niryariv]

1. Uploaded CSV file, views correctly here
2. Attempting to upload to datastore via admin UI fails with a UnicodeEncodeError message:
   

[OriHoch]

duplicate of #213 explanation in this comment: #213 (comment)

[niryariv]

@OriHoch Since this happens when we do the conversion (users are instructed to avoid uploading XLS files) and it seems to break on specific characters like " (other files with Hebrew headers convert ok) is it possible to add some code that removes these characters from the header row before starting the XLSX conversion? How much work do you estimate?

[OriHoch]

I don't see how it is related to XLSX conversion, this is the bug as I understand it:

reproduction steps

• upload a csv file which contains special characters (like quotes) in a field name
• check resource view (example)
• check datastore upload log (example)

expected

• resource view page: shows green data api button and data dictionary displayed below the table
  
  
• upload log shows status completed

actual

• resource view page: no green data api button, data dictionary is not displayed below the table
  
  
• upload log shows status failed
  

[OriHoch]

I estimate 5-10 hours to fix the bug I described in previous comment