Differences
This shows you the differences between two versions of the page.
— | howto:updateencoding [2023/06/07 20:39] (current) – created - external edit 127.0.0.1 | ||
---|---|---|---|
Line 1: | Line 1: | ||
+ | ====== Update character encoding ====== | ||
+ | |||
+ | In update 150502 of RIMMF3, we added an utility named 'Data encoding updater' | ||
+ | |||
+ | {{: | ||
+ | |||
+ | This utility will convert diacritics in older RIMMF data (data created before Christmas, 2014; at this time, support for unicode code points was added RIMMF3) to use unicode code points. | ||
+ | |||
+ | This conversion is required if you want to use this data with [[: | ||
+ | |||
+ | If you do not have any older RIMMF data that you want to bring forward, or if it does not use diacritics, then you can ignore this note. | ||
+ | |||
+ | The 'Data encoding updater' | ||
+ | |||
+ | First it copies all of the records in the folder to a folder of the same name (with the suffix ' | ||
+ | |||
+ | Then loads it each file, checks it for diacritics, and if present, tries to convert them to unicode code points. The conversion should be 100% successful for the common Latin language diacritics. After that, however, there may be some data loss (these characters may be converted to the ' | ||
+ | |||
+ | Once the conversion is done (and it runs very quickly), the data folder is ready for unicode RIMMF; it does not need to be run again. | ||
+ | |||
+ | If you have multiple data folders, then you will need to go through the steps here for each one | ||
+ | |||
+ | - Go to Tools and select ' | ||
+ | - The EI will be indexed | ||
+ | - Go back to Tools and select 'Data encoding updater' | ||
+ | - The EI will be re-index | ||
+ | |||
+ | Its important to note that this utility cannot be run in ' | ||