Pravin s glibc-unicode_and_cldr
1 like771 views
The document outlines the process of updating glibc localedata from Unicode 5.1 to Unicode 7.0, focusing on the challenges faced, such as lack of documentation and backward compatibility risks. It details the analysis and development steps taken to create a patch, including the use of scripts to compare data and generate reports. Collaboration among team members led to the successful submission of the patch to the upstream, with users receiving the update in Fedora 22 and other distributions.
Pravin s glibc-unicode_and_cldr
- 1. Glibc Unicode and CLDRGlibc Unicode and CLDR Pravin SatputePravin Satpute Senior Software EngineerSenior Software Engineer Globalization TeamGlobalization Team Red HatRed Hat
- 2. AgendaAgenda â What was the problem?What was the problem? â Why so?Why so? â How we resolved issue?How we resolved issue? â Analysis â Development â Getting patch into upstreamGetting patch into upstream â Question and AnswersQuestion and Answers
- 3. What was the problem?What was the problem?
- 4. What was the problem?What was the problem? â Updating Glibc localedata from Unicode 5.1 to Unicode 7.0 â /usr/share/i18n/locales/i18n (LC_CTYPE) â /usr/share/i18n/charmaps/UTF-8.gz
- 6. What were the issues?What were the issues? â No Documentation. â Risk of missing backward compatibility. â No expert.
- 7. How we resolved it?How we resolved it?
- 8. How we resolved it?How we resolved it? AnalysisAnalysis â Started gathering Changelog, Git logs for all changes happened over the time. Specific fixes. â Found hints, information written in Localedata files. â Comments on Bugzilla â Unicode source files providing raw information for Glibc Localedata â UnicodeData.txt â DerivedCoreProperties.txt â EastAsianWidth.txt
- 9. How we resolved it?How we resolved it? Started with LC_CTYPE (i18n)Started with LC_CTYPE (i18n) â Wrote script gen-unicode-ctype.py to update output generated from gen-unicode-ctype.c â Backward Compatiblity â This script was comparing existing data with newly generated and generating easy to understand report. â Later Mike modify gen-unicode-ctype.py to deprecate gen-unicode-ctype.c â Repeated same process for UTF-8 charmap and WIDTH.
- 10. Patch prepared whatPatch prepared what next?next?
- 11. Patch prepared what next?Patch prepared what next? â Later Mike Fabian stepped into it. â He reviewed scripts. Improved it. â Glibc upstream further improved it. â We proposed System wide change for Fedora 22
- 12. Patch prepared what next?Patch prepared what next? â Patch got committed in upstream Feb last week. â Collaborative work from Me, Mike Fabian, Alexandre Oliva supported by Carlos and Jens Petersen â Users will get this update through Fedora 22 and other upstream distros latest releases.
- 14. ReferencesReferences â https://github.com/pravins/glibc-i18n â https://sourceware.org/bugzilla/show_bug.cgi?id=14094 â https://fedoraproject.org/wiki/Changes/Glibc_Unicode_7 â https://sourceware.org/git/?p=glibc.git;a=commit;h=4a4839c94a4c 93ffc0d5b95c69a08b02a57007f2