Improved character set handling

Tuesday, April 25. 2006

Improved character set handling

Topicalizer now detects and displays custom document character sets, where before it simply assumed everything to be ISO-8859-1 or UTF-8. If no custom character set is detected or if plain text is submitted, UTF-8 is used instead.
This improved behaviour regarding character sets leads to an improvement concerning automatic language recognition and the overall analysis as well, especially for languages that contain many special characters like for instance, Norse languages or Russian.

Posted by Björn Wilmsmann in Topicalizer at 12:02 | Comments (0) | Trackbacks (4)

Trackbacks

Trackback specific URI for this entry

buy acyclovir
buy acyclovir Q: How many mathematicians does it take to screw in a light bulb? A: One. He gives it to six Californians, thereby reducing the problem to the earlier joke.

Weblog: buy acyclovir
Tracked: Jun 15, 03:01

frog ringtone
frog ringtone Q: What do you call a half-dozen Indians with Asian flu? A: Six sick Sikhs (sic).

Weblog: frog ringtone
Tracked: Jun 18, 00:02

ride on toys
ride on toys ride on toys - ride on toys Q: What's the difference between a Mac and an Etch-a-Sketch? A: You don't have to shake the Mac to clear the screen. Look afar and see the end from the beginning.

Weblog: ride on toys
Tracked: Jun 21, 16:25

forex mhv
forex mhv forex mhv - forex mhv Q: What do you call a blind, deaf-mute, quadraplegic Virginian? A: Trustworthy. You love peace.

Weblog: forex mhv
Tracked: Jun 23, 23:04

Comments

Display comments as (Linear | Threaded)

No comments

Add Comment

Name
Email
Homepage
In reply to
Comment	Enclosing asterisks marks text as bold (word), underscore are made via _word_. Standard emoticons like :-) and ;-) are converted to images. To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly. Enter the string from the spam-prevention image above:
	Remember Information? Subscribe to this entry