[Bug: 21.4.15] UTF-8 input in console tty
19 years, 6 months
Jarl Friis
================================================================
Dear Bug Team!
When I use XEmacs on console tty, then entering UTF-8 characters does
not get right, they (3 danish letters) end up as two double bytes
characters each. First let me tell you what does work: Everything
works perfect when starting XEmacs in graphical mode. In Entering
UTF-8 characters in the console itself works, they become one
doulbe-byte character (tested with `cat > console.txt`, entering utf-8
chars and used `hexdump test.txt` to verify the encoding. Viewing
UTF-8 encoded files in XEmacs (console tty mode) also works allright,
but entering them in XEmacs without X seem to generate 4 bytes per
character (two double-byte), which displays as two characters, the six
bytes on the next line is entered as æøå[1]
ÊÞå
I have found following info on WWW, but still I consider it a bug in
XEmacs: http://www.maruko.ca/i18n/
If you need any further information, please contact me on
jarl(a)softace.dk (I am not on the mailing list)
[1] The letters at the anchor of this footnote are inserted with
copy-paste from another buffer being UTF8-encoded.
Jarl
================================================================
System Info to help track down your bug:
---------------------------------------
uname -a: Linux mozart 2.6.8.1 #1 SMP Wed Dec 1 14:42:08 UTC 2004 i686 i686 i386 GNU/Linux
./configure 'i386-suse-linux' '--with-gcc' '--dynamic' '--rel-alloc' '--debug=no' '--error-checking=none' '--cflags=-O2 -march=i586 -mcpu=i686 -fmessage-length=0 -Wall -Wall -Wno-switch -pipe -O2 -march=i586 -mcpu=i686 -fmessage-length=0 -Wall -fno-strict-aliasing' '--ldflags=-s' '--prefix=/usr' '--exec-prefix=/usr' '--bindir=/usr/X11R6/bin' '--datadir=/usr/share' '--archlibdir=/usr/lib/xemacs/21.4.15/i386-suse-linux' '--docdir=/usr/lib/xemacs/21.4.15/i386-suse-linux' '--lispdir=/usr/share/xemacs/21.4.15/lisp' '--pkgdir=/usr/share/xemacs/21.4.15/lisp' '--etcdir=/usr/share/xemacs/21.4.15/etc' '--statedir=/var/lib/xemacs' '--moduledir=/usr/lib/xemacs/21.4.15/i386-suse-linux/modules' '--infodir=/usr/share/xemacs/info' '--mandir=/usr/share/man/man1' '--with-database=gnudbm,berkdb' '--with-ncurses' '--with-tty=yes' '--with-site-lisp' '--with-sound=native' '--with-gpm' '--pdump' '--with-xpm' '--with-gif' '--with-tiff' '--with-jpeg' '--with-png' '--with-x' '--with-athena=3d' '--wit
h-menubars=lucid' '--with-scrollbars=lucid' '--with-dialogs=athena' '--with-widgets=athena' '--x-includes=/usr/X11R6/include' '--x-libraries=/usr/X11R6/lib' '--with-mule' '--with-xim=xlib' '--with-xfs' '--with-clash-detection' '--with-ldap' '--with-pop'
XEmacs 21.4.15 "Security Through Obscurity" configured for `i386-suse-linux'.
Compilation / Installation:
Source code location: /usr/src/packages/BUILD/xemacs-21.4.15
Installation prefix: /usr
Operating system description file: `s/linux.h'
Machine description file: `m/intel386.h'
Compiler: gcc -O2 -march=i586 -mcpu=i686 -fmessage-length=0 -Wall -Wall -Wno-switch -pipe -O2 -march=i586 -mcpu=i686 -fmessage-length=0 -Wall -fno-strict-aliasing
Compiler version: gcc (GCC) 3.3.4 (pre 3.3.5 20040809)
Compiler specs file: /usr/lib/gcc-lib/i586-suse-linux/3.3.4/specs
Relocating allocator for buffers: yes
GNU version of malloc: yes
- Using Doug Lea's new malloc from the GNU C Library.
Need to guess glibc1/2/etc here
Window System:
Compiling in support for the X window system:
- X Windows headers location: /usr/X11R6/include
- X Windows libraries location: /usr/X11R6/lib
- Handling WM_COMMAND properly.
Compiling in support for the Athena widget set:
- Athena headers location: X11/Xaw3d
- Athena library to link: Xaw3d
Using Lucid menubars.
Using Lucid scrollbars.
Using Athena dialog boxes.
Using Athena native widgets.
TTY:
Compiling in support for ncurses.
Compiling in support for GPM (General Purpose Mouse).
Images:
Compiling in support for GIF images (builtin).
Compiling in support for XPM images.
Compiling in support for PNG images.
Compiling in support for JPEG images.
Compiling in support for TIFF images.
Compiling in support for X-Face message headers.
Sound:
Compiling in support for sound (native).
Databases:
Compiling in support for Berkeley database.
Compiling in support for GNU DBM.
Compiling in support for LDAP.
Internationalization:
Compiling in support for Mule (multi-lingual Emacs).
Compiling in support for XIM (X11R5+ I18N input method).
- Using raw Xlib to provide XIM support.
- Using XFontSet to provide bilingual menubar.
Compiling in support for Canna on Mule.
Compiling in support for the WNN input method on Mule.
Mail:
Compiling in support for POP mail retrieval.
Compiling in support for "dot-locking" mail spool file locking method.
Other Features:
Inhibiting IPv6 canonicalization at startup.
Compiling in support for dynamic shared object modules.
Using the new portable dumper.
Load-Path Lisp Shadows:
----------------------
(/usr/share/xemacs/xemacs-packages/lisp/build/build-report
/usr/share/xemacs/21.4.15/lisp/build-report
/usr/share/xemacs/21.4.15/lisp/mwheel /home/jarl/elisp/mwheel
/usr/share/xemacs/mule-packages/lisp/mule-base/char-table
/home/jarl/elisp/char-table
/usr/share/xemacs/xemacs-packages/lisp/gnus/vcard
/home/jarl/elisp/vcard)
Installed XEmacs Packages:
-------------------------
(zenirc ver: 1.15 upstream: 2.112)
(xslt-process ver: 1.11 upstream: 1.2.1)
(xslide ver: 1.09 upstream: 0.2.2)
(xemacs-devel ver: 1.61 upstream: No-Upstream-Ver)
(xemacs-base ver: 1.84 upstream: No-Upstream-Ver)
(x-symbol ver: 1.09 upstream: 4.5.1)
(w3 ver: 1.29 upstream: 4.0pre47)
(vm ver: 7.18 upstream: 7.17)
(viper ver: 1.37 upstream: 3.09)
(view-process ver: 1.13 upstream: 2.4)
(vhdl ver: 1.18 upstream: 3.31.20)
(vc-cc ver: 1.22 upstream: No-Upstream-Ver)
(vc ver: 1.38 upstream: No-Upstream-Ver)
(tramp ver: 1.17 upstream: 2.0.35)
(tpu ver: 1.14 upstream: 4.2X)
(tooltalk ver: 1.15 upstream: No-Upstream-Ver)
(tm ver: 1.37 upstream: No-Upstream-Ver)
(time ver: 1.14 upstream: 1.17)
(textools ver: 1.15 upstream: No-Upstream-Ver)
(text-modes ver: 1.73 upstream: No-Upstream-Ver)
(texinfo ver: 1.25 upstream: No-Upstream-Ver)
(supercite ver: 1.2 upstream: 3.55x3)
(strokes ver: 1.1 upstream: No-Upstream-Ver)
(speedbar ver: 1.27 upstream: 0.14beta4)
(sounds-wav ver: 1.12 upstream: No-Upstream-Ver)
(sounds-au ver: 1.12 upstream: No-Upstream-Ver)
(sml-mode ver: 0.11 upstream: 3.9.5)
(slider ver: 1.15 upstream: 0.3x1)
(sieve ver: 1.15 upstream: No-Upstream-Ver)
(sh-script ver: 1.18 upstream: 2.0e)
(sgml ver: 1.11 upstream: No-Upstream-Ver)
(semantic ver: 1.18 upstream: 1.4.2)
(scheme ver: 1.14 upstream: No-Upstream-Ver)
(sasl ver: 1.14 upstream: 1.14.4)
(ruby-modes ver: 1.02 upstream: 1.6.8)
(rmail ver: 1.14 upstream: No-Upstream-Ver)
(riece ver: 1.14 upstream: 0.1.7)
(reftex ver: 1.33 upstream: 4.21)
(python-modes ver: 1.03 upstream: No-Upstream-Ver)
(psgml-dtds ver: 1.03 upstream: No-Upstream-Ver)
(psgml ver: 1.42 upstream: 1.3.1)
(ps-print ver: 1.09 upstream: 6.5.6)
(prog-modes ver: 1.94 upstream: No-Upstream-Ver)
(pgg ver: 1.04 upstream: 0.1)
(perl-modes ver: 1.05 upstream: No-Upstream-Ver)
(pcomplete ver: 1.03 upstream: 1.1.6)
(pcl-cvs ver: 1.65 upstream: R-2_9_9)
(pc ver: 1.26 upstream: No-Upstream-Ver)
(os-utils ver: 1.35 upstream: No-Upstream-Ver)
(ocaml ver: 0.05 upstream: 3.06)
(net-utils ver: 1.38 upstream: N/A)
(mmm-mode ver: 1.01 upstream: 0.4.7)
(misc-games ver: 1.18 upstream: No-Upstream-Ver)
(mine ver: 1.16 upstream: 1.9)
(mh-e ver: 1.28 upstream: 7.4.2)
(mew ver: 1.18 upstream: 1.94.2)
(mailcrypt ver: 2.14 upstream: 3.5.8)
(mail-lib ver: 1.64 upstream: No-Upstream-Ver)
(liece ver: 1.13 upstream: 1.4.9)
(jde ver: 1.46 upstream: 2.3.2)
(ispell ver: 1.29 upstream: 3.6)
(ilisp ver: 1.33 upstream: 5.12.0)
(igrep ver: 1.12 upstream: 2.95)
(idlwave ver: 1.31 upstream: 5.1)
(ibuffer ver: 1.09 upstream: No-Upstream-Ver)
(hm--html-menus ver: 1.23 upstream: 5.9)
(haskell-mode ver: 1.06 upstream: 1.44)
(gnus ver: 1.79 upstream: 5.10.6)
(gnats ver: 1.16 upstream: 3.101)
(general-docs ver: 1.01 upstream: No-Upstream-Ver)
(games ver: 1.15 upstream: 1.04)
(fsf-compat ver: 1.14 upstream: No-Upstream-Ver)
(frame-icon ver: 1.11 upstream: No-Upstream-Ver)
(fortran-modes ver: 1.03 upstream: No-Upstream-Ver)
(forms ver: 1.15 upstream: 2.37)
(footnote ver: 1.16 upstream: 0.18x)
(eudc ver: 1.39 upstream: 1.32)
(eterm ver: 1.15 upstream: No-Upstream-Ver)
(ess ver: 1.07 upstream: 5.1.21)
(eshell ver: 1.06 upstream: 2.4.1)
(erc ver: 0.05 upstream: Version 4.0 Revision: 1.608)
(emerge ver: 1.11 upstream: No-Upstream-Ver)
(elib ver: 1.11 upstream: 1.0)
(eieio ver: 1.05 upstream: 0.17)
(efs ver: 1.32 upstream: 1.22)
(edt ver: 1.13 upstream: No-Upstream-Ver)
(edit-utils ver: 2.11 upstream: No-Upstream-Ver)
(ediff ver: 1.49 upstream: 2.75)
(edebug ver: 1.2 upstream: No-Upstream-Ver)
(ecrypto ver: 0.16 upstream: 2.0)
(ecb ver: 1.14 upstream: 2.11)
(docbookide ver: 0.07000000000000001 upstream: 0.1)
(dired ver: 1.15 upstream: 7.11)
(dictionary ver: 1.12 upstream: 1.8)
(debug ver: 1.17 upstream: No-Upstream-Ver)
(crisp ver: 1.14 upstream: 1.34)
(cookie ver: 1.15 upstream: No-Upstream-Ver)
(clearcase ver: 1.08 upstream: No-Upstream-Ver)
(cc-mode ver: 1.42 upstream: 5.30.8)
(calendar ver: 1.23 upstream: No-Upstream-Ver)
(calc ver: 1.24 upstream: 2.02fX3)
(c-support ver: 1.19 upstream: No-Upstream-Ver)
(build ver: 1.14 upstream: 2.02)
(bbdb ver: 1.24 upstream: 2.34)
(auctex ver: 1.36 upstream: 11.13)
(apel ver: 1.27 upstream: 10.2)
(ada ver: 1.14 upstream: 2.27)
(Sun ver: 1.15 upstream: No-Upstream-Ver)
(skk ver: 1.23 upstream: 10.62a)
(mule-ucs ver: 1.05 upstream: 0.84)
(mule-base ver: 1.46 upstream: No-Upstream-Ver)
(lookup ver: 1.14 upstream: 1.0)
(locale ver: 1.21 upstream: No-Upstream-Ver)
(leim ver: 1.22 upstream: No-Upstream-Ver)
(latin-unity ver: 1.09 upstream: 1.09)
(egg-its ver: 1.27 upstream: No-Upstream-Ver)
(edict ver: 1.16 upstream: 0.9.9)
Installed Modules:
-----------------
Features:
--------
(xemacsbug shadow smtpmail sort gnus-cite smiley annotations mail-extr
gnus-bcklg gnus-async gnus-dup hexl time-stamp gnus-ml gnus-topic
nnfolder pop3 env byte-optimize bytecomp byte-compile nnml nndraft
nnmh efs-cu gnus-agent gnus-srvr gnus-score score-mode nnvirtual
gnus-msg gnus-art mm-uu mml2015 pgg pgg-parse pgg-def mm-view gnus-sum
gnus-group gnus-undo nntp nnoo nnmail mail-source format-spec
gnus-cache gnus-start gnus-spec gnus-int gnus-range message mml
mml-sec mml-smime smime dig mm-decode mm-bodies mm-encode mailcap lpr
mail-parse rfc2045 rfc2231 rfc2047 qp ietf-drums mail-abbrevs sendmail
rfc822 mailheader canlock gnus-win gnus gnus-ems gnus-xmas messagexmas
nnheader nnheaderxm gnus-util netrc time-date parse-time mail-utils
mm-util mail-prsvr wid-edit bbdb timezone esms esms-conf esms-ssp-funs
time-functions dansk code-conversion tempo w3-cus url mm mule-sysdp
url-parse url-vars xml-parse doxymacs ansi-color mwheel vc ring
vc-hooks font-lock tex-site pcl-cvs diff-mode advice advice-preload
pcl-cvs-parse pcl-cvs-info pcl-cvs-defs pcl-cvs-util cvs-compat
dired-faces dired-xemacs dired cookie dll elib-node time cus-face
rsz-minibuf un-define mule-uni latin-euro-input quail overlay
latin-unity-tables latin-unity-latin10 latin-unity-latin9
latin-unity-latin8 latin-unity-latin7 latin-unity-vars latin-unity
ispell zenirc-autoloads xslt-process-autoloads xslide-autoloads
xemacs-devel-autoloads xemacs-base-autoloads x-symbol-autoloads
w3-autoloads vm-autoloads viper-autoloads view-process-autoloads
vhdl-autoloads vc-cc-autoloads vc-autoloads tramp-autoloads
tpu-autoloads tooltalk-autoloads tm-autoloads time-autoloads
textools-autoloads text-modes-autoloads texinfo-autoloads
supercite-autoloads strokes-autoloads speedbar-autoloads
sounds-wav-autoloads sounds-au-autoloads sml-mode-autoloads
slider-autoloads sieve-autoloads sh-script-autoloads sgml-autoloads
semantic-autoloads scheme-autoloads sasl-autoloads
ruby-modes-autoloads rmail-autoloads riece-autoloads reftex-autoloads
python-modes-autoloads psgml-dtds-autoloads psgml-autoloads
ps-print-autoloads prog-modes-autoloads pgg-autoloads
perl-modes-autoloads pcomplete-autoloads pcl-cvs-autoloads
pc-autoloads os-utils-autoloads ocaml-autoloads net-utils-autoloads
mmm-mode-autoloads misc-games-autoloads mine-autoloads mh-e-autoloads
mew-autoloads mailcrypt-autoloads mail-lib-autoloads liece-autoloads
jde-autoloads ispell-autoloads ilisp-autoloads igrep-autoloads
idlwave-autoloads ibuffer-autoloads hm--html-menus-autoloads
haskell-mode-autoloads gnus-autoloads gnats-autoloads
general-docs-autoloads games-autoloads fsf-compat-autoloads
frame-icon-autoloads fortran-modes-autoloads forms-autoloads
footnote-autoloads eudc-autoloads eterm-autoloads ess-autoloads
eshell-autoloads erc-autoloads emerge-autoloads elib-autoloads
eieio-autoloads efs-autoloads edt-autoloads edit-utils-autoloads
ediff-autoloads ediff-hook edebug-autoloads ecrypto-autoloads
ecb-autoloads docbookide-autoloads dired-autoloads
dictionary-autoloads debug-autoloads crisp-autoloads cookie-autoloads
clearcase-autoloads cc-mode-autoloads calendar-autoloads
calc-autoloads c-support-autoloads build-autoloads bbdb-autoloads
auctex-autoloads apel-autoloads ada-autoloads Sun-autoloads
skk-autoloads mule-ucs-autoloads mule-base-autoloads lookup-autoloads
locale-autoloads leim-autoloads latin-unity-autoloads
egg-its-autoloads edict-autoloads lisp-autoloads disp-table loadhist
auto-show fontl-hooks x-iso8859-1 canna-leim slovenian czech romanian
ccl mule-help code-cmds gutter-items menubar-items x-menubar
mode-motion mouse itimer auto-save lisp-mode easymenu iso8859-1 page
buff-menu lib-complete cus-file derived frame text-props obsolete
cus-start custom widget cl-extra mini-cl cl cl-19 packages backquote
very-early-lisp CANNA file-coding wnn mule lucid-scrollbars cut-buffer
lucid-menubars athena-dialogs x c-balloon-help tty-frames tty toolbar
native-sound scrollbar unix-processes multicast network-streams
subprocesses modules menu-accelerator-support menubar berkeley-db dbm
md5 xemacs xim i18n2 gutter tiff png gif jpeg xface xpm xbm
lisp-float-type linux dialog devices window-system base64)
Recent keystrokes:
-----------------
B ESC O B ESC O B ESC O B ESC O B ESC O B ESC O B ESC
O B ESC O B ESC O B ESC O B ESC O B ESC O B ESC O B
ESC O B ESC O B C-s x e m C-a RET q ESC O A ESC x b
u TAB BS BS x e m TAB b u TAB BS BS r e TAB p TAB BS
BS BS TAB BS BS BS BS BS BS BS r e p o TAB r t TAB
x e TAB RET
Recent messages (most recent first):
-----------------------------------
Loading xemacsbug...done
Loading xemacsbug...
Making completion list...
Making completion list...
Making completion list...
No more unread articles
Generating summary...done
Generating summary...
Scoring...done
Scoring...
Fetching headers for nnml+softace:XEmacs development...done
Fetching headers for nnml+softace:XEmacs development...
Retrieving newsgroup: nnml+softace:XEmacs development...
Generating summary...done
Generating summary...
Fetching headers for nnml+softace:Eicq development...done
Fetching headers for nnml+softace:Eicq development...
Retrieving newsgroup: nnml+softace:Eicq development...
Sending...done
Wrote /home/jarl/Mail-softace/sent-mail/all