8:04 p.m.
================================================================
Dear Bug Team!
I've been seeing a lot of ^Ms in the output of various processes
lately. It seems to happen when the process itself starts doing output
in UNIX EOL-style, but then launches subprocesses of its own that use
the DOS style. In particular, I've noticed it with MSYS make (running,
for example, native xemacs to do some autoload generation and/or
byte-compilation) and with some tex-related invocations.
(Inexplicably, sometimes it seems that the tex xemacs actually runs
uses UNIX style, but that has to run initex to generate a format file,
and initex uses the DOS style!??!)
The default process "input" coding system (used for input to emacs
from processes) is undecided, so I'm guessing that what happens is
something like:
1) eol detection code has no data to work with at all, so it says
"okay, I'll figure it out later".
2) some data comes in, with only UNIX-style eols, and the eol
detection code says "aha! unix!", and switches the process output
coding-system to a -unix variant
3) some more data comes in, this time with some DOS eols as well,
but since the eol detection code put us into a -unix coding sytem
already, it doesn't get run anymore, and we're stuck in -unix.
I'm experimenting with the following in my init file:
;; assume process output to use DOS line-end style
(setcar default-process-coding-system 'undecided-dos)
and that seems to work for this stuff, but I'm concerned that this
might run afoul of elisp programs trying to read binary data from
processes. Any thoughts?
================================================================
System Info to help track down your bug:
---------------------------------------
OS version:
Microsoft Windows XP [Version 5.1.2600]
OS: Windows_NT
XEmacs 21.5-b29 "garbanzo" configured for `i586-pc-win32'.
Building XEmacs using "nmake".
Building XEmacs using make flags " ".
Building XEmacs in source tree "C:\\XEmacsBuild\\xemacs-21.5.29".
For src, using compiler "cl -nologo -W3 -DSTRICT -Zi -Od -MD -c -TP
-IC:\XEmacsBuild\xemacs-21.5.29\nt\inc
-IC:\XEmacsBuild\xemacs-21.5.29\src
-I"C:/cygwin/usr/local/src\xpm-3.4k"
-I"C:/cygwin/usr/local/src\xpm-3.4k\lib"
-I"C:/cygwin/usr/local/src\libpng-1.2.8"
-I"C:/cygwin/usr/local/src/zlib"
-I"C:/cygwin/usr/local/src/tiff-3.7.3\libtiff"
-I"C:/cygwin/usr/local/src\jpeg-6b" -I"C:/cygwin/usr/local/src/zlib"
-DHAVE_MS_WINDOWS -DHAVE_MENUBARS -DHAVE_SCROLLBARS -DHAVE_TOOLBARS
-DHAVE_WIDGETS -DHAVE_DIALOGS -DHAVE_XPM -DFOR_MSW -DHAVE_GIF
-DHAVE_PNG -DHAVE_TIFF -DHAVE_JPEG -DHAVE_ZLIB -DHAVE_NATIVE_SOUND
-DMULE -DERROR_CHECK_ALL -DPDUMP -DSYSTEM_MALLOC -DDEBUG_XEMACS
-D_DEBUG -DWIN32_LEAN_AND_MEAN -DWIN32_NATIVE -Demacs
-DHAVE_CONFIG_H -DPATH_VERSION=\"21.5-b29\"
-DPATH_PROGNAME=\"xemacs\" -DEMACS_VERSION=\"21.5-b29\"
-DEMACS_PROGNAME=\"xemacs\" -DSHEBANG_PROGNAME=\"xemacs-script\"
-DSTACK_TRACE_EYE_CATCHER=xemacs_21_5_b29_i586_pc_win32
-DPATH_PREFIX=\""C:/XEmacsBuild/installed/XEmacs-21.5.29"\"
-DEMACS_MAJOR_VERSION=21 -DEMACS_MINOR_VERSION=5
-DEMACS_BETA_VERSION=29 -DXEMACS_CODENAME=\""garbanzo"\"
-DXEMACS_EXTRA_NAME=\"""\"
-DEMACS_CONFIGURATION=\"i586-pc-win32\"".
For lib-src, using compiler "cl -nologo -W3 -DSTRICT -Zi -Od -MD
-IC:\XEmacsBuild\xemacs-21.5.29\lib-src
-IC:\XEmacsBuild\xemacs-21.5.29\src -DHAVE_CONFIG_H -DWIN32_NATIVE".
Compiling as C++.
Installing XEmacs in "C:/XEmacsBuild/installed/XEmacs-21.5.29".
Compiling in support for Microsoft Windows native GUI.
Compiling in international (MULE) support.
Compiling in support for XPM images.
Compiling in support for GIF images.
Compiling in support for PNG images.
Compiling in support for TIFF images.
Compiling in support for JPEG images.
Compiling in support for GZIP compression/decompression.
Compiling in support for toolbars.
Compiling in support for dialogs.
Compiling in support for widgets.
Compiling in support for native sounds.
Using portable dumper.
Using system malloc.
Using DLL version of C runtime library.
Compiling in extra internal error-checking.
NOTE: ---------------------------------------------------------
NOTE: Compiling in support for runtime error-checking.
NOTE: XEmacs will run noticeably more slowly as a result.
NOTE: Error-checking is on by default for XEmacs beta releases.
NOTE: ---------------------------------------------------------
Compiling in debugging support (no slowdown).
Load-Path Lisp Shadows:
----------------------
(e:\XEmacs\site-packages\lisp\emacs-goodies-el\ctypes
e:\XEmacs\xemacs-packages\lisp\c-support\ctypes
e:\XEmacs\site-packages\lisp\emacs-goodies-el\setnu
e:\XEmacs\xemacs-packages\lisp\edit-utils\setnu
e:\XEmacs\xemacs-packages\lisp\cedet-common\working
e:\XEmacs\xemacs-packages\lisp\semantic\working
e:\XEmacs\xemacs-packages\lisp\cedet-common\sformat
e:\XEmacs\xemacs-packages\lisp\semantic\sformat
e:\XEmacs\site-packages\lisp\emacs-goodies-el\htmlize
e:\XEmacs\xemacs-packages\lisp\text-modes\htmlize
e:\XEmacs\site-packages\lisp\emacs-goodies-el\folding
e:\XEmacs\xemacs-packages\lisp\text-modes\folding
e:\XEmacs\site-packages\lisp\emacs-goodies-el\filladapt
e:\XEmacs\xemacs-packages\lisp\text-modes\filladapt
e:\XEmacs\site-packages\lisp\emacs-goodies-el\apache-mode
e:\XEmacs\xemacs-packages\lisp\text-modes\apache-mode
e:\XEmacs\site-packages\lisp\emacs-goodies-el\xrdb-mode
e:\XEmacs\xemacs-packages\lisp\text-modes\xrdb-mode
e:\XEmacs\mule-packages\lisp\mule-base\viet-util
e:\XEmacs\XEmacs-21.5.29\lisp\mule\viet-util
e:\XEmacs\mule-packages\lisp\mule-base\korea-util
e:\XEmacs\XEmacs-21.5.29\lisp\mule\korea-util
e:\XEmacs\mule-packages\lisp\mule-base\japan-util
e:\XEmacs\XEmacs-21.5.29\lisp\mule\japan-util
e:\XEmacs\mule-packages\lisp\mule-base\ethio-util
e:\XEmacs\XEmacs-21.5.29\lisp\mule\ethio-util
e:\XEmacs\mule-packages\lisp\mule-base\china-util
e:\XEmacs\XEmacs-21.5.29\lisp\mule\china-util
e:\XEmacs\xemacs-packages\lisp\xemacs-base\regexp-opt
e:\XEmacs\XEmacs-21.5.29\lisp\regexp-opt
e:\XEmacs\xemacs-packages\lisp\xemacs-base\easy-mmode
e:\XEmacs\XEmacs-21.5.29\lisp\easy-mmode
e:\XEmacs\xemacs-packages\lisp\build\build-report
e:\XEmacs\XEmacs-21.5.29\lisp\build-report
e:\XEmacs\xemacs-packages\lisp\apel\alist
e:\XEmacs\XEmacs-21.5.29\lisp\alist)
Internationalization Settings:
-------------------------
Environment:
Value of LC_ALL : nil
Value of LC_COLLATE : nil
Value of LC_CTYPE : nil
Value of LC_MESSAGES : nil
Value of LC_MONETARY : nil
Value of LC_NUMERIC : nil
Value of LC_TIME : nil
Value of LANG : nil
Lisp locale settings:
current-language-environment => "English"
default-buffer-file-coding-system => mswindows-multibyte-dos
default-process-coding-system => (undecided-dos .
mswindows-multibyte-system-default)
(current-locale) => "English_United States.1252"
keyboard-coding-system => mswindows-multibyte-system-default
terminal-coding-system => mswindows-multibyte-system-default
(coding-priority-list) =>
(iso-8-1 utf-16-little-endian-bom utf-16-bom utf-8-bom iso-7
no-conversion utf-8 iso-8-2 iso-8-designate iso-lock-shift
shift-jis big5 utf-16-little-endian utf-16 ucs-4)
Coding system aliases:
'native is aliased to
mswindows-multibyte-system-default-dos
'file-name is aliased to
mswindows-multibyte-system-default
'mswindows-multibyte-system-default is not a coding system alias
Installed XEmacs Packages:
-------------------------
(xslide ver: 1.09 upstream: 0.2.2)
(xemacs-devel ver: 1.8 upstream: No-Upstream-Ver)
(xemacs-base ver: 2.27 upstream: No-Upstream-Ver)
(w3 ver: 1.35 upstream: 4.0pre47)
(vm ver: 8.08 upstream: 8.0.12-devo)
(vc ver: 1.48 upstream: No-Upstream-Ver)
(tramp ver: 1.4 upstream: 2.0.56)
(tm ver: 1.39 upstream: No-Upstream-Ver)
(time ver: 1.14 upstream: 1.17)
(textools ver: 1.15 upstream: No-Upstream-Ver)
(text-modes ver: 1.98 upstream: No-Upstream-Ver)
(texinfo ver: 1.3 upstream: No-Upstream-Ver)
(supercite ver: 1.21 upstream: 3.55x3)
(speedbar ver: 1.29 upstream: 1.0pre4)
(sounds-wav ver: 1.12 upstream: No-Upstream-Ver)
(sieve ver: 1.18 upstream: No-Upstream-Ver)
(sh-script ver: 1.24 upstream: 2.0f)
(sgml ver: 1.11 upstream: No-Upstream-Ver)
(semantic ver: 1.21 upstream: 2.0pre4)
(sasl ver: 1.16 upstream: 1.14.4)
(rmail ver: 1.14 upstream: No-Upstream-Ver)
(reftex ver: 1.34 upstream: 4.21)
(psgml ver: 1.45 upstream: 1.3.2)
(ps-print ver: 1.12 upstream: 6.5.6)
(prog-modes ver: 2.2 upstream: No-Upstream-Ver)
(pgg ver: 1.07 upstream: 0.1)
(perl-modes ver: 1.14 upstream: No-Upstream-Ver)
(pcomplete ver: 1.06 upstream: 1.1.6)
(pcl-cvs ver: 1.7 upstream: R-2_9_9)
(pc ver: 1.28 upstream: No-Upstream-Ver)
(os-utils ver: 1.41 upstream: No-Upstream-Ver)
(net-utils ver: 1.56 upstream: N/A)
(mmm-mode ver: 1.05 upstream: 0.4.8)
(misc-games ver: 1.22 upstream: No-Upstream-Ver)
(mine ver: 1.16 upstream: 1.9)
(mailcrypt ver: 2.14 upstream: 3.5.8)
(mail-lib ver: 1.8 upstream: No-Upstream-Ver)
(ispell ver: 1.32 upstream: 3.6)
(ilisp ver: 1.36 upstream: 5.12.0)
(igrep ver: 1.16 upstream: 2.111)
(gnus ver: 1.94 upstream: 5.10.8)
(gnats ver: 1.17 upstream: 3.101)
(general-docs ver: 1.06 upstream: No-Upstream-Ver)
(games ver: 1.2 upstream: 2.00)
(fsf-compat ver: 1.19 upstream: No-Upstream-Ver)
(footnote ver: 1.16 upstream: 0.18x)
(eterm ver: 1.18 upstream: No-Upstream-Ver)
(eshell ver: 1.18 upstream: 0fc80a3f6bb3bb59f42e9ff83cc8b89bf90fe658)
(emerge ver: 1.11 upstream: No-Upstream-Ver)
(elib ver: 1.13 upstream: 1.0)
(eieio ver: 1.07 upstream: 1.0pre4)
(efs ver: 1.34 upstream: 1.24)
(edit-utils ver: 2.43 upstream: No-Upstream-Ver)
(ediff ver: 1.81 upstream: 2.75)
(edebug ver: 1.22 upstream: No-Upstream-Ver)
(ede ver: 1.03 upstream: 1.0pre4)
(ecrypto ver: 0.21 upstream: 2.0)
(ecb ver: 1.22 upstream: 2.31)
(easypg ver: 1.03 upstream: 0.0.16)
(dired ver: 1.2 upstream: 7.17)
(dictionary ver: 1.16 upstream: 1.8)
(debug ver: 1.18 upstream: No-Upstream-Ver)
(crisp ver: 1.15 upstream: 1.34)
(cookie ver: 1.15 upstream: No-Upstream-Ver)
(cedet-common ver: 1.01 upstream: 1.0pre4)
(cc-mode ver: 1.45 upstream: 5.30.10)
(calendar ver: 1.38 upstream: No-Upstream-Ver)
(calc ver: 1.26 upstream: 2.02fX3)
(c-support ver: 1.22 upstream: No-Upstream-Ver)
(build ver: 1.15 upstream: 2.02)
(bbdb ver: 1.32 upstream: 2.35)
(auctex ver: 1.51 upstream: 11.84)
(apel ver: 1.34 upstream: 10.7)
(mule-base ver: 1.56 upstream: No-Upstream-Ver)
(leim ver: 1.31 upstream: No-Upstream-Ver)
(latin-unity ver: 1.2 upstream: 1.20)
(latin-euro-standards ver: 1.09 upstream: 1.09)
Features:
--------
(mail-abbrevs xemacsbug shadow sendmail rfc822 efs-cu info view-less
view hyper-apropos mwheel compile timer-funcs lazy-lock font-lock
cus-face paren blink-paren tex-mik regexp-opt jka-compr
xslide-autoloads xemacs-devel-autoloads xemacs-base-autoloads
w3-autoloads vm-autoloads vc-autoloads tramp-autoloads tm-autoloads
time-autoloads textools-autoloads text-modes-autoloads
texinfo-autoloads supercite-autoloads speedbar-autoloads
sounds-wav-autoloads sieve-autoloads sh-script-autoloads
sgml-autoloads semantic-autoloads sasl-autoloads rmail-autoloads
reftex-autoloads psgml-autoloads ps-print-autoloads
prog-modes-autoloads pgg-autoloads perl-modes-autoloads
pcomplete-autoloads pcl-cvs-autoloads pc-autoloads os-utils-autoloads
net-utils-autoloads mmm-mode-autoloads misc-games-autoloads
mine-autoloads mailcrypt-autoloads mail-lib-autoloads ispell-autoloads
ilisp-autoloads igrep-autoloads gnus-autoloads gnats-autoloads
general-docs-autoloads games-autoloads fsf-compat-autoloads
footnote-autoloads eterm-autoloads eshell-autoloads emerge-autoloads
elib-autoloads eieio-autoloads efs-autoloads edit-utils-autoloads
ediff-autoloads edebug-autoloads ede-autoloads ecrypto-autoloads
ecb-autoloads easypg-autoloads dired-autoloads dictionary-autoloads
debug-autoloads crisp-autoloads cookie-autoloads
cedet-common-autoloads cc-mode-autoloads calendar-autoloads
calc-autoloads c-support-autoloads build-autoloads bbdb-autoloads
tex-site auctex-autoloads apel-autoloads mule-base-autoloads
leim-autoloads latin-unity-autoloads latin-euro-standards-autoloads
emacs-goodies-el emacs-goodies-custom emacs-goodies-loaddefs
mule-autoloads auto-autoloads auto-show fontl-hooks canna-leim tibetan
slovenian czech romanian lao devanagari indian cyrillic code-cmds
gutter-items menubar-items x-menubar dragdrop mode-motion mouse
behavior itimer auto-save lisp-mode easymenu easy-mmode iso8859-1 page
buff-menu lib-complete loadhist cus-file derived newcomment
rsz-minibuf env text-props frame obsolete cus-start custom widget
cl-extra cl cl-19 packages backquote unicode mswindows-scrollbars
mswindows toolbar native-sound scrollbar network-streams subprocesses
menu-accelerator-support menubar md5 xemacs mule gutter tiff png gif
jpeg xpm xbm lisp-float-type file-coding dde windows-nt dragdrop-api
dialog devices window-system base64)
_______________________________________________
XEmacs-Beta mailing list
XEmacs-Beta(a)xemacs.org
http://lists.xemacs.org/mailman/listinfo/xemacs-beta
7:11 a.m.
Samuel Bronson writes:
I've been seeing a lot of ^Ms in the output of various processes
lately.
There was a bunch of work done trying to update comint to work with
more recent gdb and gud front-ends for XEmacs. Unfortunately, it
didn't work well and bunches of stuff got reverted.
I think the long-run solution is a "universal eol" eol type a la
Python. (There's also a Unicode TR that has something to say about
this.)
I'm experimenting with the following in my init file:
;; assume process output to use DOS line-end style
(setcar default-process-coding-system 'undecided-dos)
This probably also works, although you'll likely get stair-stepping
when you actually do work with Unix-style line endings.
and that seems to work for this stuff, but I'm concerned that
this
might run afoul of elisp programs trying to read binary data from
processes. Any thoughts?
Programs trying to read binary data had better specify it with
'binary. If you run into a problem with binary I/O because of your
default setting, that's a bug in the program, not in your config.
If you have some applications where you're unwilling to risk data loss
even if you're entirely justified in changing the default, be specific
and we can audit them or you can test them.
_______________________________________________
XEmacs-Beta mailing list
XEmacs-Beta(a)xemacs.org
http://lists.xemacs.org/mailman/listinfo/xemacs-beta
5:35 p.m.
On Mon, Oct 11, 2010 at 2:11 AM, Stephen J. Turnbull <stephen(a)xemacs.org> wrote:
Samuel Bronson writes:
> I've been seeing a lot of ^Ms in the output of various processes
> lately.
There was a bunch of work done trying to update comint to work with
more recent gdb and gud front-ends for XEmacs. Unfortunately, it
didn't work well and bunches of stuff got reverted.
I think the long-run solution is a "universal eol" eol type a la
Python. (There's also a Unicode TR that has something to say about
this.)
> I'm experimenting with the following in my init file:
>
> ;; assume process output to use DOS line-end style
> (setcar default-process-coding-system 'undecided-dos)
This probably also works, although you'll likely get stair-stepping
when you actually do work with Unix-style line endings.
That's not what I'm seeing -- does [X]Emacs even support
stair-stepping, outside of eterm?
What I'm seeing is basically the same as Python's universal newline
decoding (though I haven't exactly tried injecting Mac-style CR-only
text). Which is kind of what I expected. Really, the only app I can
think of that actually gets confused by LF-only text is notepad, which
displays some meaningless glyph for an LF (the dreaded box, perhaps?)
that has no preceding CR. All the other problems that I've seen with
that are related to terminal emulation, printing, or spurious
differences (i.e. diffing files of different eol styles that are
otherwise nearly identical).
> and that seems to work for this stuff, but I'm concerned
that this
> might run afoul of elisp programs trying to read binary data from
> processes. Any thoughts?
Programs trying to read binary data had better specify it with
'binary. If you run into a problem with binary I/O because of your
default setting, that's a bug in the program, not in your config.
Okay, that's very reassuring.
If you have some applications where you're unwilling to risk data
loss
even if you're entirely justified in changing the default, be specific
and we can audit them or you can test them.
Not at all! I was just not sure how well-behaved most code is in this
respect. (I know I myself have been guilty of leaving out the "b" far
too often in my C and Python programs, just because I was on *nix and,
presumably was either not thinking about the issue or was thinking
"nah, this is just for me and why would I be on Windows?")
Given what you've said, and that my setting doesn't seem to hurt with
LF-only process output, maybe the default should be changed on
Windows, or there should be a customize option or FAQ entry or similar
about this?
I don't really expect it makes all that much difference on Mac
anymore, since I that would probably only be relevant on classic and
... does that even have a standard API for commandline programs?
(Anyway, I assume those users have probably already figured out what
to do?)
Thanks,
-- Sam
_______________________________________________
XEmacs-Beta mailing list
XEmacs-Beta(a)xemacs.org
http://lists.xemacs.org/mailman/listinfo/xemacs-beta
5156
days inactive
5158
days old
2 comments
2 participants
participants (2)
-
Samuel Bronson -
Stephen J. Turnbull