[Bug: 21.5-b29] eol handling for process output on windows

================================================================ Dear Bug Team! I've been seeing a lot of ^Ms in the output of various processes lately. It seems to happen when the process itself starts doing output in UNIX EOL-style, but then launches subprocesses of its own that use the DOS style. In particular, I've noticed it with MSYS make (running, for example, native xemacs to do some autoload generation and/or byte-compilation) and with some tex-related invocations. (Inexplicably, sometimes it seems that the tex xemacs actually runs uses UNIX style, but that has to run initex to generate a format file, and initex uses the DOS style!??!) The default process "input" coding system (used for input to emacs from processes) is undecided, so I'm guessing that what happens is something like: 1) eol detection code has no data to work with at all, so it says "okay, I'll figure it out later". 2) some data comes in, with only UNIX-style eols, and the eol detection code says "aha! unix!", and switches the process output coding-system to a -unix variant 3) some more data comes in, this time with some DOS eols as well, but since the eol detection code put us into a -unix coding sytem already, it doesn't get run anymore, and we're stuck in -unix. I'm experimenting with the following in my init file: ;; assume process output to use DOS line-end style (setcar default-process-coding-system 'undecided-dos) and that seems to work for this stuff, but I'm concerned that this might run afoul of elisp programs trying to read binary data from processes. Any thoughts? ================================================================ System Info to help track down your bug: --------------------------------------- OS version: Microsoft Windows XP [Version 5.1.2600] OS: Windows_NT XEmacs 21.5-b29 "garbanzo" configured for `i586-pc-win32'. Building XEmacs using "nmake". Building XEmacs using make flags " ". Building XEmacs in source tree "C:\\XEmacsBuild\\xemacs-21.5.29". For src, using compiler "cl -nologo -W3 -DSTRICT -Zi -Od -MD -c -TP -IC:\XEmacsBuild\xemacs-21.5.29\nt\inc -IC:\XEmacsBuild\xemacs-21.5.29\src -I"C:/cygwin/usr/local/src\xpm-3.4k" -I"C:/cygwin/usr/local/src\xpm-3.4k\lib" -I"C:/cygwin/usr/local/src\libpng-1.2.8" -I"C:/cygwin/usr/local/src/zlib" -I"C:/cygwin/usr/local/src/tiff-3.7.3\libtiff" -I"C:/cygwin/usr/local/src\jpeg-6b" -I"C:/cygwin/usr/local/src/zlib" -DHAVE_MS_WINDOWS -DHAVE_MENUBARS -DHAVE_SCROLLBARS -DHAVE_TOOLBARS -DHAVE_WIDGETS -DHAVE_DIALOGS -DHAVE_XPM -DFOR_MSW -DHAVE_GIF -DHAVE_PNG -DHAVE_TIFF -DHAVE_JPEG -DHAVE_ZLIB -DHAVE_NATIVE_SOUND -DMULE -DERROR_CHECK_ALL -DPDUMP -DSYSTEM_MALLOC -DDEBUG_XEMACS -D_DEBUG -DWIN32_LEAN_AND_MEAN -DWIN32_NATIVE -Demacs -DHAVE_CONFIG_H -DPATH_VERSION=\"21.5-b29\" -DPATH_PROGNAME=\"xemacs\" -DEMACS_VERSION=\"21.5-b29\" -DEMACS_PROGNAME=\"xemacs\" -DSHEBANG_PROGNAME=\"xemacs-script\" -DSTACK_TRACE_EYE_CATCHER=xemacs_21_5_b29_i586_pc_win32 -DPATH_PREFIX=\""C:/XEmacsBuild/installed/XEmacs-21.5.29"\" -DEMACS_MAJOR_VERSION=21 -DEMACS_MINOR_VERSION=5 -DEMACS_BETA_VERSION=29 -DXEMACS_CODENAME=\""garbanzo"\" -DXEMACS_EXTRA_NAME=\"""\" -DEMACS_CONFIGURATION=\"i586-pc-win32\"". For lib-src, using compiler "cl -nologo -W3 -DSTRICT -Zi -Od -MD -IC:\XEmacsBuild\xemacs-21.5.29\lib-src -IC:\XEmacsBuild\xemacs-21.5.29\src -DHAVE_CONFIG_H -DWIN32_NATIVE". Compiling as C++. Installing XEmacs in "C:/XEmacsBuild/installed/XEmacs-21.5.29". Compiling in support for Microsoft Windows native GUI. Compiling in international (MULE) support. Compiling in support for XPM images. Compiling in support for GIF images. Compiling in support for PNG images. Compiling in support for TIFF images. Compiling in support for JPEG images. Compiling in support for GZIP compression/decompression. Compiling in support for toolbars. Compiling in support for dialogs. Compiling in support for widgets. Compiling in support for native sounds. Using portable dumper. Using system malloc. Using DLL version of C runtime library. Compiling in extra internal error-checking. NOTE: --------------------------------------------------------- NOTE: Compiling in support for runtime error-checking. NOTE: XEmacs will run noticeably more slowly as a result. NOTE: Error-checking is on by default for XEmacs beta releases. NOTE: --------------------------------------------------------- Compiling in debugging support (no slowdown). Load-Path Lisp Shadows: ---------------------- (e:\XEmacs\site-packages\lisp\emacs-goodies-el\ctypes e:\XEmacs\xemacs-packages\lisp\c-support\ctypes e:\XEmacs\site-packages\lisp\emacs-goodies-el\setnu e:\XEmacs\xemacs-packages\lisp\edit-utils\setnu e:\XEmacs\xemacs-packages\lisp\cedet-common\working e:\XEmacs\xemacs-packages\lisp\semantic\working e:\XEmacs\xemacs-packages\lisp\cedet-common\sformat e:\XEmacs\xemacs-packages\lisp\semantic\sformat e:\XEmacs\site-packages\lisp\emacs-goodies-el\htmlize e:\XEmacs\xemacs-packages\lisp\text-modes\htmlize e:\XEmacs\site-packages\lisp\emacs-goodies-el\folding e:\XEmacs\xemacs-packages\lisp\text-modes\folding e:\XEmacs\site-packages\lisp\emacs-goodies-el\filladapt e:\XEmacs\xemacs-packages\lisp\text-modes\filladapt e:\XEmacs\site-packages\lisp\emacs-goodies-el\apache-mode e:\XEmacs\xemacs-packages\lisp\text-modes\apache-mode e:\XEmacs\site-packages\lisp\emacs-goodies-el\xrdb-mode e:\XEmacs\xemacs-packages\lisp\text-modes\xrdb-mode e:\XEmacs\mule-packages\lisp\mule-base\viet-util e:\XEmacs\XEmacs-21.5.29\lisp\mule\viet-util e:\XEmacs\mule-packages\lisp\mule-base\korea-util e:\XEmacs\XEmacs-21.5.29\lisp\mule\korea-util e:\XEmacs\mule-packages\lisp\mule-base\japan-util e:\XEmacs\XEmacs-21.5.29\lisp\mule\japan-util e:\XEmacs\mule-packages\lisp\mule-base\ethio-util e:\XEmacs\XEmacs-21.5.29\lisp\mule\ethio-util e:\XEmacs\mule-packages\lisp\mule-base\china-util e:\XEmacs\XEmacs-21.5.29\lisp\mule\china-util e:\XEmacs\xemacs-packages\lisp\xemacs-base\regexp-opt e:\XEmacs\XEmacs-21.5.29\lisp\regexp-opt e:\XEmacs\xemacs-packages\lisp\xemacs-base\easy-mmode e:\XEmacs\XEmacs-21.5.29\lisp\easy-mmode e:\XEmacs\xemacs-packages\lisp\build\build-report e:\XEmacs\XEmacs-21.5.29\lisp\build-report e:\XEmacs\xemacs-packages\lisp\apel\alist e:\XEmacs\XEmacs-21.5.29\lisp\alist) Internationalization Settings: ------------------------- Environment: Value of LC_ALL : nil Value of LC_COLLATE : nil Value of LC_CTYPE : nil Value of LC_MESSAGES : nil Value of LC_MONETARY : nil Value of LC_NUMERIC : nil Value of LC_TIME : nil Value of LANG : nil Lisp locale settings: current-language-environment => "English" default-buffer-file-coding-system => mswindows-multibyte-dos default-process-coding-system => (undecided-dos . mswindows-multibyte-system-default) (current-locale) => "English_United States.1252" keyboard-coding-system => mswindows-multibyte-system-default terminal-coding-system => mswindows-multibyte-system-default (coding-priority-list) => (iso-8-1 utf-16-little-endian-bom utf-16-bom utf-8-bom iso-7 no-conversion utf-8 iso-8-2 iso-8-designate iso-lock-shift shift-jis big5 utf-16-little-endian utf-16 ucs-4) Coding system aliases: 'native is aliased to mswindows-multibyte-system-default-dos 'file-name is aliased to mswindows-multibyte-system-default 'mswindows-multibyte-system-default is not a coding system alias Installed XEmacs Packages: ------------------------- (xslide ver: 1.09 upstream: 0.2.2) (xemacs-devel ver: 1.8 upstream: No-Upstream-Ver) (xemacs-base ver: 2.27 upstream: No-Upstream-Ver) (w3 ver: 1.35 upstream: 4.0pre47) (vm ver: 8.08 upstream: 8.0.12-devo) (vc ver: 1.48 upstream: No-Upstream-Ver) (tramp ver: 1.4 upstream: 2.0.56) (tm ver: 1.39 upstream: No-Upstream-Ver) (time ver: 1.14 upstream: 1.17) (textools ver: 1.15 upstream: No-Upstream-Ver) (text-modes ver: 1.98 upstream: No-Upstream-Ver) (texinfo ver: 1.3 upstream: No-Upstream-Ver) (supercite ver: 1.21 upstream: 3.55x3) (speedbar ver: 1.29 upstream: 1.0pre4) (sounds-wav ver: 1.12 upstream: No-Upstream-Ver) (sieve ver: 1.18 upstream: No-Upstream-Ver) (sh-script ver: 1.24 upstream: 2.0f) (sgml ver: 1.11 upstream: No-Upstream-Ver) (semantic ver: 1.21 upstream: 2.0pre4) (sasl ver: 1.16 upstream: 1.14.4) (rmail ver: 1.14 upstream: No-Upstream-Ver) (reftex ver: 1.34 upstream: 4.21) (psgml ver: 1.45 upstream: 1.3.2) (ps-print ver: 1.12 upstream: 6.5.6) (prog-modes ver: 2.2 upstream: No-Upstream-Ver) (pgg ver: 1.07 upstream: 0.1) (perl-modes ver: 1.14 upstream: No-Upstream-Ver) (pcomplete ver: 1.06 upstream: 1.1.6) (pcl-cvs ver: 1.7 upstream: R-2_9_9) (pc ver: 1.28 upstream: No-Upstream-Ver) (os-utils ver: 1.41 upstream: No-Upstream-Ver) (net-utils ver: 1.56 upstream: N/A) (mmm-mode ver: 1.05 upstream: 0.4.8) (misc-games ver: 1.22 upstream: No-Upstream-Ver) (mine ver: 1.16 upstream: 1.9) (mailcrypt ver: 2.14 upstream: 3.5.8) (mail-lib ver: 1.8 upstream: No-Upstream-Ver) (ispell ver: 1.32 upstream: 3.6) (ilisp ver: 1.36 upstream: 5.12.0) (igrep ver: 1.16 upstream: 2.111) (gnus ver: 1.94 upstream: 5.10.8) (gnats ver: 1.17 upstream: 3.101) (general-docs ver: 1.06 upstream: No-Upstream-Ver) (games ver: 1.2 upstream: 2.00) (fsf-compat ver: 1.19 upstream: No-Upstream-Ver) (footnote ver: 1.16 upstream: 0.18x) (eterm ver: 1.18 upstream: No-Upstream-Ver) (eshell ver: 1.18 upstream: 0fc80a3f6bb3bb59f42e9ff83cc8b89bf90fe658) (emerge ver: 1.11 upstream: No-Upstream-Ver) (elib ver: 1.13 upstream: 1.0) (eieio ver: 1.07 upstream: 1.0pre4) (efs ver: 1.34 upstream: 1.24) (edit-utils ver: 2.43 upstream: No-Upstream-Ver) (ediff ver: 1.81 upstream: 2.75) (edebug ver: 1.22 upstream: No-Upstream-Ver) (ede ver: 1.03 upstream: 1.0pre4) (ecrypto ver: 0.21 upstream: 2.0) (ecb ver: 1.22 upstream: 2.31) (easypg ver: 1.03 upstream: 0.0.16) (dired ver: 1.2 upstream: 7.17) (dictionary ver: 1.16 upstream: 1.8) (debug ver: 1.18 upstream: No-Upstream-Ver) (crisp ver: 1.15 upstream: 1.34) (cookie ver: 1.15 upstream: No-Upstream-Ver) (cedet-common ver: 1.01 upstream: 1.0pre4) (cc-mode ver: 1.45 upstream: 5.30.10) (calendar ver: 1.38 upstream: No-Upstream-Ver) (calc ver: 1.26 upstream: 2.02fX3) (c-support ver: 1.22 upstream: No-Upstream-Ver) (build ver: 1.15 upstream: 2.02) (bbdb ver: 1.32 upstream: 2.35) (auctex ver: 1.51 upstream: 11.84) (apel ver: 1.34 upstream: 10.7) (mule-base ver: 1.56 upstream: No-Upstream-Ver) (leim ver: 1.31 upstream: No-Upstream-Ver) (latin-unity ver: 1.2 upstream: 1.20) (latin-euro-standards ver: 1.09 upstream: 1.09) Features: -------- (mail-abbrevs xemacsbug shadow sendmail rfc822 efs-cu info view-less view hyper-apropos mwheel compile timer-funcs lazy-lock font-lock cus-face paren blink-paren tex-mik regexp-opt jka-compr xslide-autoloads xemacs-devel-autoloads xemacs-base-autoloads w3-autoloads vm-autoloads vc-autoloads tramp-autoloads tm-autoloads time-autoloads textools-autoloads text-modes-autoloads texinfo-autoloads supercite-autoloads speedbar-autoloads sounds-wav-autoloads sieve-autoloads sh-script-autoloads sgml-autoloads semantic-autoloads sasl-autoloads rmail-autoloads reftex-autoloads psgml-autoloads ps-print-autoloads prog-modes-autoloads pgg-autoloads perl-modes-autoloads pcomplete-autoloads pcl-cvs-autoloads pc-autoloads os-utils-autoloads net-utils-autoloads mmm-mode-autoloads misc-games-autoloads mine-autoloads mailcrypt-autoloads mail-lib-autoloads ispell-autoloads ilisp-autoloads igrep-autoloads gnus-autoloads gnats-autoloads general-docs-autoloads games-autoloads fsf-compat-autoloads footnote-autoloads eterm-autoloads eshell-autoloads emerge-autoloads elib-autoloads eieio-autoloads efs-autoloads edit-utils-autoloads ediff-autoloads edebug-autoloads ede-autoloads ecrypto-autoloads ecb-autoloads easypg-autoloads dired-autoloads dictionary-autoloads debug-autoloads crisp-autoloads cookie-autoloads cedet-common-autoloads cc-mode-autoloads calendar-autoloads calc-autoloads c-support-autoloads build-autoloads bbdb-autoloads tex-site auctex-autoloads apel-autoloads mule-base-autoloads leim-autoloads latin-unity-autoloads latin-euro-standards-autoloads emacs-goodies-el emacs-goodies-custom emacs-goodies-loaddefs mule-autoloads auto-autoloads auto-show fontl-hooks canna-leim tibetan slovenian czech romanian lao devanagari indian cyrillic code-cmds gutter-items menubar-items x-menubar dragdrop mode-motion mouse behavior itimer auto-save lisp-mode easymenu easy-mmode iso8859-1 page buff-menu lib-complete loadhist cus-file derived newcomment rsz-minibuf env text-props frame obsolete cus-start custom widget cl-extra cl cl-19 packages backquote unicode mswindows-scrollbars mswindows toolbar native-sound scrollbar network-streams subprocesses menu-accelerator-support menubar md5 xemacs mule gutter tiff png gif jpeg xpm xbm lisp-float-type file-coding dde windows-nt dragdrop-api dialog devices window-system base64) _______________________________________________ XEmacs-Beta mailing list XEmacs-Beta(a)xemacs.org http://lists.xemacs.org/mailman/listinfo/xemacs-beta