Date: Tue, 5 Jul 2005 00:05:20 EST-10EDT,10,-1,0,7200,3,-1,0,7200,3600 Subject: [UnixOS2_Archive] No. 576 ************************************************** Monday 04 July 2005 Number 576 ************************************************** Subjects for today 1 Re: gzip (was: The OS/2 and eCS Ecosystem) : John Poltorak 2 Re: SETMOZENV & UX2BS : John Poltorak 3 Re: Subversion : John Poltorak 4 Re: Debugging Perl code : Dave Saville" 5 Re: UX2BS list : Anton Monroe 6 Re: gzip (was: The OS/2 and eCS Ecosystem) : Dave Yeo" 7 Re: SETMOZENV & UX2BS : Dave Yeo" 8 Re: CPAN : Dave Yeo" 9 Re: SETMOZENV & UX2BS : Dave Yeo" 10 Re: SETMOZENV & UX2BS : Dave Yeo" 11 Re: Debugging Perl code : Steven Levine" 12 Re: Debugging Perl code : John Poltorak 13 Re: UX2BS list : John Poltorak 14 Re: SETMOZENV & UX2BS : John Poltorak 15 Re: Debugging Perl code : Dave Saville" 16 Re: Debugging Perl code : John Poltorak 17 Re: CC1.EXE hanging processing the exit list : Knut St. Osmundsen" **= Email 1 ==========================** Date: Sun, 3 Jul 2005 15:30:04 +0100 From: John Poltorak Subject: Re: gzip (was: The OS/2 and eCS Ecosystem) On Sun, Jul 03, 2005 at 12:32:29PM +0200, Andreas Buening wrote: > John Poltorak wrote: > > > Once I've done that satisfactorily, I think UX2BS is at a level which is > > usable as a standard framework for building a great many other apps. Most > > of these work fine already but I'm stuck getting the text/shell/file utils > > built properly. I know the source and patches are available but I can't > > follow the way Jun Sawataishi, who has produced the latest versions, has > > built them. If you could assist, then this task would be completed pretty > > quickly. > > The file/shell/text utilities are (at least) a two day full time job, > I guess. You already did a port of the text utilities (v2.0) nearly four years ago. I wonder if all the same changes would be required now that automake and autoconf have been updated... If you have chnace can you have a quick look at your patches to see if you would still do everything the same way? > So I think they'll have to wait a little bit longer. That's no problem. Knowing that you hope to tackle them when time permits is reassuring enough. > For gzip I just had to add a missing header, change some shell > code twice which relied on a case sensitive file system, remove > some duplicate defines and add a test for a missing function > to have a define for it. Nothing that could be called "real" > porting. You are far too modest, Andreas ;-) > Bye, > Andreas -- John **= Email 2 ==========================** Date: Sun, 3 Jul 2005 15:35:33 +0100 From: John Poltorak Subject: Re: SETMOZENV & UX2BS On Sun, Jul 03, 2005 at 08:10:26PM +0930, Paul Smedley wrote: > Hi John, > Unless ux2bs has at least Innotek GCC 3.2.2 it isn't going to work...... Paul, I'm aware that UX2BS does not currently use Innotek GCC, but I hope to incorporate it before long. What I'd like to know is that I have the rest of the infrastructure in place for building Mozilla - well at least the basic Unix utils. Anyone know if gcc v3.3.5 can be used for building Mozilla yet? > John Poltorak wrote: > > I'd like to create a SETMOZENV.CMD suitable for building Mozilla under a > > UX2BS environment. I realise some tools are missing at the moment, but > > quite a number are already available and I don't want to duplicate > > programs. > > > > > > The current setup instructions are here:- > > > > http://www.mozilla.org/ports/os2/gccsetup.html > > > > and the environment setup is here:- > > > > http://www.mozilla.org/ports/os2/gcc/setmozenv.cmd > > > > I'd like to rationalise it so that it works with UX2BS as well as remove > > all redundant entries. > > > > What do I need to change and what can I remove? > > > > -- John **= Email 3 ==========================** Date: Sun, 3 Jul 2005 15:49:02 +0100 From: John Poltorak Subject: Re: Subversion On Sun, Jul 03, 2005 at 11:19:42PM +1000, Brian Havard wrote: > On Fri, 1 Jul 2005 15:35:54 +0100, John Poltorak wrote: > > > > >A server of SUBVERSION has just been released and is available here:- > > > >http://silk.apana.org.au/subversion/ > > > >Does anyone know how to get it working in INETD mode? > > I doubt that's going to work without significant mods to svnserve as it > expects to communicate using stdin/stdout when started in inetd mode and, > if I remember correctly, OS/2's inetd works a bit differently due to the > fact that sockets and file handles aren't interchangable. I guess SVNSERVE would have the same problems as IMAPD/IPOPD. Is this information relevant to using SVNSERVE with INETD:- ? http://www.zeta.org.au/~nps/software/pine/lib/UWIMAPD.OS2 > I only tried it in daemon mode. It must be run multithreaded (-T) to work > as it's built in OMF mode so no fork(). I'll try and get it set up. Presumably the standard docs should apply to the OS/2 version... > BTW, I've just got v1.2.0 to build cleanly & will release it when I've > tested it for a bit. Great! Will there be any build instructions? > > -- > ______________________________________________________________________________ > | Brian Havard | "He is not the messiah! | > | brianh at kheldar.apana.org.au | He's a very naughty boy!" - Life of Brian | > ------------------------------------------------------------------------------ > -- John **= Email 4 ==========================** Date: Sun, 03 Jul 2005 16:04:37 +0100 (BST) From: "Dave Saville" Subject: Re: Debugging Perl code On Sat, 2 Jul 2005 12:06:14 +0100, John Poltorak wrote: > >Looking at CPAN.pm, I suspect I am getting some file corruption introduced >by this code:- > > $self->debug("localizing funkyftpwise[$url]") if $CPAN::DEBUG; > my($f,$funkyftp); > for $f ('lynx','ncftpget','ncftp','wget') { > next unless exists $CPAN::Config->{$f}; > $funkyftp = $CPAN::Config->{$f}; > next unless defined $funkyftp; > next if $funkyftp =~ /^\s*$/; > my($asl_ungz, $asl_gz); > ($asl_ungz = $aslocal) =~ s/\.gz//; > $asl_gz = "$asl_ungz.gz"; > my($src_switch) = ""; > if ($f eq "lynx"){ > $src_switch = " -source"; > } elsif ($f eq "ncftp"){ > $src_switch = " -c"; > } elsif ($f eq "wget"){ > $src_switch = " -O -"; > } > my($chdir) = ""; > my($stdout_redir) = " > $asl_ungz"; > if ($f eq "ncftpget"){ > $chdir = "cd $aslocal_dir && "; > $stdout_redir = ""; > } > > >WGET retrieves files correctly but then something goes and appends some >additional data. Is the above code where this is done? Any way to log it? Don't think so. All that is doing is finding which of several get file type progs are defined in the config file and then setting relevant switches for what ever type it is going to use. It then (re)defines STDOUT and current working dir one way for ncftp and another for everything else. HTH -- Regards Dave Saville **= Email 5 ==========================** Date: Sun, 3 Jul 2005 11:39:19 -0500 From: Anton Monroe Subject: Re: UX2BS list On Fri, Jul 01, 2005 at 04:37:31PM +0100, John Poltorak wrote: > I'd really like to get started again with UX2BSand get a few people to try > it out as I'v been making a few adjustments to the internal directory > structure and want to be sure everything which did work, still works. Is your rsync server working? I tried to check it a couple of times this week and got no response. Anton **= Email 6 ==========================** Date: Sun, 03 Jul 2005 09:48:07 -0800 From: "Dave Yeo" Subject: Re: gzip (was: The OS/2 and eCS Ecosystem) On Sun, 03 Jul 2005 12:32:29 +0200, Andreas Buening wrote: >For gzip I just had to add a missing header, change some shell >code twice which relied on a case sensitive file system, remove >some duplicate defines and add a test for a missing function >to have a define for it. Nothing that could be called "real" >porting. Does it support EAs? Dave **= Email 7 ==========================** Date: Sun, 03 Jul 2005 09:48:16 -0800 From: "Dave Yeo" Subject: Re: SETMOZENV & UX2BS On Sun, 3 Jul 2005 15:35:33 +0100, John Poltorak wrote: >Anyone know if gcc v3.3.5 can be used for building Mozilla yet? Always has, haven't actually tried with the newest beta yet. You first need to rebuild libidl and glib. Dave **= Email 8 ==========================** Date: Sun, 03 Jul 2005 09:50:00 -0800 From: "Dave Yeo" Subject: Re: CPAN On Sun, 3 Jul 2005 10:11:05 +0100, John Poltorak wrote: > Do you have a URL for ncftp? IIRC my favorite build is http://hobbes.nmsu.edu/pub/os2/apps/internet/ftp/client/ncftp3beta19os2.zip. There is also a newer one around that I didn't like quite as much though it is more complete Dave **= Email 9 ==========================** Date: Sun, 03 Jul 2005 18:06:19 -0800 From: "Dave Yeo" Subject: Re: SETMOZENV & UX2BS On Sun, 3 Jul 2005 11:15:44 +0100, John Poltorak wrote: >I'd like to create a SETMOZENV.CMD suitable for building Mozilla under a >UX2BS environment. I realise some tools are missing at the moment, but >quite a number are already available and I don't want to duplicate >programs. > > >The current setup instructions are here:- > >http://www.mozilla.org/ports/os2/gccsetup.html > >and the environment setup is here:- > >http://www.mozilla.org/ports/os2/gcc/setmozenv.cmd > >I'd like to rationalise it so that it works with UX2BS as well as remove >all redundant entries. > >What do I need to change and what can I remove? It should just be a matter of removing most everything from /moztools that are in ux2bs. Then setting some enviroment settings such as perl. One thing I learned the hard way is that you need Henrys newest build of autoconf 2.13. IIRC you do need a /moztools directory since it is hardwired in configure. Be a good test of your build system especially perl Dave **= Email 10 ==========================** Date: Sun, 03 Jul 2005 22:30:04 -0800 From: "Dave Yeo" Subject: Re: SETMOZENV & UX2BS On Sun, 03 Jul 2005 09:48:16 -0800, Dave Yeo wrote: > Anyways tried to build firefox with ux2bs. This was just a quick hack with the mozilla tree on I: and ux2bs on G:. Ended here checking for g:/usr/bin/perl.exe... g:/usr/bin/perl.exe checking for minimum required perl version >= 5.004... 5.008006 checking for full perl installation... no configure: error: Cannot find Config.pm or $Config{archlib}. A full perl installation is required. *** Fix above errors and then restart with "make.exe -f client.mk build" make: *** [i:/mozilla/obj-fb/Makefile] Error 1 which looking at config.log is configure:3488: checking for full perl installation Can't locate Config.pm in at INC ( at INC contains: /usr/lib/perl5/5.8.6/os2 /usr/lib/perl5/5.8.6 /usr/lib/perl5/site_perl/5.8.6/os2 /usr/lib/perl5/site_perl/5.8.6 /usr/lib/perl5/site_perl .) at -e line 1. BEGIN failed--compilation aborted at -e line 1. So one problem with ux2bs perl is the lack of drive letters in at INC I edited g:\usr\lib\perl5\5.8.6\os2\Config.pm and g:\usr\lib\perl5\5.8.6\os2\CORE\config.h changing all /usr/lib/perl5/5.8.6 to G:/usr/lib/perl5/5.8.6 which unluckily didn't help. Seems that perl needs to be built slightly different so drive letters are there. I then tried with Henrys perl installed in I:\perl and removing config.site from \unixos2\lib and perl is fine now. Now getting more weird errors related to gcc so something is mixed up in the enviroment from ux2_env.cmd. Adding /* set ux2bs path and libpath */ 'SET PATH=g:\usr\bin;g:\unixos2\emx\bin;g:\usr\local\bin;g:\unixos2\bin;%PATH %' 'SET BEGINLIBPATH=g:\usr\lib;g:\unixos2\dll;%BEGINLIBPATH%' to setmozenv right after the check for ROOT close to the top of setmozenv.cmd seems to work. So in summary, ux2_env screws up gcc somehow, plus config.site introduces some problems. Perl is broken when used on a differnet partition but might work fine on the same partition. I don't have the room on G: to test. Only thing I have in /moztools is ash.exe and nsinstall.exe which is hardwired somewhere. Also a newer rc.exe and ilink.exe is needed After all this the build dies when building nspr4.dll with 381 undefined symbols. This turned out to be a sed failure fixed by using the sed from moztools Dave ps using gcc3.2.2. as I haven't got around to rebuilding libidl and glib yet **= Email 11 ==========================** Date: Mon, 04 Jul 2005 00:22:26 -0700 From: "Steven Levine" Subject: Re: Debugging Perl code In <20050702120614.D56 at warpix.org>, on 07/02/05 at 12:06 PM, John Poltorak said: > } elsif ($f eq "wget"){ > $src_switch = " -O -"; You left out to more interesting code that comes later: my($stdout_redir) = " > $asl_ungz"; and my($system) = "$chdir$funkyftp$src_switch \"$url\" $devnull$stdout_redir"; and my($system) = "$funkyftp$src_switch \"$url.gz\" $devnull > $asl_gz"; This is effectively: wget -O - url >somefile Your output file will get garbage appended your version of wgets spews commentary to stdout after retrieving the file. The code assumes this will not occur. What you can do to test this theory is tweak the code to invokde wget as: wget -O somefile url Regards, Steven -- ---------------------------------------------------------------------- "Steven Levine" MR2/ICE 2.67 #10183 Warp4.something/14.100c_W4 www.scoug.com irc.fyrelizard.com #scoug (Wed 7pm PST) ---------------------------------------------------------------------- **= Email 12 ==========================** Date: Mon, 4 Jul 2005 09:50:08 +0100 From: John Poltorak Subject: Re: Debugging Perl code On Mon, Jul 04, 2005 at 12:22:26AM -0700, Steven Levine wrote: > In <20050702120614.D56 at warpix.org>, on 07/02/05 > at 12:06 PM, John Poltorak said: > > > } elsif ($f eq "wget"){ > > $src_switch = " -O -"; > > > > You left out to more interesting code that comes later: > > my($stdout_redir) = " > $asl_ungz"; > > and > my($system) = > "$chdir$funkyftp$src_switch \"$url\" $devnull$stdout_redir"; and > my($system) = "$funkyftp$src_switch \"$url.gz\" $devnull > $asl_gz"; > > This is effectively: > > wget -O - url >somefile > > Your output file will get garbage appended your version of wgets spews > commentary to stdout after retrieving the file. The code assumes this > will not occur. > > What you can do to test this theory is tweak the code to invokde wget as: > wget -O somefile url I would if I understood Perl, but my efforts to tweak the lines above resulted in:- Trying with "g:/wget.exe -O" to get ftp://ftp.mirror.ac.uk/sites/ftp.funet.fi/pub/languages/perl/CPAN/modules/03 modlist.data.gz System call "g:/wget.exe -O "ftp://ftp.mirror.ac.uk/sites/ftp.funet.fi/pub/langu ages/perl/CPAN/modules/03modlist.data.gz" > g:/home/root/.cpan/sources/modules/ 03modlist.data" returned status 1 (wstat 256) Warning: expected file [g:/home/root/.cpan/sources/modules/03modlist.data.gz] do esn't exist Here are the changes I made:- } elsif ($f eq "wget"){ $src_switch = " -O"; } my($system) = "$funkyftp$src_switch \"$asl_gz\" $devnull $url.gz"; Obviously something wrong... > > Regards, > > Steven > > -- > ---------------------------------------------------------------------- > "Steven Levine" MR2/ICE 2.67 #10183 Warp4.something/14.100c_W4 > www.scoug.com irc.fyrelizard.com #scoug (Wed 7pm PST) > ---------------------------------------------------------------------- > -- John **= Email 13 ==========================** Date: Mon, 4 Jul 2005 10:14:01 +0100 From: John Poltorak Subject: Re: UX2BS list On Sun, Jul 03, 2005 at 11:39:19AM -0500, Anton Monroe wrote: > On Fri, Jul 01, 2005 at 04:37:31PM +0100, John Poltorak wrote: > > I'd really like to get started again with UX2BSand get a few people to try > > it out as I'v been making a few adjustments to the internal directory > > structure and want to be sure everything which did work, still works. > > Is your rsync server working? I tried to check it a couple of times > this week and got no response. It isn't running just at the moment. I'm making some changes to UX2BS and would prefer not confuse people by allowing them to download something which will be out of date and incompatible in a couple of days. I'll let you know when my RSYNC server is back up. > Anton -- John **= Email 14 ==========================** Date: Mon, 4 Jul 2005 10:45:28 +0100 From: John Poltorak Subject: Re: SETMOZENV & UX2BS On Sun, Jul 03, 2005 at 06:06:19PM -0800, Dave Yeo wrote: > On Sun, 3 Jul 2005 11:15:44 +0100, John Poltorak wrote: > > >I'd like to create a SETMOZENV.CMD suitable for building Mozilla under a > >UX2BS environment. I realise some tools are missing at the moment, but > >quite a number are already available and I don't want to duplicate > >programs. > > > > > >The current setup instructions are here:- > > > >http://www.mozilla.org/ports/os2/gccsetup.html > > > >and the environment setup is here:- > > > >http://www.mozilla.org/ports/os2/gcc/setmozenv.cmd > > > >I'd like to rationalise it so that it works with UX2BS as well as remove > >all redundant entries. > > > >What do I need to change and what can I remove? > > It should just be a matter of removing most everything from /moztools > that are in ux2bs. That is what I was thinking. At least all these should be common:- * GNU shell utilities * GNU text utilities * GNU file utilities * GNU diff * GNU grep * GNU awk * GNU m4 * GNU make * GNU gettext * GNU sed * GNU find * Info-ZIP (Zip and UnZip) * GNU Patch * GNU Tar although I'm not sure that specific version of SED (v4.05) and MAKE (v3.81) are required. Maybe they were picked because the were the most recent versions... > Then setting some enviroment settings such as perl. Why is this required? My view is if it isn't needed on Unix, then we should be able to use the same defaults under UX2BS. Or am I missing something? > One thing I learned the hard way is that you need Henrys newest build of > autoconf 2.13. IIRC you do need a /moztools directory since it is > hardwired in configure. Be a good test of your build system especially > perl Yes it certainly would. I'd like to get as much of MOZTOOLS into UX2BS as possible so that people don't need to worry about setting up the correct build environment for themselves. > Dave -- John **= Email 15 ==========================** Date: Mon, 04 Jul 2005 11:34:19 +0100 (BST) From: "Dave Saville" Subject: Re: Debugging Perl code On Mon, 4 Jul 2005 09:50:08 +0100, John Poltorak wrote: >I would if I understood Perl, but my efforts to tweak the lines above >resulted in:- > > >Trying with "g:/wget.exe -O" to get > >ftp://ftp.mirror.ac.uk/sites/ftp.funet.fi/pub/languages/perl/CPAN/modules/03 >modlist.data.gz > >System call "g:/wget.exe -O >"ftp://ftp.mirror.ac.uk/sites/ftp.funet.fi/pub/langu >ages/perl/CPAN/modules/03modlist.data.gz" > >g:/home/root/.cpan/sources/modules/ >03modlist.data" >returned status 1 (wstat 256) >Warning: expected file >[g:/home/root/.cpan/sources/modules/03modlist.data.gz] do >esn't exist > > > >Here are the changes I made:- > > > } elsif ($f eq "wget"){ > $src_switch = " -O"; > } > > > > my($system) = "$funkyftp$src_switch \"$asl_gz\" $devnull $url.gz"; I don't think you need the $devnull Shove a print after the above line and see if what you get looks like what Steve said to try. print "$system\n"; HTH -- Regards Dave Saville **= Email 16 ==========================** Date: Mon, 4 Jul 2005 12:11:03 +0100 From: John Poltorak Subject: Re: Debugging Perl code On Mon, Jul 04, 2005 at 11:34:19AM +0100, Dave Saville wrote: > On Mon, 4 Jul 2005 09:50:08 +0100, John Poltorak wrote: > > >I would if I understood Perl, but my efforts to tweak the lines above > >resulted in:- > > > > > >Trying with "g:/wget.exe -O" to get > > > >ftp://ftp.mirror.ac.uk/sites/ftp.funet.fi/pub/languages/perl/CPAN/modules/03 > >modlist.data.gz > > > >System call "g:/wget.exe -O > >"ftp://ftp.mirror.ac.uk/sites/ftp.funet.fi/pub/langu > >ages/perl/CPAN/modules/03modlist.data.gz" > > >g:/home/root/.cpan/sources/modules/ > >03modlist.data" > >returned status 1 (wstat 256) > >Warning: expected file > >[g:/home/root/.cpan/sources/modules/03modlist.data.gz] do > >esn't exist > > > > > > > >Here are the changes I made:- > > > > > > } elsif ($f eq "wget"){ > > $src_switch = " -O"; > > } > > > > > > > > my($system) = "$funkyftp$src_switch \"$asl_gz\" $devnull $url.gz"; > > I don't think you need the $devnull Shove a print after the above line and see > if what you get looks like what Steve said to try. > > print "$system\n"; I think I've done what you suggested... This is the code as I have it now:- Trying with "$funkyftp$src_switch" to get $url.gz ]); my($system) = "$funkyftp$src_switch \"$asl_gz\" $url.gz"; print "$system\n"; # my($system) = "$funkyftp$src_switch \"$url.gz\" $devnull > $asl_gz"; $self->debug("system[$system]") if $CPAN::DEBUG; my($wstatus); Here is what I get:- Trying with "g:/wget.exe -O" to get ftp://ftp.perl.org/pub/CPAN/authors/01mailrc.txt.gz System call "g:/wget.exe -O "ftp://ftp.perl.org/pub/CPAN/authors/01mailrc.txt.gz " > g:/home/root/.cpan/sources/authors/01mailrc.txt" returned status 1 (wstat 256) Warning: expected file [g:/home/root/.cpan/sources/authors/01mailrc.txt.gz] doesn't exist Something ain't right... > HTH > > -- > Regards > > Dave Saville > -- John **= Email 17 ==========================** Date: Mon, 04 Jul 2005 14:59:10 +0200 From: "Knut St. Osmundsen" Subject: Re: CC1.EXE hanging processing the exit list Dave Yeo wrote: > Went to work leaving a long compile happening. Came home and it had > died due to an out of memory error. Killed emxload and sent a break > to the hung CC1 process and now its sitting processing its exit list. > Newest Innotek_libc, any one else had this? I've seen something similar this weekend but haven't been able to reproduce it properly and at the time it happend attaching a debugger to the process wasn't helping much in seeing the real cause. In my case I didn't see any out of memory messages though. Do you remember any of the wording of that message? Did you get any messages of the !!!deadlock!!! type? > I never have, usually killing emxload is enough, occasionally a > ctrl-c as well. There are a few really important locks which also include entering a must complete section. If the app should hang while inside such a section it's rather difficult to kill it using signals since those are not delivered to the process. I'm try my best not to do anything which would require blocking and trying to catch faults using special exception handlers while inside a must complete section. I might have overlooked something, somewhere. Kind Regards, knut