Apply ALL relevent fixes to ECL 10.4.1 #9264

sagetrac-drkirkby · 2010-06-18T12:16:14Z

There are a number of tickets active at the minute with patches to ECL

none have been merged, but the patches are not consistent across all or them.

The option --with-dffi=no from ecl 9.10.2-20091105cvs.p1 faiils to build on Open Solaris x64 #8089 has not been been missed which is very important.
Some other less important changes (such as removing an inaccurate, but innocuous mention of building a 32-bit version) are removed.
There is a 10.4.1.p0 package, despite no 10.4.1 has actually been merged.

The aim of this ticket is to update to the 10.4.1 source code, whilst ensuring all the relevant patches are applied.

Important

On #8951 Jason says "As a reminder here, this (i.e. #8951) should only be merged simultaneously with the new maxima at #8731."

Assuming Jason is correct, that gives us a problem.

The Maxima update seems to have stalled (there are no updates on the ticket for 3 weeks). If updating Maxima to 5.21.1 and ECL 10.4.1 need to be done together, it will probably be best to create a ecl-10.2.1.p0, which has all the small changes, and actually leave updating to the latest ECL code until it can be better coordinated with the Maxima update.

At the moment, it seems several small but important changes to the ECL installation are being held up for a non-trivial set of changes needed if Mamima is updated.

Dave

CC: @williamstein @jhpalmieri @qed777 @nexttime @jaapspies @jasongrout @vbraun @jdemeyer

Component: packages: standard

Reviewer: Volker Braun

Issue created by migration from https://trac.sagemath.org/ticket/9264

nbruin · 2010-06-18T16:03:22Z

comment:2

Your best chance is to see if you can give a positive review to
#8645. The maxima spkg there:

http://sage.math.washington.edu/home/nbruin/maxima-5.20.1.p1.spkg

is the same maxima that is in sage now, with minimal changes applied to let maxima build under ECL 10.4.1.

If maxima.5.20.1.p1 on ecl.10.4.1 needs work, we might as well wait until maxima.5.21 is ready to be merged, because then the problem is ecl.10.4.1.

When I tried, I couldn't get maxima to build properly under ecl.10.2 (its "ASDF" is too buggy)

sagetrac-drkirkby · 2010-06-19T19:23:17Z

comment:3

I've created a new ECL package

http://boxen.math.washington.edu/home/kirkby/revised-patches/ecl-10.4.1.spkg

which has the following fixes applied:

Updates ECL to the latest upstream, 10.4.1
Applies a fix to stop ECL building in parallel, which is ticket Update ECL's spkg-install for building multiple spkgs in parallel #9187. This already has positive review.
Applies the fix from ecl 9.10.2-20091105cvs.p1 faiils to build on Open Solaris x64 #8089 to disable the dynamic foreign function interface as advised by the ECL developer. This disables the use of assembly code on OpenSolaris x64, but no other platform.
Removes files from /tmp/ECL* as soon as they are no longer needed, as failure to do so can present problems on multi-user systems.

All changes have been checked with #8645, which has a change to Maxima which allows Maxima to build with the latest ECL. The patch on #8645 does not update Maxima to the latest version, as that creates problems which are non-trivial to solve. It does however fix a problem with Maxima not installing the library properly, and allows Maxima to build with the latest ECL>

As such, the attached ticket:

Allows Maxima to build the library properly whilst still working with the latest ECL.
Remove unwanted ECL tmp files.
Allows spkgs to build in parallel
Allow ECL to build on OpenSolaris x64.

Here are the test results:

== Testing on Solaris 10 SPARC in 32-bit mode. ==

Sun Blade 1000
2 x 900 MHz UltraSPARC III+ CPUs
2 GB RAM
Solaris 10 03/2005 (first release of Solaris 10)
gcc 4.4.3 (uses Sun linker and assembler)
Sage 4.4.4.alpha1

	done
for i in Copyright LGPL; do \
	  /usr/bin/ginstall -c -m 644 /export/home/drkirkby/sage-4.4.4.alpha1/spkg/build/ecl-10.4.1/src/src/../$i /export/home/drkirkby/sage-4.4.4.alpha1/local/lib/; \
	done
/bin/sh /export/home/drkirkby/sage-4.4.4.alpha1/spkg/build/ecl-10.4.1/src/src/gc/mkinstalldirs /export/home/drkirkby/sage-4.4.4.alpha1/local/share/man/man1
for i in doc/ecl.man doc/ecl-config.man; do \
	    /usr/bin/ginstall -c -m 644 $i /export/home/drkirkby/sage-4.4.4.alpha1/local/share/man/man1/ecl.1; \
	done
make[1]: Leaving directory `/export/home/drkirkby/sage-4.4.4.alpha1/spkg/build/ecl-10.4.1/src/build'

real	1m26.075s
user	1m17.655s
sys	0m7.531s
Successfully installed ecl-10.4.1

Here is the Maxima 5.20.1.p1 installation from #8645

installing Maxima library as /export/home/drkirkby/sage-4.4.4.alpha1/local/lib/ecl//maxima.fas

real    22m32.432s
user    19m9.372s
sys     2m51.674s
Successfully installed maxima-5.20.1.p1
Now cleaning up tmp files.
rm: Cannot remove any directory in the path of the current working directory
/export/home/drkirkby/sage-4.4.4.alpha1/spkg/build/maxima-5.20.1.p1
Making Sage/Python scripts relocatable...
Making script relocatable
Finished installing maxima-5.20.1.p1.spkg
drkirkby@redstart:~/sage-4.4.4.alpha1$

== Testing on OpenSolaris x64 06/2009 64-bit mode. ==

Sun Ultra 27
2 x 3.33 GHz quad core Intel Xeon MHz
12 GB RAM
OpenSolaris 06/2009 (Last release of OpenSolaris, updated to build 134)
gcc 4.4.4 (uses Sun linker and GNU assembler)
Sage 4.4.4.alpha1

/bin/sh /export/home/drkirkby/sage-4.4.4.alpha1/spkg/build/ecl-10.4.1/src/src/gc/mkinstalldirs /export/home/drkirkby/sage-4.4.4.alpha1/local/share/man/man1
for i in doc/ecl.man doc/ecl-config.man; do \
	    /usr/bin/ginstall -c -m 644 $i /export/home/drkirkby/sage-4.4.4.alpha1/local/share/man/man1/ecl.1; \
	done
make[1]: Leaving directory `/export/home/drkirkby/sage-4.4.4.alpha1/spkg/build/ecl-10.4.1/src/build'

real	1m26.075s
user	1m17.655s
sys	0m7.531s
Successfully installed ecl-10.4.1

Maxima 5.20.1.p1 will not build on this platform, but such a problem is not related to this ticket, and appears it might be an incorrect flag given in the source (-Wl,-G instead of -shared). This is documented at #9099

Testing on sage.math (Linux), 64-bit.

n/man1/ecl.1; \
	done
make[1]: Leaving directory `/home/kirkby/sage-4.4.3/spkg/build/ecl-10.4.1/src/build'

real	2m16.904s
user	1m44.990s
sys	0m14.980s
Successfully installed ecl-10.4.1
Now cleaning up tmp files.
Making Sage/Python scripts relocatable...
Making script relocatable
Finished installing ecl-10.4.1.spkg

We can also see Maxima, and the library are ok now.

;;; 
installing Maxima library as /home/kirkby/sage-4.4.3/local/lib/ecl//maxima.fas

real	4m41.594s
user	3m14.160s
sys	0m46.000s
Successfully installed maxima-5.20.1.p1
Now cleaning up tmp files.
Making Sage/Python scripts relocatable...
Making script relocatable
Finished installing maxima-5.20.1.p1.spkg

Note to Release manager

There are many tickets active at the minute for updates to Maxima and ECL. Once positively, this should be integrated with Maxima at #8645. At the time of writing, the use of the latest Maxima will cause problems with doctest failures, as Maxima's output is changed from the current version.

nbruin · 2010-06-21T06:02:28Z

comment:4

I have tested this ticket by building sage 4.4.3 with the following spkgs substituted:
http://boxen.math.washington.edu/home/kirkby/revised-patches/ecl-10.4.1.spkg
http://sage.math.washington.edu/home/nbruin/maxima-5.20.1.p1.spkg
All doctests pass on sage.math.washington.edu. Furthermore, the ecl-10.4.1 package looks like it does what it's supposed to. When I diff it with http://sage.math.washington.edu/home/nbruin/ecl-10.4.1.spkg there are some unexpected files and differences in binary files in the .hg subdir, but otherwise the packages agree.

Merging this ticket should be a good stepping stone towards #8731 (assuming the issues there haven't been resolved by the time the next release merges are made). Merging this ticket would also resolve #8645, as well as all ECL related ticket referred to.

nbruin · 2010-06-21T06:02:28Z

Reviewer: Nils Bruin

sagetrac-drkirkby · 2010-06-25T12:39:56Z

comment:5

I just noticed a small inaccuracy in the description of the hardware used to test this on OpenSolaris. It does not affect the validity of the ticket, but it is sensible to correct the error.

The section marked Testing on OpenSolaris x64 06/2009 64-bit mode. states the processors are:

2 x 3.33 GHz quad core Intel Xeon MHz

which is incorrect. Unfortunately, the Sun Ultra 27 does not support more than one CPU. A more accurate description of the hardware/software used to test this ECL package on OpenSolaris is:

Testing on OpenSolaris x64 06/2009 64-bit mode.

Sun Ultra 27 workstation
1 x 3.33 GHz 64-bit Intel Xeon W3580 CPU (4 cores, 8 threads, 8 MB cache).
12 GB RAM
OpenSolaris 06/2009 (Last release of OpenSolaris, updated to build 134)
gcc 4.4.4 (uses Sun linker and GNU assembler)
Sage 4.4.4.alpha1

Dave

rlmill · 2010-06-25T15:45:15Z

Merged: sage-4.5.alpha0

rlmill · 2010-06-25T15:45:35Z

comment:7

Applied http://boxen.math.washington.edu/home/kirkby/revised-patches/ecl-10.4.1.spkg

rlmill · 2010-07-11T19:16:40Z

Changed merged from sage-4.5.alpha0 to none

vbraun · 2010-10-29T01:20:19Z

comment:9

ecl-10.2.1.p3 does not compile on Fedora 14:

libeclmin.a(sequence.o): In function `cl_sublis':
/home/vbraun/Code/ecl/src/c/sequence.d:106: multiple definition of `cl_sublis'
libeclmin.a(list.o):/home/vbraun/Code/ecl/src/c/list.d:778: first defined here
c/all_symbols.o:(.data.rel+0x9b20): undefined reference to `cl_subseq'
libeclmin.a(string.o): In function `string_trim0':
/home/vbraun/Code/ecl/src/c/string.d:756: undefined reference to `cl_subseq'
libeclmin.a(sequence.o): In function `cl_copy_seq':
tmp.c:(.text+0x4c0): undefined reference to `cl_subseq'
libeclmin.a(pathname.o): In function `make_one':
/home/vbraun/Code/ecl/src/c/pathname.d:234: undefined reference to `cl_subseq'
/home/vbraun/Code/ecl/src/c/pathname.d:234: undefined reference to `cl_subseq'
collect2: ld returned 1 exit status
make[1]: *** [ecl_min] Error 1

The current ecl-10.4.1 compiles fine. Given that Fedora 14 is scheduled to be released next Monday, is there any chance we can update ecl? Ideally in the next Sage (4.6.1) release...

sagetrac-drkirkby · 2010-10-29T02:47:28Z

comment:10

You should open a new trac ticket for this.

Dave

sagetrac-drkirkby · 2010-10-29T03:40:49Z

comment:11

I've created a new trac ticket for you - see #10185.

sagetrac-drkirkby · 2010-10-29T03:56:17Z

comment:12

I realise this ticket was still open, but I still think the Fedora issue should go on a ticket of its own. The package I made for this ticket is not the latest ECL, so if we do update ECL, we will probably end up using a later version of it. The version here does not have some fixes which are in the current ECL in Sage. In particular, #9917 has fixes which are not in my package referenced here.

vbraun · 2010-10-29T13:59:11Z

comment:13

I went through ./src/src/c/dpp.c in your ecl-10.4.1 spkg (http://boxen.math.washington.edu/home/kirkby/revised-patches/ecl-10.4.1.spkg) and checked that all fprint()s have the right number of arguments. So upstream fixed #9917 and we don't have to patch it any more.

I removed the included gmp as discussed in #9493.

Are there any other outstanding patches? I've looked through trac and there seem to be many overlapping discussions. But I could not find any outstanding bugs.

The new ecl requires also a new maxima (5.22.1 is newest upstream release), so we have to update both at the same time. I've created #10187 for a simultaneous ecl+maxima update.

vbraun · 2011-02-19T13:37:56Z

comment:14

This ticket can be closed as we did update to ecl-10.4.1 a while ago.

kcrisman · 2011-06-28T16:07:52Z

comment:15

In fact, now ECL is at version 11.1.1 in Sage. #9493 is still open for the GMP removal, otherwise this ticket can be closed.

kcrisman · 2011-06-28T16:07:52Z

Changed author from David Kirkby to none

kcrisman · 2011-06-28T16:07:52Z

Changed reviewer from Nils Bruin to Volker Braun

nexttime · 2011-06-28T16:15:25Z

comment:17

Replying to @kcrisman:

In fact, now ECL is at version 11.1.1 in Sage. #9493 is still open for the GMP removal, otherwise this ticket can be closed.

I wonder if at least my Special Update / Build Instructions from there went into the ECL spkg... 8)

kcrisman · 2011-06-28T16:19:44Z

comment:18

Well, unpack ecl-11.1.1.p1.spkg and find out. At any rate, that is on the ticket description at #9493 still, so this ticket should be closed.

kcrisman · 2011-06-28T16:20:11Z

comment:19

Replying to @kcrisman:

Well, unpack ecl-11.1.1.p1.spkg and find out. At any rate, that is on the ticket description at #9493 still, so this ticket should be closed.

No offense intended, by the way - it just seems more relevant to discuss this at that ticket.

nexttime · 2011-06-28T16:29:02Z

comment:20

Replying to @kcrisman:

Well, unpack ecl-11.1.1.p1.spkg and find out. At any rate, that is on the ticket description at #9493 still, so this ticket should be closed.

Could be the first time I ever use sage -info ... (which ought to dump SPKG.txt to the screen, but unfortunately currently doesn't: #11021). :D

sagetrac-drkirkby mannequin added this to the sage-4.7.1 milestone Jun 18, 2010

sagetrac-drkirkby mannequin added c: packages: standard labels Jun 18, 2010

This comment has been minimized.

Sign in to view

sagetrac-drkirkby mannequin added the s: needs review label Jun 19, 2010

nbruin added s: positive review and removed s: needs review labels Jun 21, 2010

rlmill mannequin removed the s: positive review label Jun 25, 2010

rlmill mannequin closed this as completed Jun 25, 2010

rlmill mannequin reopened this Jul 11, 2010

kcrisman added s: needs review and removed s: needs review labels Jun 28, 2011

kcrisman added the s: positive review label Jun 28, 2011

jdemeyer removed this from the sage-4.7.1 milestone Jun 28, 2011

jdemeyer removed the s: positive review label Jul 5, 2011

jdemeyer closed this as completed Jul 5, 2011

jdemeyer added r: duplicate and removed p: major / 3 labels Jul 5, 2011

qed777 mannequin mentioned this issue Jun 26, 2010

Parallel inter/intra-spkg builds #8306

Closed

sagetrac-drkirkby mannequin mentioned this issue Dec 18, 2010

ECL in Sage will not build on Fedora 14, which will be released on 2nd November 2010 #10185

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Apply ALL relevent fixes to ECL 10.4.1 #9264

Apply ALL relevent fixes to ECL 10.4.1 #9264

sagetrac-drkirkby mannequin commented Jun 18, 2010

This comment has been minimized.

nbruin commented Jun 18, 2010

sagetrac-drkirkby mannequin commented Jun 19, 2010

nbruin commented Jun 21, 2010

nbruin commented Jun 21, 2010

sagetrac-drkirkby mannequin commented Jun 25, 2010

rlmill mannequin commented Jun 25, 2010

rlmill mannequin commented Jun 25, 2010

rlmill mannequin commented Jul 11, 2010

vbraun commented Oct 29, 2010

sagetrac-drkirkby mannequin commented Oct 29, 2010

sagetrac-drkirkby mannequin commented Oct 29, 2010

sagetrac-drkirkby mannequin commented Oct 29, 2010

vbraun commented Oct 29, 2010

vbraun commented Feb 19, 2011

kcrisman commented Jun 28, 2011

kcrisman commented Jun 28, 2011

kcrisman commented Jun 28, 2011

nexttime mannequin commented Jun 28, 2011

kcrisman commented Jun 28, 2011

kcrisman commented Jun 28, 2011

nexttime mannequin commented Jun 28, 2011

Apply ALL relevent fixes to ECL 10.4.1 #9264

Apply ALL relevent fixes to ECL 10.4.1 #9264

Comments

sagetrac-drkirkby mannequin commented Jun 18, 2010

Important

This comment has been minimized.

nbruin commented Jun 18, 2010

sagetrac-drkirkby mannequin commented Jun 19, 2010

Testing on sage.math (Linux), 64-bit.

Note to Release manager

nbruin commented Jun 21, 2010

nbruin commented Jun 21, 2010

sagetrac-drkirkby mannequin commented Jun 25, 2010

Testing on OpenSolaris x64 06/2009 64-bit mode.

rlmill mannequin commented Jun 25, 2010

rlmill mannequin commented Jun 25, 2010

rlmill mannequin commented Jul 11, 2010

vbraun commented Oct 29, 2010

sagetrac-drkirkby mannequin commented Oct 29, 2010

sagetrac-drkirkby mannequin commented Oct 29, 2010

sagetrac-drkirkby mannequin commented Oct 29, 2010

vbraun commented Oct 29, 2010

vbraun commented Feb 19, 2011

kcrisman commented Jun 28, 2011

kcrisman commented Jun 28, 2011

kcrisman commented Jun 28, 2011

nexttime mannequin commented Jun 28, 2011

kcrisman commented Jun 28, 2011

kcrisman commented Jun 28, 2011

nexttime mannequin commented Jun 28, 2011