maxima not working under grsec kernel

[alan.d]

I can't tell how long this issue actually exists, but maxima segfaults under grsec kernels (works fine using vanilla kernels).
A few kernel versions back (but I do not remeber anymore, I guess some 4.4 release) maxima worked just fine.

Simply starting maxima from command-line results in a segfault, but there is nothing in the logs apart from the obvious:

Code: Select all

Jun 18 10:36:25 debian kernel: [   40.842254] grsec: denied resource overstep by requesting 4096 for RLIMIT_CORE against limit 0 for /usr/lib/maxima/5.38.0/binary-gcl/maxima[exe:1493] uid/euid:1000/1000 gid/egid:1000/1000, parent /bin/bash[bash:1486] uid/euid:1000/1000 gid/egid:1000/1000


strace: http://pastebin.com/uxgiTu0V
config: http://pastebin.com/YJL1YHnL

Code: Select all

Linux debian 4.5.0-2-grsec-amd64 #1 SMP Debian 4.5.7-1+grsec201606142010+1 (2016-06-17) x86_64 GNU/Linux


Code: Select all

user@debian:~$ getfattr -d /usr/lib/maxima/5.38.0/binary-gcl/maxima
getfattr: Removing leading '/' from absolute path names
# file: usr/lib/maxima/5.38.0/binary-gcl/maxima
user.pax.flags="em"


[PaX Team]

does it work if you also disable ASLR ('r' flag) on the binary?

[alan.d]

does it work if you also disable ASLR ('r' flag) on the binary?

Oh that did the trick! It works! Thanks a lot!