Octave - Language and interpreter for numerical computations
Pre-compiled downloads available for Linux, Mac OS X, Windows and others.
For example inverting a matrix works that simple:
$ A = [-2,1;1,-1]
$ inv(A)
