October 2012 - antik-devel - mailman3.common-lisp.net

[Antik-devel] first draft of numerical lisp
by Mirko Vukovic 28 Oct '12

28 Oct '12

I put up my first draft of numerical lisp on https://github.com/mirkov/numerical-lisp You will have to clone it and look at the documentation in the doc/developers/index.html. Comments, feedback, participation welcome. Mirko

4 4

[Antik-devel] ann: numerical-lisp on github.com
by Mirko Vukovic 22 Oct '12

22 Oct '12

Based on a recent discussion<https://groups.google.com/d/topic/lisp-stat/sYBndICy_HA/discussion>on the Common Lisp Statistics group, I decided to start a github project numerical-lisp <https://github.com/mirkov/numerical-lisp>. The purpose of the project is to serve as an ordered (as much as possible) collection of thoughts on what would make a useful and powerful system for numerical programming, analysis and visualization based on common-lisp. I suspect the discussion will be taking place on the common lisp statistics group, antik, and maybe others. I don't think that we should form yet another discussion forum. Coding would start in the next few months. The project would depend a great deal on Antik, gsll, cl-num-utils, and other numerical libraries. The goal is not to start yet another incompatible numerical library. Instead, the goal is to provide a flexible framework into which one can plug in existing libraries with relatively little modification. When it comes to coding, there will be relatively little intense numerical or graphics coding. Instead, we should use as many of already existing resources and libraries already available, and allow enough flexibility so as not to be locked to a particular library. We should also look at other systems (R, numpy, Matlab, mathematica, Macsyma), and incorporate their best features, albeit in a lispy way. The project may boil down to software engineering, and good language design (maybe we should study Fortress for hints) Right now the project is quite empty, and I will add to it over the coming weeks. Once I figure out how github operates for collaborative work, I would welcome contributions from others as well. I hope this to be a community effort. Mirko

4 6

Re: [Antik-devel] antik on clisp - some corrections
by Liam Healy 20 Oct '12

20 Oct '12

Mirko, If you know texinfo you can patch the doc source where the links are bad, otherwise I'll try to fix it. If you can create a git patch to the head of cffi-libffi I will take a look at it. I think I understand the reason for the conflict on 'second (the unit of time vs. the function that produces the second element of a sequence) but I don't know why it's not seen on other implementations. I don't understand the other conflicts off the top of my head. Liam On Sun, Oct 7, 2012 at 12:14 PM, Mirko Vukovic <mirko.vukovic(a)gmail.com>wrote: > Liam, > > I installed antik on clisp on cygwin+windows. (I also have it running on > sbcl & linux). > > To make it go I had to change a few things: > > - minor syntax tweak in the asd file (use :asdf-system-connections instead > of #:asdf-system-connections) > - shadow a few more cl symbols in package.lisp > > #+clisp #:second #+clisp #:fifth #+clisp #:tenth > #+clisp #:rem > > > Also, in a few files I had to specify `cl:second' instead of just `second' > > Now all but two tests are passing. > > Two questions/points: > - Maybe I missed something. Could that be the reason for the symbol > conflicts. > - If you want to accept these changes, what is the best way to submit them? > > Also, there are faulty links on the html documentation. Chapter five > links5 and 5.1 both lead to Section 4.5. > > Thank you for the antik. It is quite something. > > I will now proceed to adapt map-grid-utils to the version of grid that is > built into antik. > > Mirko > > >

2 1

Re: [Antik-devel] First post: common-lisp -> numerical-lisp->CL-statistics
by Liam Healy 14 Oct '12

14 Oct '12

Hi Mirko, Tamas, Tony, I am happy to read of these developments; they align very closely with what I have in mind in building grid and Antik. A little bit of background: I do numerical computation as part of my "day jobs," and have used Lisp for 25 years now, starting with the Symbolics. Over the decades, I developed for personal use only a rather (ahem) hackish set of numerical libraries and utilities. When GSL came out in the late 90s, I saw it as an opportunity to gain some numerical utilities without having to write them myself, but it took until CFFI's release in 2005 to spur me to start GSLL. I am of the mind that any correct library is potentially useful and should be available in CL; while I prefer to code in CL myself, if the library is already written, then I will try to use it. I realize others may differ. My goal in writing GSLL was to make the non-lispness of it as invisible as possible, so that it can be used with all the power of lisp and none of the hassles of C. One of the hacks I had in my old personal library was that of generic arrays. With some GSL functions needing arrays, I was forced to reinvent that. I did a lot of research of existing CL libraries, and settled on Tamas's affine library (which predates xarray, I believe) as a basis, and built on that. Eventually, this was split out from GSLL into the grid package in Antik, which also includes other numerical utilities. I envision that grids could address any kind of array-like structure (including, say SQL tables, structured files like FITS, HDF, etc.) because these are the kinds of things I use in my work. They should be as transparent as possible, so that if for example there is a function in GSL that does the same thing as another library (written in C, or CL, or whatever), I can send the exact same inputs and compare the outputs. There is a lot of work to be done to get Antik and grids to that point, and I welcome ideas, contributions, and patches. Unfortunately, my time on this has been very limited recently, but I intend to move this forward as best as I can. Mirko has sent me emails and I've been slow to respond. I think the antik-devel<http://lists.common-lisp.net/cgi-bin/mailman/listinfo/antik-devel>list is a good place to discuss any ideas, and its email archive may be useful in the future. It is my intent to be inclusive of different approaches as possible, so that even working entirely within CL using arrays and displaced arrays should be supported (currently, displaced arrays are not there). I look at languages like Fortran 90, Python, and Matlab, and I think there is opportunity to borrow idioms and features, and maybe have interfaces to some of those libraries. I don't know R but suspect it too has something to offer. As Mirko noted, I use (shadowed) CL symbols where possible. One special note about the current status: all development for the last several months or so (and there hasn't been much) is on the "cffi-libffi" branches. Over last fall and winter, working with Luís Oliveira, I have replaced FSBV with the system cffi-libffi, currently distributed on the master branch of CFFI. This is a significant improvement on FSBV because calling structures by value require nothing more than CFFI calls and having libffi (also, things like recursive structures should work). While this is in the master branch of CFFI, it is not yet in a released version of CFFI, so I have held off merging my cffi-libffi branches into master because Quicklisp only pulls from released versions of software, where such a concept is defined (it isn't for Antik and GSLL). However, I don't maintain the FSBV-based master branches any more. (I am copying antik-devel so that other Antik users will see.) Liam On Fri, Oct 12, 2012 at 7:45 AM, A.J. Rossini <blindglobe(a)gmail.com> wrote: > Hi Mirko - > > The other possibility is that depending on the complexity of Antik (sounds > like it does a good deal, whether it should all be in the same place is > another matter, which is just a question that I shouldn't ask until I read > the code later this weekend, Sorry for posing it prematureley!), we just > replace xarray with antik. Some of this might be pretty simple. > > > > On Friday, October 12, 2012 2:02:06 AM UTC+2, Mirko Vukovic wrote: >> >> This is a bit long-winded, but it may have some relevance to the >> architecture of CL-Statistics >> >> The other day, I was writing this as part of a sequence generating >> library documentation that I hope to release soon: >> >> The Intoruction to R<http://cran.r-project.org/doc/manuals/R-intro.html#Top> describes >> vectors<http://cran.r-project.org/doc/manuals/R-intro.html#Simple-manipulations-num…>. >> Of interest are also sections on factors<http://cran.r-project.org/doc/manuals/R-intro.html#Factors>, >> arrays and matrices<http://cran.r-project.org/doc/manuals/R-intro.html#Arrays-and-matrices>, >> and lists and data frames<http://cran.r-project.org/doc/manuals/R-intro.html#Lists-and-data-frames>. >> Finally, reading data<http://cran.r-project.org/doc/manuals/R-intro.html#Reading-data-from-files>is of interest. At this point, this is starting to sound like Rossini's >> project common-lisp-stat. However note that this project uses Tamas >> Papp's xarray. >> >> At that point, I went to google what Rossini was up to, and came upon >> this list. It was up for only a day or so when I found it. >> >> The reason for this post is that I am using Liam Healy's gsll and antik >> libraries. These use his grid library for representing vectors, matrices, >> etc. It is unfortunate that at the time Liam was releasing grid, Tamas >> released his xarray. >> >> Personally, I dislike fragmentation (grid vs xarray), but now nothing can >> be done about it. And some competition is good. >> >> The interesting part of Liam's antik is that antik shadows several of >> CL's symobls: many math functions, and also aref and aref*. He >> reimplements these as generic functions, allowing extension for other data >> types (such as grids). In a way, Liam is on his way to creating what I >> would call Numerical Lisp: Extension of CL for numerical computing that may >> be incompatible with CL. But the extension is a relatively thin layer on >> top of CL, leaving all of CL accessible. >> >> Futhermore, Numerical-Lisp (NL) can unify grid and xarray using the >> following three-layered structure: >> - Application layer, such as CL-Statistics >> - Numerical-Lisp layer >> - Raw libraries (grid/xarray) >> >> The numerical lisp layer would consist of Liam's redefinitions of CL >> mathematics related functions via generic functions. The raw libraries >> would hook into this via methods. In addition to CL mathematics functions, >> NL can define interface to higher mathematics functions also using generic >> functions. Then the raw libraries can plug in using packages such as GSL, >> LAPACK, etc. >> >> What needs to be done is >> - creation of the Numerical-Lisp library >> - hooks in grid and xarray >> - write the application layer to use Numerical-Lisp interface. >> >> It seems to me that much of this should be relatively straightforward. I >> would be glad to help in testing (sbcl, clisp) and documenting. >> >> Finally, what does this have to do with CL-statistics? Well, I am >> suggesting that the code be organized in a way to make it easy to >> transition from interfacing to CL & xarray into NL. >> >> Best, >> >> Mirko >> >> PS - and in the end, when all is said and done, someone writes a great >> book: Practical Numerical Lisp >> >

1 0