October 2012 - pro - mailman3.common-lisp.net

[pro] Search engine development discussion.
by orange thirty 30 Oct '12

30 Oct '12

Hello all, My name is Pablo Rivera (orangethirty), founder of Nuuton.com. Been a software engineer for a while and have used LISP in various situations before. I joined this list in order to create an open discussion regarding the development of the Nuuton search engine. It is being developed with Common LISP (GNU CLISP). We are currently in the design stage, and have not written a line of LISP. That is why I'm here. I would like to learn about your opinions before doing anything. As a collective, this group has a lot of knowledge about the language. Knowledge that will allow us to build a better search engine with LISP. After searching around the web, I've found some projects aimed at developing web crawlers and the like with LISP. Though nothing too big or concrete. My guess is that no one has ever tried to write such system for production use. I hope to be wrong in those accounts. I will ask for your input in terms of judging how well the implementations currently available will fit Nuuton. The first stage for the Nuuton search engine is to build a very basic crawling system. We already have one in Python. But I refuse to port over the Python code to LISP, because it would undermine the latter. If you so wish, I can go ahead and translate the Python code to LISP and we can work from there. About the project: Nuuton is a new search engine. It is being actively developed by a team of three programmers. Our aim is to develop the search engine programmers need and want. Currently, our only focus is in serving the programming community. All the help you give us will in turn help the community in getting a good search engine that is not riddled with advertisements. Nuuton is also not in the business of selling advertising. We respect your privacy and will not demand that you hand over your personal information. Ever. I chose LISP because it provides the flexibility that we need for semantic web search. Questions, opinions, anything is welcome. (If this is the wrong mailing list, please point me in the right direction.) -- Pablo Rivera Sent from my C64 Skype: orange.thirty

3 2

[pro] Sensible interpretation of declarations in CLOS
by Juan Jose Garcia-Ripoll 29 Oct '12

29 Oct '12

Dear all, I am retaking an old question, which is the utility of type declarations in a language that has the flexibility of the MOP. In an extremely open-minded setup, where any class is prone to change, not only their structure, but also their metaclass, it would seem that a local declaration of the kind (DECLARE (MY-CLASS FOO)) would be totally useless. But... do you actually face that flexibility in real life? I mean, declarations such as (DECLARE (TYPE MY-INTEGER-TYPE FOO)) are used in actual code, where there is an implicit contract that the DEFTYPE type will not be changed in unsafe code. Can't we assume something similar when facing CLOS? What would be a reasonable optimization/safety/debug level to start considering that? Best, Juanjo -- Instituto de Física Fundamental, CSIC c/ Serrano, 113b, Madrid 28006 (Spain) http://juanjose.garciaripoll.googlepages.com

5 6

[pro] Curating libraries
by Faré 28 Oct '12

28 Oct '12

Dear Dan, Maybe we should be moving this discussion to another list. I've asked admin(a)common-lisp.net to create lisp-interface-library-devel. >: Dan Lentz > Regarding consolidation under LIL just wondering if someone might have > suggestions for individual authors of CL data structure libraries on > how to work in a way most cooperative with the effort. For example I > have a small ctrie lib (http://github.com/danlentz/cl-ctrie) the > objective should be to refactor based on what unique interface it > could provide, such as "concurrent" or "lock-free"? > > Perhaps this question is somewhat specific to LIL but it is a project > I've been following with interest > It would be delighted to help with such an effort, either a merge of the two libraries, or a layer to make them work together. Also, considering that LIL has so few users (just drewc and I, IIUC), it is still time to rename basic API functions if you have strong opinions. While adding support for concurrent data structures has long been on my TODO list, I admit I haven't given much thought on how to automate (or not) whatever locking is required (or not) on various methods (not the same methods, depending on the data structure). So far, my hypothesis is that nothing needs to be changed as far as the signature of map interfaces goes: the underlying implementation may or may not be concurrent, that doesn't directly affect the calling conventions. Of course, concurrently accessing a non-concurrent data structure may blow up in your face, but I don't know how to express linearity constraints in Lisp, yet. That's a topic I'm actively researching, though, and suggestions are welcome. In short, I'd love that to happen, I'm ready to help, and a small data structure library is the perfect place to start. PS: I've added you as a contributor on https://github.com/fare/lisp-interface-library —♯ƒ • François-René ÐVB Rideau •Reflection&Cybernethics• http://fare.tunes.org Be careful what you set your heart on — for it will surely be yours. — James Baldwin, "Nobody Knows My Name"

1 0

Re: [pro] pro Digest, Vol 24, Issue 5
by Dan Lentz 28 Oct '12

28 Oct '12

Regarding consolidation under LIL just wondering if someone might have suggestions for individual authors of CL data structure libraries on how to work in a way most cooperative with the effort. For example I have a small ctrie lib (http://github.com/danlentz/cl-ctrie) the objective should be to refactor based on what unique interface it could provide, such as "concurrent" or "lock-free"? Perhaps this question is somewhat specific to LIL but it is a project I've been following with interest ---- Replace the method the carefully chosen name deletes the comment On Oct 28, 2012, at 3:01 PM, "pro-request(a)common-lisp.net" <pro-request(a)common-lisp.net> wrote: > Send pro mailing list submissions to > pro(a)common-lisp.net > > To subscribe or unsubscribe via the World Wide Web, visit > http://lists.common-lisp.net/cgi-bin/mailman/listinfo/pro > or, via email, send a message with subject or body 'help' to > pro-request(a)common-lisp.net > > You can reach the person managing the list at > pro-owner(a)common-lisp.net > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of pro digest..." > > > Today's Topics: > > 1. Curating libraries (Far?) > 2. Re: Curating libraries (A.J. Rossini) > 3. Re: Curating libraries (Far?) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Sun, 28 Oct 2012 09:50:18 +0900 > From: Far? <fahree(a)gmail.com> > To: Common Lisp Professionals <pro(a)common-lisp.net> > Subject: [pro] Curating libraries > Message-ID: > <CAN7nBXfK6R7xB4R_afRdLZ_aR_cyjq14=NVTdVLVEdvWmPPLEQ(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > Dear Lisp pro, > > I think it is time for us (the Lisp professionals) to do a better job > at curating libraries. > > Now that, thanks to Quicklisp, people aren't afraid from using > libraries anymore, > we find that there are too many libraries for any given problem domain, > yet that most of these libraries do a bad 80% job max (sometimes 50% or less). > Moreover, navigating which of these libraries makes most sense to use is hard. > > Ideally, we'd have a one distinguished library providing a 100% solution > for any such domain, that we could use and recommend, and that would have > an easily recognized name. > > For instance, regarding pattern-matching libraries, I'd like to retire > fare-matcher, > and after migrating any remaining useful functionality (such as > fare-quasiquote), > recommend that all users should use optima instead. I would similarly push > toward the retirement of all other pattern-matching libraries but one. > That one library could then be called "pattern-matching" and use the package > "pattern-matching". > > Similarly, I'm trying to push for a single data structure library. > This time, I'm putting forward my own Lisp-Interface-Library (aka LIL) > because I think it has much more potential than other libraries, > including some with a lot of existing data structures (such as cl-containers): > Indeed, LIL can accommodate both pure and stateful data structures, > in both Interface-Passing Style (IPS) and > traditional Object-Oriented Programming (OOP), > with automatic mapping between the four combinations. > Moreover, its IPS allows for parametric polymorphism, > which wasn't previously available in CL, and > is great to bootstrap new data structures. > > I'd like to invite you to join me in this effort. > Whichever libraries you use or maintain, > please partake in this consolidation effort. > > ??? ? Fran?ois-Ren? ?VB Rideau ?Reflection&Cybernethics? http://fare.tunes.org > The problem with being a citizen of the world is > that you don't get to travelling abroad much. > > > > ------------------------------ > > Message: 2 > Date: Sun, 28 Oct 2012 08:25:48 +0100 > From: "A.J. Rossini" <blindglobe(a)gmail.com> > To: Far? <fahree(a)gmail.com> > Cc: Common Lisp Professionals <pro(a)common-lisp.net> > Subject: Re: [pro] Curating libraries > Message-ID: > <CAA1MS4pVM0-ePAPsA1Dx_FH8dTWsxr1zHKk6YSMUhqbuFyFu=A(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > On Sun, Oct 28, 2012 at 2:50 AM, Far? <fahree(a)gmail.com> wrote: > >> I'd like to invite you to join me in this effort. >> Whichever libraries you use or maintain, >> please partake in this consolidation effort. > > As discussed, am looking at the data importers ((text)-file or system > to CL array, i.e. the prototypical CSV to CL-array importer), and > would be happy to work with others who want to take a lead on this > topic (I'm aware of 5-6 blog posts over the past few years to review > as part of due diligence, and 5+ different systems which range from > simple importers to a bit more sophisticated state machine parsers...) > > I eventually need something like a unified version of R's foreign > package (unified with the other data importer and exporter packages), > but of course, need to start somewhere, and somewhere is with CSV, > TSV, and similiar delimiter-separated-values (DSV). > > best, > -tony > > blindglobe(a)gmail.com > Muttenz, Switzerland. > "Commit early,commit often, and commit in a repository from which we > can easily roll-back your mistakes" (AJR, 4Jan05). > > Drink Coffee: Do stupid things faster with more energy! > > > > ------------------------------ > > Message: 3 > Date: Sun, 28 Oct 2012 17:01:58 +0900 > From: Far? <fahree(a)gmail.com> > To: "A.J. Rossini" <blindglobe(a)gmail.com> > Cc: Common Lisp Professionals <pro(a)common-lisp.net> > Subject: Re: [pro] Curating libraries > Message-ID: > <CAN7nBXcSAopSCLcWVeYM=2HQfFczLfuD-LNqBNs_xwyTmPjzDw(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > On Sun, Oct 28, 2012 at 4:25 PM, A.J. Rossini <blindglobe(a)gmail.com> wrote: >> On Sun, Oct 28, 2012 at 2:50 AM, Far? <fahree(a)gmail.com> wrote: >> >>> I'd like to invite you to join me in this effort. >>> Whichever libraries you use or maintain, >>> please partake in this consolidation effort. >> >> As discussed, am looking at the data importers ((text)-file or system >> to CL array, i.e. the prototypical CSV to CL-array importer), and >> would be happy to work with others who want to take a lead on this >> topic (I'm aware of 5-6 blog posts over the past few years to review >> as part of due diligence, and 5+ different systems which range from >> simple importers to a bit more sophisticated state machine parsers...) >> >> I eventually need something like a unified version of R's foreign >> package (unified with the other data importer and exporter packages), >> but of course, need to start somewhere, and somewhere is with CSV, >> TSV, and similiar delimiter-separated-values (DSV). > Speaking of CSV, a few years back I reviewed the existing offering and > beefed up my fare-csv library which was lagging behind so it was > better than all other available CSV libraries (at the time): fare-csv > can be configured to be compliant with at least two conflicting CSV > standards, and more, and by default follows the more relaxed > "Creativyst" specification. > > I haven't followed recent developments, but there as in other cases, > someone who actually develops or uses these libraries should drive a > consolidation. > > ??? ? Fran?ois-Ren? ?VB Rideau ?Reflection&Cybernethics? http://fare.tunes.org > You cannot teach a man anything; you can only help him find it for himself. > ? attributed to Galileo Galilei > > > > ------------------------------ > > _______________________________________________ > pro mailing list > pro(a)common-lisp.net > http://lists.common-lisp.net/cgi-bin/mailman/listinfo/pro > > End of pro Digest, Vol 24, Issue 5 > **********************************

1 0

[pro] Curating libraries
by Faré 28 Oct '12

28 Oct '12

Dear Lisp pro, I think it is time for us (the Lisp professionals) to do a better job at curating libraries. Now that, thanks to Quicklisp, people aren't afraid from using libraries anymore, we find that there are too many libraries for any given problem domain, yet that most of these libraries do a bad 80% job max (sometimes 50% or less). Moreover, navigating which of these libraries makes most sense to use is hard. Ideally, we'd have a one distinguished library providing a 100% solution for any such domain, that we could use and recommend, and that would have an easily recognized name. For instance, regarding pattern-matching libraries, I'd like to retire fare-matcher, and after migrating any remaining useful functionality (such as fare-quasiquote), recommend that all users should use optima instead. I would similarly push toward the retirement of all other pattern-matching libraries but one. That one library could then be called "pattern-matching" and use the package "pattern-matching". Similarly, I'm trying to push for a single data structure library. This time, I'm putting forward my own Lisp-Interface-Library (aka LIL) because I think it has much more potential than other libraries, including some with a lot of existing data structures (such as cl-containers): Indeed, LIL can accommodate both pure and stateful data structures, in both Interface-Passing Style (IPS) and traditional Object-Oriented Programming (OOP), with automatic mapping between the four combinations. Moreover, its IPS allows for parametric polymorphism, which wasn't previously available in CL, and is great to bootstrap new data structures. I'd like to invite you to join me in this effort. Whichever libraries you use or maintain, please partake in this consolidation effort. —♯ƒ • François-René ÐVB Rideau •Reflection&Cybernethics• http://fare.tunes.org The problem with being a citizen of the world is that you don't get to travelling abroad much.

2 2

[pro] Dan Weinreb Memorial Celebration
by Tom Emerson 09 Oct '12

09 Oct '12

[Apologies for those for whom this is a repost] Dan Weinreb Memorial Celebration A memorial to celebrate the life of Dan Weinreb will be held on Sunday, October 21, 2012 from 1:30 p.m. - 4:30 p.m. Chatham Café, 3 Cambridge Center, 4th floor, Cambridge, MA Family and friends are welcome to join us as we share memories of Dan and celebrate his life. A short program will begin at 2:15 p.m. If you plan to attend, please RSVP using the following link: http://anyvite.com/events/home/dcbce0bnop Knowing how many people are attending will help us greatly. Additional information about the event is available on Facebook at http://www.facebook.com/events/360648707356145/ Please CHECK the Facebook link before you attend for any changes in location or time. The page will also contain information about parking and directions. For questions or more information, contact Dena Brody at denabrody(a)comcast.net -- Tom Emerson tremerson(a)gmail.com http://www.dreamersrealm.net/tree

1 0

[pro] [Q] introspecting setf expanders
by Didier Verna 09 Oct '12

09 Oct '12

Hello, I cannot find a standard way to figure out whether a setf expander has been defined for a symbol FOO (via either DEFSETF or DEFINE-SETF-EXPANDER). Is there one? Otherwise, I would also be happy with an SBCL-only solution. Thank you ! -- Resistance is futile. You will be jazzimilated. Scientific site: http://www.lrde.epita.fr/~didier Music (Jazz) site: http://www.didierverna.com

6 7

[pro] examples of compiled embedded DSL
by Yakov Zaytsev 30 Sep '12

30 Sep '12

hello all, i'm looking for examples of small languages embedded in Common Lisp which are compiled so effectively small language programs do not run from the host compiler (CL) environment but from other run-time i know about parenscript and would love to know about more available in the public (or story about closed implementations)

2 1