- armedbear-devel - mailman3.common-lisp.net

Better integration between ABCL & Java
by Blake McBride 30 Aug '15

30 Aug '15

Greetings, I worked hard on a project to link ABCL with a very large Java application. Although the addition of ABCL to that project failed, the work I did could be of use, and with some effort could be made to solve the problem I had. I believe the original problem I had would be a very common problem in similar circumstances. My pre-existing Java application has almost 10,000 classes! I wasn't about to create lisp cover functions for each java method. I also wasn't going to use a convoluted syntax to get to java each time. What I did was create some Java and Lisp code that, through reflection, caused the system to auto-generate a complete set of CLOS classes to mirror my primary java application classes - including the class hierarchy. The methods in these CLOS classes would call the Java methods. With this, when in Lisp, I could just use all of my Java classes and methods as regular CLOS classes and methods. It's use of Java classes and methods internally was transparent to lisp. All of this worked fine. The problem I ran into was the fact that Java can have several methods with the same name but different arguments. So, the Java method being called depended on the types and number of arguments too (not just the class of the instance and the method name). I never solved this, although I think it could be. I just ran out of time and steam, as well as other non-technical reasons. The reason I bring this all up now is because I am unclear about what problems Ralph is trying to solve. I thought what I have done may be of use. Thanks. Blake McBride

5 5

All conformance ansi-test's passed
by Ralph Ritoch 26 Aug '15

26 Aug '15

Hello, I have been able to get ABCL to pass all of the ansi conformance tests. While this is not an official ABCL release, all of the modifications I made are released under the MIT license and may be freely integrated into ABCL at the discretion of the maintainers. To embed this conforming version into your java applications add the following dependencies which have been released at maven central. <dependency> <groupId>com.vnetpublishing.lisp</groupId> <artifactId>jrelisp-abcl-impl</artifactId> <version>0.0.2</version> </dependency> <dependency> <groupId>com.vnetpublishing.lisp</groupId> <artifactId>jrelisp-abcl-contrib</artifactId> <version>0.0.2</version> </dependency> The source code for this release can be found at https://github.com/rritoch/jrelisp-abcl/tree/55e808d3c0084d16d1ed04c36a6f5a… . While I have moved some files around it is still an ABCL implementation that is mostly backwards-compatible with the official ABCL releases. Moving forward it is likely that any future development on these branches will further deviate from ABCL. I am not claiming that this solves EVERY compliance issue but I have found solutions for each of the ansi conformance test failures. Any remaining compliance issues can be considered a bug. My primary intention of passing every test is to lock the build process so that builds will fail if any of the ansi tests fail. It is unlikely that future modifications to these forks will have any relevance to ABCL. I will likely continue developing features that are needed for modern application development and therefore are of little interest to some, if not all, of the ABCL maintainers. That being said, v0.0.2 is the best release to source conformance solutions from for ABCL as it passes every conformance test. Any future releases will no longer be based on improving ABCL but be for the purpose of better supporting modern application development. Best Regards, Ralph Ritoch

5 7

loading lisp files from inside the java jar
by Hamda Binte Ajmal 18 Aug '15

18 Aug '15

Hi, I am sending this message again, as the last thread went a little too far. I have developed a Java Application that runs lisp code at the back end, and I use ABCL for that. Before using the lisp commands, I load a few .lisp files so that I can call the functions defined in those files. Everything works fine as long as I run the application from Netbeans. When I run the application from the jar file, it throws 'File not found error'. as the lisp files are not a part of file system inside the project jar. I tried to follow the suggestions given by Mark (load “jar:file:/absolute/path/to/file.jar!/path/within/jar/setup.lisp”) It shows the same File not found error. Am i missing something here? As suggested by Ralph to use (load-system-file "path/to/resource.lisp"), I tried to use that, but I was unable to access sys package, please let me know how to do this. I find the help documentation and tutorials very confusing, and difficult to understand. Any hints will be appreciated. Thanking in anticipation. Regards, Hamda NUIG, Ireland.

5 13

Re: Lisp filepath issues when running application directly from jar file
by Ralph Ritoch 17 Aug '15

17 Aug '15

This "idiot" refactored a very small portion of your code making it MUCH faster, and also passed more than 90% of the tests ABCL is currently failing, leaving only 3 ansi-tests that are still failing. If I'm an idiot it doesn't say much about you since you've been working on this for years and I've only been working on it for weeks. Best Regards, Ralph Ritoch On Mon, Aug 17, 2015 at 8:00 PM, <armedbear-devel-request(a)common-lisp.net> wrote: > Send armedbear-devel mailing list submissions to > armedbear-devel(a)common-lisp.net > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.common-lisp.net/listinfo/armedbear-devel > or, via email, send a message with subject or body 'help' to > armedbear-devel-request(a)common-lisp.net > > You can reach the person managing the list at > armedbear-devel-owner(a)common-lisp.net > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of armedbear-devel digest..." > > > Today's Topics: > > 1. Re: Lisp filepath issues when running application directly > from jar file (Mark Evenson) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Sun, 16 Aug 2015 14:38:44 +0200 > From: Mark Evenson <evenson(a)panix.com> > To: Armed Bear <armedbear-devel(a)common-lisp.net> > Subject: Re: Lisp filepath issues when running application directly > from jar file > Message-ID: <5616917D-F789-4F95-93E2-FC3B7633B051(a)panix.com> > Content-Type: text/plain; charset="utf-8" > > > > On Aug 16, 2015, at 02:34, Ralph Ritoch <rritoch(a)gmail.com> wrote: > > > > I have used this function in my code without ANY problems. [?] > > The SYSTEM package is not intended to be used by users unless there is no > alternative. The manual states clearly that functionality provided by > SYSTEM > is subject to be changed between major releases without warning. > Therefore, > the argument in this case isn?t that one would have problems using > SYSTEM:LOAD-SYSTEM-FILE, but rather that one should use the ANSI interface > as > implemented CL:LOAD which should be able to load Lisp and/or fasls in all > cases > needed by the user. My work on EXT:JAR-PATHNAME and EXT:URL-PATHNAME was > motivated by precisely the need for CL:LOAD to work in all conceivable > cases in > the JVM ecology. And the best contemporary mechanism for expression for > resolution of and dependency order for CL:LOAD lies in ASDF, hence my > emphasis on using its abstraction where extending CL:LOAD is not desirable. > > As a side note, over time, we wish to move functions in SYSTEM which > useful to > the user into the EXTENSION package, but this work is incomplete at best. > Currently, there are indeed cases in which using a function from SYSTEM is > unavoidable. The use of SYSTEM:LOAD-SYSTEM-FILE is not one of them. > > > Your attitude regarding "progress" is archaic. If you don't want to > support maven or other java technologies why do you even bother controlling > abcl? > > > Your attitude towards discussion is not only archaic (i.e. immature) but > counterproductive towards reaching the sort of consensus needed for > progress. > > However misguided such an endeavor may be, a couple points follow towards a > defense from your sleazy ad hominem ?argumentation?. > > As for supporting Maven, I have developed the machinery to use Maven > artifacts > in ABCL-ASDF, and continued to maintain them (with help from users) even > as the > lurching horror that comprises Maven release engineering continues to > change > API semantics between patch level releases. I have offered to collaborate > with you on incorporating your initial work on building from Maven, > pointing > out the problems that I see with your approach to which I have received no > reply. > > As for supporting ?other technologies?, I suppose you are referring to your > attempt to merge abcl-contrib.jar and abcl.jar. In this effort, I pointed > out > you could do this cleanly with the current code by adding site-specific > code to > the ?system.lisp? file whose contents are controlled by the Ant build > process. > Since your Maven build doesn?t use the Ant target to package (one of my > explicit criticisms), you presumedly weren?t interested in using this > mechanism. I responded twice to your proposal to probe jar files on the > classpath for code to pontential load with suggestions which you found too > burdensome to discuss so you developed what you needed. Your email > announcing > this implementation implied you had implemented to a ?specification?, but > no > such entity existed external to the source code. If you wish to provide > such a > specification for your current implementation, please do so that others may > consider its usefulness. > > As to whether I control ABCL, I was going to reply that I am but one > maintainer > out of five; that you are welcome to convince a majority of the maintainers > through useful and accepted contributions that that you should be in > ?control? > too; and that since the code is GPL?d so you are welcome to get the fork > out of > here. But at this point, I would reply that if I do somehow ?control? > ABCL, I > am glad to protect it from idiots like you. > > -- > "A screaming comes across the sky. It has happened before but there is > nothing > to compare to it now." > > > > > >

5 7

Lisp filepath issues when running application directly from jar file
by Hamda Binte Ajmal 17 Aug '15

17 Aug '15

Hi, I was working on an application, that loads a few lisp files using lisp command (load "fullfilepath.lisp") from java using ABCL. This file in turn loads the other lisp files located in same folder hierarchy, and then i call lisp functions (defined in these files) from java and everything works perfect as long as I run the application from Netbeans. Close to deployment, I tested the application by running it from jar file, I found that there are issues with filepaths, as the files are not a part of file-system, and hence not accessible using a file-path. Does anyone has any idea how to fix this issue ? I tried many things, like URL url = LispConnector.class.getResource("/Aima/aima/quicklisp/setup.lisp");String path = url.getFile();File f = new File(path); path = f.getAbsolutePath(); path = path.replace("\\", "/"); which returns [image: enter image description here] But which is wrong as this is not a valid file path and does not exists so lisp : (load "filepath") fails here. When I use the code String path = url.toURI();File = new File(path); path = path.getAbsolutePath(); Again it works fine while running from netbeans, but shows error "URI is not hierarchical" error while running the jar file. Has anyone encountered this issue, please help. -- Hamda Binte Ajmal NUIG, Ireland

2 2

Re: Lisp filepath issues when running application directly from jar file
by Ralph Ritoch 16 Aug '15

16 Aug '15

Hello, Since you are loading resources and not from the filesystem you probably want to utilize the load-system-file function which I believe is provided by the :sys package. I'm not sure how portable this is so you may want to add some additional control logic if you want portability. (load-system-file "path/to/resource.lisp") Best Regards, Ralph Ritoch On Fri, Aug 14, 2015 at 8:00 PM, <armedbear-devel-request(a)common-lisp.net> wrote: > Send armedbear-devel mailing list submissions to > armedbear-devel(a)common-lisp.net > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.common-lisp.net/listinfo/armedbear-devel > or, via email, send a message with subject or body 'help' to > armedbear-devel-request(a)common-lisp.net > > You can reach the person managing the list at > armedbear-devel-owner(a)common-lisp.net > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of armedbear-devel digest..." > > > Today's Topics: > > 1. Lisp filepath issues when running application directly from > jar file (Hamda Binte Ajmal) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 14 Aug 2015 11:20:18 +0100 > From: Hamda Binte Ajmal <hamda.binte.ajmal(a)gmail.com> > To: armedbear-devel(a)common-lisp.net > Subject: Lisp filepath issues when running application directly from > jar file > Message-ID: > <CAJEb= > LPJuCP6FJoTxuCGaapbo4FHdjnWdEf_QumgMJF-9BhHXQ(a)mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Hi, > I was working on an application, that loads a few lisp files using lisp > command > (load "fullfilepath.lisp") from java using ABCL. > This file in turn loads the other lisp files located in same folder > hierarchy, and then i call lisp functions (defined in these files) from > java and everything works perfect as long as I run the application from > Netbeans. > Close to deployment, I tested the application by running it from jar file, > I found that there are issues with filepaths, as the files are not a part > of file-system, and hence not accessible using a file-path. > Does anyone has any idea how to fix this issue ? > I tried many things, like > > URL url = > LispConnector.class.getResource("/Aima/aima/quicklisp/setup.lisp");String > path = url.getFile();File f = new File(path); > path = f.getAbsolutePath(); > path = path.replace("\\", "/"); > > which returns [image: enter image description here] > > But which is wrong as this is not a valid file path and does not exists so > lisp : (load "filepath") fails here. > > When I use the code > > String path = url.toURI();File = new File(path); > path = path.getAbsolutePath(); > > Again it works fine while running from netbeans, but shows error "URI is > not hierarchical" error while running the jar file. > > Has anyone encountered this issue, please help. > > > -- > Hamda Binte Ajmal > NUIG, Ireland >

2 3

ABCL on jailbroken iPhone
by Vibhu Mohindra 12 Aug '15

12 Aug '15

My jailbroken iPhone has GNU classpath[0] and jamvm[1] installed. To get ABCL working with GNU classpath, I needed to patch two of classpath's classes as below. I patched and built classpath in a Linux VM, then extracted the two class files from the resulting glibj.zip and inserted them into the iPhone's /usr/share/classpath/glibj.zip . I've reported these modifications to: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=67188 https://gcc.gnu.org/bugzilla/show_bug.cgi?id=67189 the latter of which may be an ABCL problem, not a GNU classpath one. (Performance: The ABCL REPL takes a few minutes to appear, but things look good when it does.) ref: [0] http://www.gnu.org/software/classpath/ [1] http://jamvm.sourceforge.net/ Vibhu diff -Naur classpath-0.99/java/math/BigInteger.java classpath-0.99.abcl/java/math/BigInteger.java --- classpath-0.99/java/math/BigInteger.java 2010-09-02 17:47:07.000000000 +0100 +++ classpath-0.99.abcl/java/math/BigInteger.java 2015-08-11 02:01:18.000000000 +0100 @@ -183,6 +183,7 @@ int i, digit; boolean negative; byte[] bytes; + if (len == 0) throw new NumberFormatException("zero length big integer"); char ch = s.charAt(0); if (ch == '-') { diff -Naur classpath-0.99/java/nio/charset/CharsetEncoder.java classpath-0.99.abcl/java/nio/charset/CharsetEncoder.java --- classpath-0.99/java/nio/charset/CharsetEncoder.java 2010-06-03 20:13:04.000000000 +0100 +++ classpath-0.99.abcl/java/nio/charset/CharsetEncoder.java 2015-08-12 12:16:13.000000000 +0100 @@ -159,8 +159,6 @@ // in progress" and also that "it resets this Encoder". // Should we check to see that the state is reset, or should we // call reset()? - if (state != STATE_RESET) - throw new IllegalStateException (); // REVIEW: Using max instead of average may allocate a very large // buffer. Maybe we should do something more efficient? @@ -199,9 +197,6 @@ // a return value indicating an incomplete decoding operation" // XXX: We will not check the previous return value, just // that the previous call passed true for endOfInput - if (state != STATE_RESET && state != STATE_CODING - && !(endOfInput && state == STATE_END)) - throw new IllegalStateException (); state = newState; for (;;)

1 0

Proposal to improve the loading of the abcl-contrib dependency.
by Ralph Ritoch 03 Aug '15

03 Aug '15

Hi, I have run into an issue with making executable abcl jars when the jar depends on, and provides, abcl-contrib. As far as I can tell abcl looks for abcl-contrib in the following locations. 1. Looks for a jar named abcl-contrib.jar in the classpath determined by probing the classloader for the jars it provides. 2. Looks in the directory of the jars in the classpath for a file named abcl-contrib.jar Neither of these solutions work if the currently executing jar includes abcl-contrib and isn't named abcl-contrib.jar. The following code proves that it is relatively easy to add this capability. (in-package 'sys) (sys:add-contrib (make-pathname :defaults (java:jcall "toString" (svref (java:jcall "getURLs" (sys:boot-classloader)) 0)))) This code properly loads abcl-contrib when the executing jar provides abcl-contrib, while (require 'abcl-contrib) does not. My proposal is to add a file named abcl-contrib/version.lisp to the abcl-contrib.jar, possibly in the /META-INF directory to avoid any potential conflicts with java, and to have sys:find-contrib look for this file in the resources provided by the classpath. The contents of this file is not important. This change makes it possible to include the abcl-contrib "dependency" directly inside the jar application that is currently running, regardless of the name of the jar file. Therefore, applications which make use of abcl-contrib can be distributed as a single jar. For maven users, this means that their uberjars will work by just including abcl and abcl-contrib as dependencies. For ant users they would probably need to extract abcl-contrib and include the extracted files in their generated jar which I believe can be fully automated. It would be relatively easy for me to produce a patch to provide this feature as part of ABCL. It may be possible to provide this feature as an add-on, but the functions needed within the system package are private (not exported) so it would be difficult, if not impossible, to implement this feature as an add-on. I would like your feedback on this issue. If this is a feature you want, or if you have any specific objections to including this feature in ABCL, please let me know. Best Regards, Ralph Ritoch

2 11

Build ABCL with Maven using these updated POM files.
by Ralph Ritoch 03 Aug '15

03 Aug '15

Hi, I have created some maven POM files which can be used to build and deploy ABCL with maven. There have been a few modifications to these over the past few days and there is probably room for improvement but these make it possible to build and depoy ABCL with the normal maven lifecycle. Included are the following pom.xml => abcl\pom.xml (abcl-parent) main-pom.xml => abcl\main\pom.xml (abcl) contrib-pom.xml => abcl\contrib\pom.xml (abcl-contrib) Note: Filenames are relative to the trunk so they include the abcl prefix. These have been posted as a gist on github at https://gist.github.com/rritoch/70f9f211c523499b794a I have tested by deploying to my localrepo and the abcl artifact is functional. Additional work may be needed on the abcl-contrib artifact POM because I'm unsure how to test it. The file size is similar to the one generated by ant so it may be correct. Best Regards, Ralph Ritoch

2 4

Are you looking for an idea for an ABCL project?
by Ralph Ritoch 01 Aug '15

01 Aug '15

Hi, I was invited by someone in the virt.x community to add ABCL to the virt.x project http://vertx.io/ . I don't foresee having the time to do the integration this year but if anyone is interested it looks like there are many in the Java development community who are interested in using common-lisp in their JVM applications. The virt.x system supports maven and integration with vert.x will most likely require that the maven integration issues, including integration of abcl-contrib from the classpath (maven) be resolved before integration will be possible. I don't currently use virt.x but it looks like a good system for large teams with diverse programming backgrounds. Best Regards, Ralph Ritoch

1 0