cffi-devel

Download

cffi-devel@common-lisp.net

May 2018

3 participants
2 discussions

Nix / Guix compatibility
by Pierre Neidhardt 19 May '18

19 May '18

CFFI fails to find libraries on Nix / Guix. This is (probably) because those two distributions don't follow the traditional filesystem hierarchy /lib, /usr/lib, etc. For instance, trying to load sqlite-lib yields the following backtrace: --8<---------------cut here---------------start------------->8--- Unable to load any of the alternatives: ("libsqlite3.so.0" "libsqlite3.so") [Condition of type LOAD-FOREIGN-LIBRARY-ERROR] Restarts: 0: [RETRY] Try loading the foreign library again. 1: [USE-VALUE] Use another library instead. 2: [TRY-RECOMPILING] Recompile sqlite-ffi and try loading it again 3: [RETRY] Retry loading FASL for #<CL-SOURCE-FILE "sqlite" "sqlite-ffi">. 4: [ACCEPT] Continue, treating loading FASL for #<CL-SOURCE-FILE "sqlite" "sqlite-ffi"> as having been successful. 5: [RETRY] Retry ASDF operation. --more-- Backtrace: 0: (CFFI::FL-ERROR "Unable to load any of the alternatives:~% ~S" ("libsqlite3.so.0" "libsqlite3.so")) 1: (CFFI::TRY-FOREIGN-LIBRARY-ALTERNATIVES SQLITE3-LIB ("libsqlite3.so.0" "libsqlite3.so") NIL) 2: ((FLET CFFI::%DO-LOAD :IN CFFI::%DO-LOAD-FOREIGN-LIBRARY) #<FOREIGN-LIBRARY SQLITE3-LIB> SQLITE3-LIB (:OR "libsqlite3.so.0" "libsqlite3.so")) 3: (LOAD-FOREIGN-LIBRARY SQLITE3-LIB :SEARCH-PATH NIL) 4: (SB-FASL::LOAD-FASL-GROUP #S(SB-FASL::FASL-INPUT :STREAM #<SB-SYS:FD-STREAM for "file /home/ambrevar/.cache/common-lisp/sbcl-1.4.4-linux-x64/home/ambrevar/quicklisp/dists/quicklisp/software/cl-sqlite-.. 5: (SB-FASL::LOAD-AS-FASL #<SB-SYS:FD-STREAM for "file /home/ambrevar/.cache/common-lisp/sbcl-1.4.4-linux-x64/home/ambrevar/quicklisp/dists/quicklisp/software/cl-sqlite-20130615-git/sqlite-ffi.fasl" {100.. 6: ((FLET SB-FASL::THUNK :IN LOAD)) 7: (SB-FASL::CALL-WITH-LOAD-BINDINGS #<CLOSURE (FLET SB-FASL::THUNK :IN LOAD) {7FFFF6E4E31B}> #<SB-SYS:FD-STREAM for "file /home/ambrevar/.cache/common-lisp/sbcl-1.4.4-linux-x64/home/ambrevar/quicklisp/d.. 8: ((FLET SB-FASL::LOAD-STREAM :IN LOAD) #<SB-SYS:FD-STREAM for "file /home/ambrevar/.cache/common-lisp/sbcl-1.4.4-linux-x64/home/ambrevar/quicklisp/dists/quicklisp/software/cl-sqlite-20130615-git/sqlite.. 9: (LOAD #P"/home/ambrevar/.cache/common-lisp/sbcl-1.4.4-linux-x64/home/ambrevar/quicklisp/dists/quicklisp/software/cl-sqlite-20130615-git/sqlite-ffi.fasl" :VERBOSE NIL :PRINT NIL :IF-DOES-NOT-EXIST T :E.. 10: (UIOP/UTILITY:CALL-WITH-MUFFLED-CONDITIONS #<CLOSURE (LAMBDA NIL :IN UIOP/LISP-BUILD:LOAD*) {1002424CEB}> ("Overwriting already existing readtable ~S." #(#:FINALIZERS-OFF-WARNING :ASDF-FINALIZERS))) 11: ((SB-PCL::EMF ASDF/ACTION:PERFORM) #<unused argument> #<unused argument> #<ASDF/LISP-ACTION:LOAD-OP > #<ASDF/LISP-ACTION:CL-SOURCE-FILE "sqlite" "sqlite-ffi">) 12: ((LAMBDA NIL :IN ASDF/ACTION:CALL-WHILE-VISITING-ACTION)) 13: ((:METHOD ASDF/ACTION:PERFORM-WITH-RESTARTS (ASDF/LISP-ACTION:LOAD-OP ASDF/LISP-ACTION:CL-SOURCE-FILE)) #<ASDF/LISP-ACTION:LOAD-OP > #<ASDF/LISP-ACTION:CL-SOURCE-FILE "sqlite" "sqlite-ffi">) [fast-met.. 14: ((:METHOD ASDF/ACTION:PERFORM-WITH-RESTARTS :AROUND (T T)) #<ASDF/LISP-ACTION:LOAD-OP > #<ASDF/LISP-ACTION:CL-SOURCE-FILE "sqlite" "sqlite-ffi">) [fast-method] 15: ((:METHOD ASDF/PLAN:PERFORM-PLAN (T)) #<ASDF/PLAN:SEQUENTIAL-PLAN {10021FC613}>) [fast-method] 16: ((FLET SB-C::WITH-IT :IN SB-C::%WITH-COMPILATION-UNIT)) 17: ((:METHOD ASDF/PLAN:PERFORM-PLAN :AROUND (T)) #<ASDF/PLAN:SEQUENTIAL-PLAN {10021FC613}>) [fast-method] 18: ((:METHOD ASDF/OPERATE:OPERATE (ASDF/OPERATION:OPERATION ASDF/COMPONENT:COMPONENT)) #<ASDF/LISP-ACTION:LOAD-OP > #<ASDF/SYSTEM:SYSTEM "sqlite"> :PLAN-CLASS NIL :PLAN-OPTIONS NIL) [fast-method] 19: ((SB-PCL::EMF ASDF/OPERATE:OPERATE) #<unused argument> #<unused argument> #<ASDF/LISP-ACTION:LOAD-OP > #<ASDF/SYSTEM:SYSTEM "sqlite"> :VERBOSE NIL) 20: ((LAMBDA NIL :IN ASDF/OPERATE:OPERATE)) 21: ((:METHOD ASDF/OPERATE:OPERATE :AROUND (T T)) #<ASDF/LISP-ACTION:LOAD-OP > #<ASDF/SYSTEM:SYSTEM "sqlite"> :VERBOSE NIL) [fast-method] 22: ((SB-PCL::EMF ASDF/OPERATE:OPERATE) #<unused argument> #<unused argument> ASDF/LISP-ACTION:LOAD-OP "sqlite" :VERBOSE NIL) 23: ((LAMBDA NIL :IN ASDF/OPERATE:OPERATE)) 24: ((:METHOD ASDF/OPERATE:OPERATE :AROUND (T T)) ASDF/LISP-ACTION:LOAD-OP "sqlite" :VERBOSE NIL) [fast-method] 25: (ASDF/SESSION:CALL-WITH-ASDF-SESSION #<CLOSURE (LAMBDA NIL :IN ASDF/OPERATE:OPERATE) {10021F140B}> :OVERRIDE T :KEY NIL :OVERRIDE-CACHE T :OVERRIDE-FORCING NIL) 26: ((LAMBDA NIL :IN ASDF/OPERATE:OPERATE)) 27: (ASDF/SESSION:CALL-WITH-ASDF-SESSION #<CLOSURE (LAMBDA NIL :IN ASDF/OPERATE:OPERATE) {10021E896B}> :OVERRIDE NIL :KEY NIL :OVERRIDE-CACHE NIL :OVERRIDE-FORCING NIL) 28: ((:METHOD ASDF/OPERATE:OPERATE :AROUND (T T)) ASDF/LISP-ACTION:LOAD-OP "sqlite" :VERBOSE NIL) [fast-method] 29: (ASDF/OPERATE:LOAD-SYSTEM "sqlite" :VERBOSE NIL) 30: (QUICKLISP-CLIENT::CALL-WITH-MACROEXPAND-PROGRESS #<CLOSURE (LAMBDA NIL :IN QUICKLISP-CLIENT::APPLY-LOAD-STRATEGY) {10021E88CB}>) 31: (QUICKLISP-CLIENT::AUTOLOAD-SYSTEM-AND-DEPENDENCIES "sqlite" :PROMPT NIL) 32: ((:METHOD QL-IMPL-UTIL::%CALL-WITH-QUIET-COMPILATION (T T)) #<unused argument> #<CLOSURE (FLET QUICKLISP-CLIENT::QL :IN QUICKLISP-CLIENT:QUICKLOAD) {10021D574B}>) [fast-method] 33: ((:METHOD QL-IMPL-UTIL::%CALL-WITH-QUIET-COMPILATION :AROUND (QL-IMPL:SBCL T)) #<QL-IMPL:SBCL {10054D58E3}> #<CLOSURE (FLET QUICKLISP-CLIENT::QL :IN QUICKLISP-CLIENT:QUICKLOAD) {10021D574B}>) [fast-me.. 34: ((:METHOD QUICKLISP-CLIENT:QUICKLOAD (T)) :SQLITE :PROMPT NIL :SILENT NIL :VERBOSE NIL) [fast-method] 35: (QL-DIST::CALL-WITH-CONSISTENT-DISTS #<CLOSURE (LAMBDA NIL :IN QUICKLISP-CLIENT:QUICKLOAD) {10021CD67B}>) 36: (SB-INT:SIMPLE-EVAL-IN-LEXENV (QUICKLISP-CLIENT:QUICKLOAD :SQLITE) #<NULL-LEXENV>) 37: (EVAL (QUICKLISP-CLIENT:QUICKLOAD :SQLITE)) 38: (SB-EXT:INTERACTIVE-EVAL (QUICKLISP-CLIENT:QUICKLOAD :SQLITE) :EVAL NIL) 39: (SB-IMPL::REPL-FUN NIL) 40: ((LAMBDA NIL :IN SB-IMPL::TOPLEVEL-REPL)) 41: (SB-IMPL::%WITH-REBOUND-IO-SYNTAX #<CLOSURE (LAMBDA NIL :IN SB-IMPL::TOPLEVEL-REPL) {100335BB1B}>) 42: (SB-IMPL::TOPLEVEL-REPL NIL) 43: (SB-IMPL::TOPLEVEL-INIT) 44: ((FLET SB-UNIX::BODY :IN SB-EXT:SAVE-LISP-AND-DIE)) 45: ((FLET "WITHOUT-INTERRUPTS-BODY-27" :IN SB-EXT:SAVE-LISP-AND-DIE)) 46: ((LABELS SB-IMPL::RESTART-LISP :IN SB-EXT:SAVE-LISP-AND-DIE)) --8<---------------cut here---------------end--------------->8--- Any idea on how to fix this? -- Pierre Neidhardt

2 5

Memory fault error
by Elliott Johnson 01 May '18

01 May '18

Hello, If this is not the correct list to report a user error, I apologize and will happily redirect my question where ever suitable. I've been using cffi to make a trivial library to libsensors https://github.com/groeck/lm-sensors and am getting an odd memory fault error when referencing a string value from a groveled struct. After hitting my head against a wall for a day and a half, I thought I'd ask in case it's a simple mistake. Here's my information: Running a 64 bit linux install. My local version of the libsensors library is as follows: > elliott@desktop ~ $ file /usr/lib64/libsensors.so.4.4.0 > /usr/lib64/libsensors.so.4.4.0: ELF 64-bit LSB shared object, x86-64, > version 1 (SYSV), dynamically linked, stripped > elliott@desktop ~ $ sensors --version > sensors version 3.4.0+git_83cafd29f28d463573750d897014ec7143217ae5 > with libsensors version 3.4.0+git_83cafd29f28d463573750d897014ec7143217ae5 I'm using a fairly recent version of sbcl built from source that (apparently) passed all of the tests after the build: > CL-USER> (lisp-implementation-version) > "1.4.6.140-f8d5864d0" My version of cffi appears to be the latest: > CL-USER> (slot-value (asdf:find-system :cffi) 'asdf:version) > "0.19.0" My system uses cffi-grovel and defines the following structs: > (cstruct sensors-bus-id "sensors_bus_id" > (type "type" :type :short) > (nr "nr" :type :short)) > > (cstruct sensors-chip-name "sensors_chip_name" > (prefix "prefix" :type :string) > (bus "bus" :type (:struct sensors-bus-id)) > (address "addr" :type :int) > (path "path" :type :string)) These are based upon the definitions in sensors/sensors.h: https://github.com/groeck/lm-sensors/blob/master/lib/sensors.h After asdf loading the system, the following groveler definitions are created (had to dig these out of the cached build files): > (cffi:defcstruct (sensors-bus-id :size 4) > (type :short :offset 0) > (nr :short :offset 2)) > (cl:defconstant size-of-sensors-bus-id (cffi:foreign-type-size > '(:struct sensors-bus-id))) > (cffi:defcstruct (sensors-chip-name :size 24) > (prefix :string :offset 0) > (bus (:struct sensors-bus-id) :offset 8) > (address :int :offset 12) > (path :string :offset 16)) > (cl:defconstant size-of-sensors-chip-name (cffi:foreign-type-size > '(:struct sensors-chip-name))) All of the above appears to be correct, so I proceed to load the library: > (define-foreign-library libsensors > (:unix (:or "libsensors.so.4" "libsensors.so")) > (t (:default "libsensors.so"))) > (use-foreign-library libsensors) No issues, so I define a c function from the c header file that parses a sensor chip name-string into a struct: > (defcfun ("sensors_parse_chip_name" cffi-sensors-parse-chip-name) :int > "Parse a chip name to the internal representation. Return 0 on > success, <0 on error." > (orig-name :string) > (res (:pointer (:struct sensors-chip-name)))) Which is based upon the following header function declaration: > int sensors_parse_chip_name(const char *orig_name, sensors_chip_name > *res); Then I implement a simple call to print out the parsed values (not including the bus): > (defun test-sensors-parse-chip-name (string) > (with-foreign-object (name '(:struct sensors-chip-name)) > (unless (= 0 (cffi-sensors-parse-chip-name string name)) > (error "Failed to parse: ~A" string)) > (with-foreign-slots ((prefix address path) > name > (:struct sensors-chip-name)) > (format t "~%Prefix: '~A'" prefix) > (format t "~%Address: '~A'" address) > (format t "~%Path: '~A'" path)))) The above when executed gives the following output before the error: > CL-LMSENSORS> (test-sensors-parse-chip-name "atk0110-acpi-0") > > Prefix: 'atk0110' > Address: '0' And once it tries to access the path variable, it gives the following error (sorry a lot rolls off the screen): > Unhandled memory fault at #xE71B7. > [Condition of type SB-SYS:MEMORY-FAULT-ERROR] > > Restarts: > 0: [RETRY] Retry SLIME REPL evaluation request. > 1: [*ABORT] Return to SLIME's top level. > 2: [ABORT] abort thread (#<THREAD "repl-thread" RUNNING {1002207F93}>) > > Backtrace: > 0: (CFFI::FOREIGN-STRING-LENGTH #.(SB-SYS:INT-SAP #X000E71B7) > :ENCODING :UTF-8 :OFFSET 0) > Locals: > #:.DEFAULTING-TEMP. = :UTF-8 > #:.DEFAULTING-TEMP.#1 = 0 > #:N-SUPPLIED-0 = 1 > POINTER = #.(SB-SYS:INT-SAP #X000E71B7) > 1: (FOREIGN-STRING-TO-LISP #.(SB-SYS:INT-SAP #X000E71B7) :OFFSET 0 > :COUNT NIL :MAX-CHARS 4611686018427387900 :ENCODING :UTF-8$ > Locals: > #:.DEFAULTING-TEMP. = 0 > #:.DEFAULTING-TEMP.#1 = NIL > #:.DEFAULTING-TEMP.#2 = 4611686018427387900 > #:.DEFAULTING-TEMP.#3 = :UTF-8 > ENCODING = :UTF-8 > #:N-SUPPLIED-0 = 1 > POINTER = #.(SB-SYS:INT-SAP #X000E71B7) > 2: ((:METHOD TRANSLATE-FROM-FOREIGN (T CFFI::FOREIGN-STRING-TYPE)) > #.(SB-SYS:INT-SAP #X000E71B7) #<CFFI::FOREIGN-STRING-TYPE $ > 3: (TEST-SENSORS-PARSE-CHIP-NAME "atk0110-acpi-0") My guess is I'm not defining the (:struct sensors-chip-name) correctly, so that when sensors_parse_chip_name writes values into the struct, it somehow overlaps into the path string. When looking at the source for sensors_parse_chip_name I've noticed that it does not set or access the path value at all. So I decided to write a small c program to test the native behavior: > elliott@desktop ~ $ cat test-sensors.c > #include <stdio.h> > #include <stdlib.h> > #include "sensors/sensors.h" > > int main( ) { > > //sensors_init( NULL ); > > struct sensors_chip_name name; > > int return_value = sensors_parse_chip_name( "atk0110-acpi-0", &name); > if ( return_value != 0 ) { > printf( "Failed to get a good return value." ); > exit( return_value ); > } > > printf( "Printing the prefix: '%s'\n", name.prefix ); > printf( "Address: '%i'\n", name.addr ); > printf( "Printing path value: '%s'\n", name.path ); > printf ("\n exiting..." ); > > exit( 0 ); > } > elliott@desktop ~ $ gcc test-sensors.c -l sensors -o test-sensors > elliott@desktop ~ $ ./test-sensors > Printing the prefix: 'atk0110' > Address: '0' > Printing path value: '' > > exiting... No problems there, so I assume that the issue is all my lack of cffi-fu training. Any pointers (yes, pun intended) would be appreciated... sorry for such a long read, but I hope it helps to have the background. At the very least it helped me to frame the issue in my mind by writing this. Regards, Elliott

2 4