* Luís Oliveira [2010-05-31 20:57+0200] writes:

On Mon, May 31, 2010 at 1:32 PM, Helmut Eller heller@common-lisp.net wrote:

...

Is this assertion

(assert  (equal  (cffi:with-foreign-string (data "foobar" :encoding :utf-16)    (cffi:foreign-string-to-lisp data :count 6 :encoding :utf-16))  "foobar"))

expected to fail?

FOREIGN-STRING-ALLOC currently doesn't insert BOM markers and the :UTF-16 encoder uses native endianness. The :UTF-16 decoder defaults to big endian when a BOM marker is not present, as recommended by the Unicode specification. That's why the assertion fails.

One solution is to use :UTF-16BE or :UTF-16LE explicitly, which unfortunately aren't implemented in Babel yet.

Thanks. I will write my on decoder then.

Helmut

* Luís Oliveira [2010-06-01 10:43+0200] writes:

On Tue, Jun 1, 2010 at 7:51 AM, Helmut Eller heller@common-lisp.net wrote:

...

Thanks. I will write my on decoder then.

But please do contribute it to Babel. :-)

Well, it's trivial for my case:

(defun domstring-to-lisp (data length) (declare (type fixnum length)) (let ((string (make-string length))) (dotimes (i length) (setf (aref string i) (code-char (cffi:mem-aref data :uint16 i)))) string))

Helmut