closure-devel

closure-devel@common-lisp.net

57 discussions

Unexplained (by me) illegal sharp macro character #\)
by William Lederer 26 Apr '23

26 Apr '23

Using sblc-2.2.3 and 2.3.3 under Ubuntu 24. Updated quicklisp to latest version and compile resulted in following. Version of closure is (from quicklisp) closure-html-20180711-git/ Stack trace from slime compile follows. --------------------------------------------------------------------------------------- illegal sharp macro character: #\) Stream: #<dynamic-extent STRING-INPUT-STREAM (unavailab[le) from ";;; -*- ..."> [Condition of type SB-INT:SIMPLE-READER-ERROR] Restarts: 0: [MUFFLE-WARNING] Skip warning. 1: [RETRY] Retry compiling #<CLOSURE-SOURCE-FILE "closure-html" "src" "parse" "sgml-parse">. 2: [ACCEPT] Continue, treating compiling #<CLOSURE-SOURCE-FILE "closure-html" "src" "parse" "sgml-parse"> as having been successful. 3: [RETRY] Retry ASDF operation. 4: [CLEAR-CONFIGURATION-AND-RETRY] Retry ASDF operation after resetting the configuration. 5: [RETRY] Retry ASDF operation. --more-- Backtrace: 0: (SB-C::COMPILER-STYLE-WARNING-HANDLER #<SB-INT:SIMPLE-STYLE-WARNING "using deprecated EVAL-WHEN situation names~{ ~S~}" {101615BD83}>) 1: (SB-KERNEL::%SIGNAL #<SB-INT:SIMPLE-STYLE-WARNING "using deprecated EVAL-WHEN situation names~{ ~S~}" {101615BD83}>) 2: ((FLET SB-KERNEL::%WARN :IN "SYS:SRC;CODE;WARM-ERROR.LISP") "using deprecated EVAL-WHEN situation names~{ ~S~}" #<SB-KERNEL::CONDITION-CLASSOID STYLE-WARNING> SB-INT:SIMPLE-STYLE-WARNING (EVAL LOAD CO.. 3: (SB-C:PARSE-EVAL-WHEN-SITUATIONS (COMPILE LOAD EVAL)) 4: (SB-C::PROCESS-TOPLEVEL-FORM (EVAL-WHEN (COMPILE LOAD EVAL) (DEFPARAMETER SGML::*BUF-SIZE* 4096)) (SB-C::ORIGINAL-SOURCE-START 0 18) NIL) 5: ((LAMBDA (SB-KERNEL:FORM &KEY :CURRENT-INDEX &ALLOW-OTHER-KEYS) :IN SB-C::SUB-COMPILE-FILE) (EVAL-WHEN (COMPILE LOAD EVAL) (DEFPARAMETER SGML::*BUF-SIZE* 4096)) :CURRENT-INDEX 18) 6: (SB-C::%DO-FORMS-FROM-INFO #<FUNCTION (LAMBDA (SB-KERNEL:FORM &KEY :CURRENT-INDEX &ALLOW-OTHER-KEYS) :IN SB-C::SUB-COMPILE-FILE) {52C1F34B}> #<SB-C::SOURCE-INFO {10153E7333}> SB-C::INPUT-ERROR-IN-COMP.. 7: ((FLET "LAMBDA0" :IN "SYS:SRC;COMPILER;MAIN.LISP")) 8: ((FLET SB-C::WITH-IT :IN SB-C::%WITH-COMPILATION-UNIT)) 9: (SB-C::SUB-COMPILE-FILE #<SB-C::SOURCE-INFO {10153E7333}> NIL) 10: (SB-C::%COMPILE-FILES (#P"/home/wgl/quicklisp/dists/quicklisp/software/closure-html-20180711-git/src/parse/sgml-parse.lisp") :UTF-8 T #P"/home/wgl/.cache/common-lisp/sbcl-2.2.3-linux-x64/home/wgl/quic.. 11: (COMPILE-FILE #P"/home/wgl/quicklisp/dists/quicklisp/software/closure-html-20180711-git/src/parse/sgml-parse.lisp" :OUTPUT-FILE #P"/home/wgl/.cache/common-lisp/sbcl-2.2.3-linux-x64/home/wgl/quicklisp/.. 12: (UIOP/UTILITY:CALL-WITH-MUFFLED-CONDITIONS #<FUNCTION (LAMBDA NIL :IN UIOP/LISP-BUILD:COMPILE-FILE*) {10153E5E3B}> NIL) 13: (UIOP/PATHNAME:CALL-WITH-ENOUGH-PATHNAME #P"/home/wgl/quicklisp/dists/quicklisp/software/closure-html-20180711-git/src/parse/sgml-parse.lisp" NIL #<FUNCTION (LAMBDA (UIOP/LISP-BUILD::INPUT-FILE) :IN U.. 14: (UIOP/LISP-BUILD:COMPILE-FILE* #P"/home/wgl/quicklisp/dists/quicklisp/software/closure-html-20180711-git/src/parse/sgml-parse.lisp" :OUTPUT-FILE #P"/home/wgl/.cache/common-lisp/sbcl-2.2.3-linux-x64/ho.. 15: (ASDF/LISP-ACTION:PERFORM-LISP-COMPILATION #<ASDF/LISP-ACTION:COMPILE-OP > #<CLOSURE-SYSTEM::CLOSURE-SOURCE-FILE "closure-html" "src" "parse" "sgml-parse">) 16: ((SB-PCL::EMF ASDF/ACTION:PERFORM) #<unused argument> #<unused argument> #<ASDF/LISP-ACTION:COMPILE-OP > #<CLOSURE-SYSTEM::CLOSURE-SOURCE-FILE "closure-html" "src" "parse" "sgml-parse">) 17: ((LAMBDA NIL :IN ASDF/ACTION:CALL-WHILE-VISITING-ACTION)) 18: ((:METHOD ASDF/ACTION:PERFORM :AROUND (ASDF/LISP-ACTION:COMPILE-OP T)) #<ASDF/LISP-ACTION:COMPILE-OP > #<CLOSURE-SYSTEM::CLOSURE-SOURCE-FILE "closure-html" "src" "parse" "sgml-parse">) [fast-method] 19: ((:METHOD ASDF/ACTION:PERFORM :AROUND (ASDF/LISP-ACTION:COMPILE-OP CLOSURE-SYSTEM::CLOSURE-SOURCE-FILE)) #<ASDF/LISP-ACTION:COMPILE-OP > #<CLOSURE-SYSTEM::CLOSURE-SOURCE-FILE "closure-html" "src" "par.. --more--

1 0

Proposed improvement to the HTML parser
by Elias Mårtenson 05 Sep '16

05 Sep '16

A few years back, I posted this request, but at the time I got no reply. Since there has recently been some activity here, I'm asking this again. Currently, closure-html throws an error when trying to parse HTML generated by Microsoft Outlook. The reason for this is that Outlook generates a lot of tags with a colon (:) in them, which closure-html considers a syntax error. I don't know if it actually is a syntax error, but closure-html should be lenient here and simply ignore these tags. That's what my fix does. Currently, I had to advice my users to manually patch closure-html. It would be very nice if this was integrated in the official version. Here is the patch: diff --git a/src/parse/html-parser.lisp b/src/parse/html-parser.lisp index 1fdd457..4e45b81 100644 --- a/src/parse/html-parser.lisp +++ b/src/parse/html-parser.lisp @@ -106,7 +106,10 @@ for (name value) on plist by #'cddr unless ;; better don't emit as HAX what would be bogus as SAX anyway - (string-equal name "xmlns") + (let ((s (string name)) + (prefix "xmlns:")) + (or (string-equal s "xmlns") + (string-equal s prefix :end1 (min (length s) (length prefix))))) collect (let* ((n #+rune-is-character (coerce (symbol-name name) 'rod) #-rune-is-character (symbol-name name)) diff --git a/src/parse/sgml-parse.lisp b/src/parse/sgml-parse.lisp index faa9029..a277ece 100644 --- a/src/parse/sgml-parse.lisp +++ b/src/parse/sgml-parse.lisp @@ -182,7 +182,8 @@ (or (name-start-rune-p char) (digit-rune-p char) (rune= char #/.) - (rune= char #/-))) + (rune= char #/-) + (rune= char #/:))) (definline sloopy-name-rune-p (char) (or (name-rune-p char)

1 0

Re: Does closure have a maintainer?
by Stas Boukarev 04 Sep '16

04 Sep '16

On Sun, Sep 4, 2016 at 5:23 PM, Victory Omole <vtomole(a)iastate.edu> wrote: > The browser only renders html4. I want to make it render html5. You don't have to be a maintainer to do that. It'd be a good idea to have something to contribute before becoming a maintainer. -- With best regards, Stas.

1 0

Does closure have a maintainer?
by Victory Omole 04 Sep '16

04 Sep '16

If closure doesn't have a maintainer, I was wondering if I could maintain it.

3 2

[Closure-devel] a bug in read-pcdata (source file: sgml-parse.lisp)
by lookwong 30 Jun '14

30 Jun '14

In function read-pcdata: *(t * * (setf (aref scratch sp) ch) ;recode character read* * (setf sp (the fixnum (+ sp 1)))* * <http://repo.or.cz/w/closure-html.git/blob/HEAD:/src/parse/sgml-parse.lisp#l…> (cond ((= sp se) ;end of scratch pad reached?* * (enlarge-scratch-pad input)* * (setf scratch (a-stream-scratch input)* * se (length scratch))))))))* Should first enlarge the input buffer, or will cause out of index error. *(t** (cond ((= sp se) ;end of scratch pad reached?* * (enlarge-scratch-pad input)* * (setf scratch (a-stream-scratch input)* * se (length scratch))))* * (setf (aref scratch sp) ch) ;recode character read* * (setf sp (the fixnum (+ sp 1)))**))))*

1 0

[Closure-devel] Bug in html parsing
by Christopher Laux 08 Jun '14

08 Jun '14

Hi, I think I've found a bug in closure. If I execute (chtml:parse "<small><p>test1</p><p>test2</p></small>" (chtml:make-lhtml-builder)) > (:HTML NIL (:HEAD NIL) (:BODY NIL (:SMALL NIL) (:P NIL (:SMALL NIL "test1")) (:P NIL "test2"))) I get that incorrect parse tree. The example is taken from a real website and the same happens inside the entire page. That happens both with the current git version and the quicklisp version (which might just be the same one). Any help? Chris

2 2

[Closure-devel] Bug in closure-html, when use with *print-case* set to :downcase
by Michał Psota 04 Jun '14

04 Jun '14

Hello, I've noticed that in 2 places strings are not correctly interned when you load closure-html with *print-case* set to :downcase. To make it work, I've changed (intern …) to (intern (string-upcase …)). Please find patch attached. Best regards, Michał Psota

1 0

[closure-devel] Corrupted UTF-8 input
by Patrick May 15 Oct '13

15 Oct '13

Hi, I'm using chtml for a simple experimental web crawler. I'm occasionally getting this error (Slime output): 0: (RUNES-ENCODING::XERROR "Corrupted UTF-8 input (initial byte was #b~8,'0B)" 255) 1: (#<STANDARD-METHOD RUNES-ENCODING:DECODE-SEQUENCE ((EQL :UTF-8) T T T T T ...)> :UTF-8 #(255 216 255 0 0 0 ...) 0 3 #(65535 0 0 0 0 0 ...) 0 8191 NIL) 2: (NIL #<Unknown Arguments>) 3: (#<STANDARD-METHOD RUNES::XSTREAM-UNDERFLOW (RUNES:XSTREAM)> #<RUNES:XSTREAM NIL>) 4: (SGML::READ-TOKEN #<RUNES:XSTREAM NIL> #<SGML::DTD (:PUBLIC "-//W3C//DTD HTML 4.0 Frameset//EN")>) 5: (SGML::READ-TOKEN* #<RUNES:XSTREAM NIL> #<SGML::DTD (:PUBLIC "-//W3C//DTD HTML 4.0 Frameset//EN")>) 6: (SGML:SGML-PARSE #<SGML::DTD (:PUBLIC "-//W3C//DTD HTML 4.0 Frameset//EN")> #<RUNES:XSTREAM NIL>) 7: (CLOSURE-HTML::PARSE-XSTREAM #<RUNES:XSTREAM NIL> #<CLOSURE-HTML:LHTML-BUILDER #x3020032CBF3D>) Choosing the restart continuation seems to get past it, but I'd like to understand what's going on and how to automatically detect and work around it. Any input appreciated. Thanks, Patrick

1 0

[closure-devel] forever stirring the tag soup
by Ben Hyde 15 Jul '13

15 Jul '13

Parsing a github project page takes forever. > (setf sgml::*parse-warn-level* 5) > (let ((page (drakma:http-request "https://github.com/rss-sync/corpus"))) (handler-case (bt:with-timeout (10) (chtml:parse page (make-instance 'hax:default-handler))) (condition (c) c))) #<bordeaux-threads:timeout #x302009C80C6D> Multiple div's appearing in a THead element are the root cause. > (setf sgml::*parse-warn-level* 0) 0 > (chtml:parse "<table><thead><div>a</div><div>b</div></thead></table>" (make-instance 'hax:default-handler)) ;; Parser warning: Line 1, column 26 : **** [-] Saw <div> in thead -- nuked <div>. ;; Parser warning: Line 1, column 31 : **** [H] Saw </div> in thead -- ??? patched (</div> <div>) -> (<div> </div>) ;; Parser warning: Line 1, column 31 : **** [-] Saw <div> in thead -- nuked <div>. ;; Parser warning: Line 1, column 32 : **** [H] Saw </div> in thead -- ??? patched (</div> <pcdata>) -> (<pcdata> </div>) ;; Parser warning: Line 1, column 32 : **** [-] Saw <pcdata> in thead -- nuked <pcdata>. ;; Parser warning: Line 1, column 38 : **** [H] Saw </div> in thead -- ??? patched (</div> </div>) -> (</div> </div>) ;; Parser warning: Line 1, column 38 : **** [H] Saw </div> in thead -- ??? patched (</div> </div>) -> (</div> </div>) ;; Parser warning: Line 1, column 38 : **** [H] Saw </div> in thead -- ??? patched (</div> </div>) -> (</div> </div>) … So far, I'm not clever enough to fix this. - ben ps. Thanks for the awesome library.

1 0

[closure-devel] Problem parsing HTML from BBC
by Victor 13 Mar '13

13 Mar '13

Hello! When trying to parse HTML from articles on BBC, like: http://www.bbc.co.uk/news/world-africa-21734036 I get the following error: prefix/URI mismatch for `xml' namespace Backtrace is: (6FA0924) : 0 (PRINT-CALL-HISTORY :CONTEXT NIL :PROCESS NIL :ORIGIN NIL :DETAILED-P NIL :COUNT 536870911 :START-FRAME-NUMBER 0 :STREAM #<STRING-OUTPUT-STREAM #x1A11E036> :PRINT-LEVEL 2 :PRINT-LENGTH 5 :SHOW-INTERNAL-FRAMES NIL :FORMAT :TRADITIONAL) 727 (6FA09D8) : 1 (PRINT-BACKTRACE-TO-STREAM #<STRING-OUTPUT-STREAM #x1A11E036>) 71 (6FA09F0) : 2 (GET-BACKTRACE) 311 (6FA0A24) : 3 (FUNCALL #'#<(:INTERNAL (HUNCHENTOOT:HANDLE-REQUEST (HUNCHENTOOT:ACCEPTOR HUNCHENTOOT:REQUEST)))> #<CXML-STP:STP-ERROR #x1A11E04E>) 95 (6FA0A3C) : 4 (SIGNAL #<CXML-STP:STP-ERROR #x1A11E04E>) 871 (6FA0A64) : 5 (%ERROR #<CXML-STP:STP-ERROR #x1A11E04E> (:FORMAT-CONTROL "prefix/URI mismatch for `xml' namespace" :FORMAT-ARGUMENTS NIL) 29262494) 111 (6FA0A78) : 6 (STP-ERROR "prefix/URI mismatch for `xml' namespace") 103 (6FA0A88) : 7 (RENAME-ATTRIBUTE #<error printing object> "xml" "") 287 (6FA0A9C) : 8 (MAKE-ATTRIBUTE "en-GB" "xml:lang" "") 303 (6FA0AC0) : 9 (FUNCALL #'#<#<STANDARD-METHOD SAX:START-ELEMENT (CXML-STP-IMPL::BUILDER T T T T)>> #<CXML-STP-IMPL::BUILDER #x1A00D50E> "http://www.w3.org/1999/xhtml" "div" "div" (#<HAX:STANDARD-ATTRIBUTE #x1A11E206> #<HAX:STANDARD-ATTRIBUTE #x1A11E1D6>)) 279 (6FA0AEC) : 10 (FUNCALL #'#<(:INTERNAL CLOSURE-HTML::RECURSE CLOSURE-HTML:SERIALIZE-PT)> #<SGML:PT DIV ..>) 455 (6FA0B10) : 11 (FUNCALL #'#<(:INTERNAL CLOSURE-HTML::RECURSE CLOSURE-HTML:SERIALIZE-PT)> #<SGML:PT DIV ..>) 559 (6FA0B40) : 12 (FUNCALL #'#<(:INTERNAL CLOSURE-HTML::RECURSE CLOSURE-HTML:SERIALIZE-PT)> #<SGML:PT BODY ..>) 559 (6FA0B70) : 13 (FUNCALL #'#<(:INTERNAL CLOSURE-HTML::RECURSE CLOSURE-HTML:SERIALIZE-PT)> #<SGML:PT HTML ..>) 559 (6FA0BA0) : 14 (SERIALIZE-PT #<SGML:PT HTML ..> #<CXML-STP-IMPL::BUILDER #x1A00D50E> :NAME "HTML" :PUBLIC-ID NIL :SYSTEM-ID NIL :DOCUMENTP T) 343 (6FA0BD8) : 15 (PARSE-XSTREAM #<RUNES:XSTREAM NIL> #<CXML-STP-IMPL::BUILDER #x1A00D50E>) 263 The parse call in my program is: (closure-html:parse article-page (stp:make-builder)) As far as I understand the problem has something to do with the xml prefix in attributes (for language, xml:lang) but I can not understand how to fix it or to work around. Could please anybody give a hint where to look for the problem and its solution. Thanks, Victor -- реклама ----------------------------------------------------------- Модная одежда и обувь! Цены ниже, чем в магазине! http://moda.aukro.ua/?utm_source=i.ua&utm_medium=advert&utm_campaign=m

1 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

closure-devel