Hi Burton
no. I have not heard of anything similar, except maybe from Mark Watson (who should be on these lists - markwatson.com). I became interested in them as well.
In any case, the issue is whether you are interested in a CL implementation or a binding to this or that C/C++ library (yeah! I refrain from mentioning languages susceptible to the 'irsabol attack' 😑 ).
All the best
Marco
On Sat, Aug 12, 2023 at 2:38 AM Burton John Samograd (as burtonjohnsamograd at protonmail dot com) lisp-hug@lispworks.com wrote:
Hello,
I was wondering if anybody on this list (or anybody you might know) has heard or had experience with a Common Lisp "Transformer" library, as in Transformer from Generalized Pre-trained Transformer (GPT).
I'd like to do some experimentation and was wondering if there was any previous work that has been done that can be used.
-- Burton John Samograd burtonjohnsamograd@protonmail.com http://burton.samograd.ca/ 2023
Sent with Proton Mail https://proton.me/ secure email.
------- Forwarded Message ------- From: Burton John Samograd burtonjohnsamograd@protonmail.com Date: On Friday, August 11th, 2023 at 5:33 PM Subject: Common Lisp Transformer Libraries To: pro@common-lisp.net pro@common-lisp.net
Hello,
I was wondering if anybody on this list (or anybody you might know) has heard or had experience with a Common Lisp "Transformer" library, as in Transformer from Generalized Pre-trained Transformer (GPT).
I'd like to do some experimentation and was wondering if there was any previous work that has been done that can be used.
Thank you.
-- Burton John Samograd burtonjohnsamograd@protonmail.com 2023
Sent with Proton Mail https://proton.me/ secure email.
I don’t have experience with GPT myself, but I would guess there’s a Python interface, in which case you could drive it through py4cl (note: avoid py4cl2 for now, it is not yet ready for prime time).
There are one or two minor oddities to learn in py4cl, but by and large I have found it works quite well.
-- Robert P. Goldman
On August 12, 2023 at 00:06:29, Marco Antoniotti (marco.antoniotti@unimib.it(mailto:marco.antoniotti@unimib.it)) wrote:
Hi Burton
no. I have not heard of anything similar, except maybe from Mark Watson (who should be on these lists - markwatson.com(http://markwatson.com)). I became interested in them as well.
In any case, the issue is whether you are interested in a CL implementation or a binding to this or that C/C++ library (yeah! I refrain from mentioning languages susceptible to the 'irsabol attack' 😑 ).
All the best
Marco
On Sat, Aug 12, 2023 at 2:38 AM Burton John Samograd (as burtonjohnsamograd at protonmail dot com) <lisp-hug@lispworks.com(mailto:lisp-hug@lispworks.com)> wrote:
Hello,
I was wondering if anybody on this list (or anybody you might know) has heard or had experience with a Common Lisp "Transformer" library, as in Transformer from Generalized Pre-trained Transformer (GPT).
I'd like to do some experimentation and was wondering if there was any previous work that has been done that can be used.
-- Burton John Samograd burtonjohnsamograd@protonmail.com(mailto:burtonjohnsamograd@protonmail.com) http://burton.samograd.ca/ 2023
Sent with Proton Mail(https://proton.me/) secure email.
------- Forwarded Message ------- From: Burton John Samograd <burtonjohnsamograd@protonmail.com(mailto:burtonjohnsamograd@protonmail.com)> Date: On Friday, August 11th, 2023 at 5:33 PM Subject: Common Lisp Transformer Libraries To: pro@common-lisp.net(mailto:pro@common-lisp.net) <pro@common-lisp.net(mailto:pro@common-lisp.net)>
Hello,
I was wondering if anybody on this list (or anybody you might know) has heard or had experience with a Common Lisp "Transformer" library, as in Transformer from Generalized Pre-trained Transformer (GPT).
I'd like to do some experimentation and was wondering if there was any previous work that has been done that can be used.
Thank you.
-- Burton John Samograd burtonjohnsamograd@protonmail.com(mailto:burtonjohnsamograd@protonmail.com) 2023
Sent with Proton Mail(https://proton.me/) secure email.
I'd be interesting in working on such a library, whether it be native or CFFI. The basics shouldn't be that difficult if we can find a C library. @Burton (or others), contact me for a discussion; it would be good to exchange notes in any case.
On Saturday, August 12, 2023 at 10:13:41 PM GMT+8, Robert P. Goldman rpgoldman@sift.net wrote:
I don’t have experience with GPT myself, but I would guess there’s a Python interface, in which case you could drive it through py4cl (note: avoid py4cl2 for now, it is not yet ready for prime time). There are one or two minor oddities to learn in py4cl, but by and large I have found it works quite well.
--Â Robert P. Goldman On August 12, 2023 at 00:06:29, Marco Antoniotti (marco.antoniotti@unimib.it) wrote:
Hi Burton no. I have not heard of anything similar, except maybefrom Mark Watson (who should be on these lists - markwatson.com). I becameinterested in them as well. In any case, the issue is whether you are interested in a CLimplementation or a binding to this or that C/C++ library (yeah! Irefrain from mentioning languages susceptible to the 'irsabolattack'  😑 ). All the best Marco
On Sat, Aug 12, 2023 at 2:38 AMBurton John Samograd (as burtonjohnsamograd at protonmail dot com)lisp-hug@lispworks.comwrote:
Hello, I was wondering if anybody on this list (or anybody youmight know) has heard or had experience with a Common Lisp"Transformer" library, as in Transformer from GeneralizedPre-trained Transformer (GPT). I'd like to do some experimentation and was wondering if therewas any previous work that has been done that can be used. --BurtonJohn Samogradburtonjohnsamograd@protonmail.comhttp://burton.samograd.ca/ 2023
Sent with Proton Mail secureemail. ------- Forwarded Message ------- From: Burton John Samograd burtonjohnsamograd@protonmail.com Date: On Friday, August 11th, 2023 at 5:33 PM Subject: Common Lisp Transformer Libraries To: pro@common-lisp.net pro@common-lisp.net
Hello, I waswondering if anybody on this list (or anybody you might know)has heard or had experience with a Common Lisp "Transformer"library, as in Transformer from Generalized Pre-trained Transformer(GPT). I'd liketo do some experimentation and was wondering if there was anyprevious work that has been done that can be used. Thankyou. --BurtonJohn Samogradburtonjohnsamograd@protonmail.com2023
Sent with Proton Mail secureemail.
Something that would be hugely valuable to the CL community, IMO, would be a tool that at least partially automates translation of a Python API spec for an external library into something that CFFI could process.
I don't know how Python talks to C, C++, or Fortran, so I don't know how easy this would be, but if it was possible, it would be hugely valuable to (relatively) easily adapt arbitrary Python libraries.
Best, R
On 14 Aug 2023, at 5:15, Steven Nunez wrote:
I'd be interesting in working on such a library, whether it be native or CFFI. The basics shouldn't be that difficult if we can find a C library. @Burton (or others), contact me for a discussion; it would be good to exchange notes in any case.
On Saturday, August 12, 2023 at 10:13:41 PM GMT+8, Robert P.Goldman rpgoldman@sift.net wrote:
I don’t have experience with GPT myself, but I would guess there’s a Python interface, in which case you could drive it through py4cl (note: avoid py4cl2 for now, it is not yet ready for prime time). There are one or two minor oddities to learn in py4cl, but by and large I have found it works quite well.
--Â Robert P. Goldman On August 12, 2023 at 00:06:29, Marco Antoniotti (marco.antoniotti@unimib.it) wrote:
Hi Burton no. I have not heard of anything similar, except maybefrom Mark Watson (who should be on these lists - markwatson.com). I becameinterested in them as well. In any case, the issue is whether you are interested in a CLimplementation or a binding to this or that C/C++ library (yeah! Irefrain from mentioning languages susceptible to the 'irsabolattack'  😑 ). All the best Marco
On Sat, Aug 12, 2023 at 2:38 AMBurton John Samograd (as burtonjohnsamograd at protonmail dot com)lisp-hug@lispworks.comwrote:
Hello, I was wondering if anybody on this list (or anybody youmight know) has heard or had experience with a Common Lisp"Transformer" library, as in Transformer from GeneralizedPre-trained Transformer (GPT). I'd like to do some experimentation and was wondering if therewas any previous work that has been done that can be used. --BurtonJohn Samogradburtonjohnsamograd@protonmail.comhttp://burton.samograd.ca/ 2023
Sent with Proton Mail secureemail. ------- Forwarded Message ------- From: Burton John Samograd burtonjohnsamograd@protonmail.com Date: On Friday, August 11th, 2023 at 5:33 PM Subject: Common Lisp Transformer Libraries To: pro@common-lisp.net pro@common-lisp.net
Hello, I waswondering if anybody on this list (or anybody you might know)has heard or had experience with a Common Lisp "Transformer"library, as in Transformer from Generalized Pre-trained Transformer(GPT). I'd liketo do some experimentation and was wondering if there was anyprevious work that has been done that can be used. Thankyou. --BurtonJohn Samogradburtonjohnsamograd@protonmail.com2023
Sent with Proton Mail secureemail.
That's a fantastic idea; I wish I'd thought of it. With it, virtually any library used by the Python ecosystem (and most Python systems are driven by 3rd party libs) becomes available. I wonder what this would look like? Parsing the spec and interfacing to, say claw or cl-autowrap are the first things that jump out to me. It would have to gracefully deal with C++. These days nearly all libraries are written in C++ first and might have a C library as an afterthought.
On Tuesday, August 15, 2023 at 12:40:57 AM GMT+8, Robert Goldman rpgoldman@sift.net wrote:
Something that would be hugely valuable to the CL community, IMO, would be a tool that at least partially automates translation of a Python API spec for an external library into something that CFFI could process.
I don't know how Python talks to C, C++, or Fortran, so I don't know how easy this would be, but if it was possible, it would be hugely valuable to (relatively) easily adapt arbitrary Python libraries.
Best, R
On 14 Aug 2023, at 5:15, Steven Nunez wrote:
I'd be interesting in working on such a library, whether it be native or CFFI. The basics shouldn't be that difficult if we can find a C library. @Burton (or others), contact me for a discussion; it would be good to exchange notes in any case.
On Saturday, August 12, 2023 at 10:13:41 PM GMT+8, Robert P. Goldman rpgoldman@sift.net wrote:
I don’t have experience with GPT myself, but I would guess there’s a Python interface, in which case you could drive it through py4cl (note: avoid py4cl2 for now, it is not yet ready for prime time). There are one or two minor oddities to learn in py4cl, but by and large I have found it works quite well.
--Â Robert P. Goldman On August 12, 2023 at 00:06:29, Marco Antoniotti (marco.antoniotti@unimib.it) wrote:
Hi Burton no. I have not heard of anything similar, except maybe from Mark Watson (who should be on these lists - markwatson.com). I became interested in them as well. In any case, the issue is whether you are interested in a CL implementation or a binding to this or that C/C++ library (yeah! I refrain from mentioning languages susceptible to the 'irsabol attack'  😑 ). All the best Marco
On Sat, Aug 12, 2023 at 2:38 AM Burton John Samograd (as burtonjohnsamograd at protonmail dot com) lisp-hug@lispworks.com wrote:
Hello, I was wondering if anybody on this list (or anybody you might know) has heard or had experience with a Common Lisp "Transformer" library, as in Transformer from Generalized Pre-trained Transformer (GPT). I'd like to do some experimentation and was wondering if there was any previous work that has been done that can be used. --Burton John Samogradburtonjohnsamograd@protonmail.comhttp://burton.samograd.ca/ 2023
Sent with Proton Mail secure email. ------- Forwarded Message ------- From: Burton John Samograd burtonjohnsamograd@protonmail.com Date: On Friday, August 11th, 2023 at 5:33 PM Subject: Common Lisp Transformer Libraries To: pro@common-lisp.net pro@common-lisp.net
Hello, I was wondering if anybody on this list (or anybody you might know) has heard or had experience with a Common Lisp "Transformer" library, as in Transformer from Generalized Pre-trained Transformer (GPT). I'd like to do some experimentation and was wondering if there was any previous work that has been done that can be used. Thank you. --Burton John Samogradburtonjohnsamograd@protonmail.com2023
Sent with Proton Mail secure email.
-
Marco Antoniotti -
Robert Goldman -
Robert P. Goldman
-
Steven Nunez