elephant-cvs

elephant-cvs@common-lisp.net

858 discussions

[elephant-cvs] CVS elephant
by ieslick 31 Mar '07

31 Mar '07

Update of /project/elephant/cvsroot/elephant In directory clnet:/tmp/cvs-serv15195 Modified Files: elephant.asd Log Message: Sanitize class indexing option; more documentation stuff --- /project/elephant/cvsroot/elephant/elephant.asd 2007/03/30 14:34:34 1.39 +++ /project/elephant/cvsroot/elephant/elephant.asd 2007/03/30 23:36:52 1.40 @@ -296,13 +296,13 @@ (:file "classes") (:file "cache") (:file "serializer") - (:file "serializer1") ;; 0.6.0 db's - (:file "serializer2") ;; 0.6.1 db's - (:file "unicode2") (:file "controller") (:file "collections") (:file "classindex-utils") (:file "classindex") + (:file "serializer1") ;; 0.6.0 db's + (:file "serializer2") ;; 0.6.1 db's + (:file "unicode2") (:file "migrate") (:file "backend")) :serial t

1 0

[elephant-cvs] CVS elephant/src/elephant
by ieslick 30 Mar '07

30 Mar '07

Update of /project/elephant/cvsroot/elephant/src/elephant In directory clnet:/tmp/cvs-serv16927/src/elephant Modified Files: backend.lisp Log Message: Move utility to utilities, fix warning --- /project/elephant/cvsroot/elephant/src/elephant/backend.lisp 2007/03/30 14:55:54 1.13 +++ /project/elephant/cvsroot/elephant/src/elephant/backend.lisp 2007/03/30 17:46:14 1.14 @@ -86,6 +86,5 @@ #:slot-definition-name #:slots-and-values #:struct-slots-and-values - #:remove-indexed-element-and-adjust ))

1 0

[elephant-cvs] CVS elephant/src/utils
by ieslick 30 Mar '07

30 Mar '07

Update of /project/elephant/cvsroot/elephant/src/utils In directory clnet:/tmp/cvs-serv16747/src/utils Modified Files: convenience.lisp package.lisp Log Message: Move utility to utilities, fix warning --- /project/elephant/cvsroot/elephant/src/utils/convenience.lisp 2007/03/06 04:15:27 1.5 +++ /project/elephant/cvsroot/elephant/src/utils/convenience.lisp 2007/03/30 17:45:42 1.6 @@ -69,3 +69,12 @@ make it a list if it's an atom" (if (listp elts) elts (list elts))) +(defun remove-indexed-element-and-adjust (idx array) + "Remove element at idx and adjust the array to + reduce array length by one" + (let ((last (- (length array) 1))) + (do ((i idx (1+ i))) + ((= i last) nil) + (progn + (setf (aref array i) (aref array (+ 1 i))))) + (adjust-array array last))) --- /project/elephant/cvsroot/elephant/src/utils/package.lisp 2007/03/06 04:15:27 1.5 +++ /project/elephant/cvsroot/elephant/src/utils/package.lisp 2007/03/30 17:45:42 1.6 @@ -37,4 +37,5 @@ #:aif #:awhen #:mklist - #:it)) + #:it + #:remove-indexed-element-and-adjust))

1 0

[elephant-cvs] CVS elephant/src/elephant
by ieslick 30 Mar '07

30 Mar '07

Update of /project/elephant/cvsroot/elephant/src/elephant In directory clnet:/tmp/cvs-serv16747/src/elephant Modified Files: classindex.lisp variables.lisp Log Message: Move utility to utilities, fix warning --- /project/elephant/cvsroot/elephant/src/elephant/classindex.lisp 2007/03/30 14:34:35 1.34 +++ /project/elephant/cvsroot/elephant/src/elephant/classindex.lisp 2007/03/30 17:45:41 1.35 @@ -71,6 +71,7 @@ (find-class-index (find-class class-name) :sc sc :errorp errorp)) (defmethod class-indexedp-by-name ((class-name symbol) &key (sc *store-controller*)) + (declare (ignore sc)) (let ((class (find-class class-name nil))) (when class (indexed class)))) --- /project/elephant/cvsroot/elephant/src/elephant/variables.lisp 2007/03/30 17:28:50 1.12 +++ /project/elephant/cvsroot/elephant/src/elephant/variables.lisp 2007/03/30 17:45:41 1.13 @@ -69,17 +69,6 @@ (intern symbol :elephant)) '(get-cached-instance))) -;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;; -;;; Utilities - -;; get rid of spot idx and adjust the arrray -(defun remove-indexed-element-and-adjust (idx array) - (let ((last (- (length array) 1))) - (do ((i idx (1+ i))) - ((= i last) nil) - (progn - (setf (aref array i) (aref array (+ 1 i))))) - (adjust-array array last)))

1 0

[elephant-cvs] CVS elephant/doc
by ieslick 30 Mar '07

30 Mar '07

Update of /project/elephant/cvsroot/elephant/doc In directory clnet:/tmp/cvs-serv13013/doc Modified Files: data-store-reference.texinfo Log Message: Fixed circular name dependency due to new asdf load order --- /project/elephant/cvsroot/elephant/doc/data-store-reference.texinfo 2007/03/30 14:34:34 1.2 +++ /project/elephant/cvsroot/elephant/doc/data-store-reference.texinfo 2007/03/30 17:28:50 1.3 @@ -67,11 +67,21 @@ @include includes/fun-elephant-backend-open-controller.texinfo @include includes/fun-elephant-backend-close-controller.texinfo - +For upgrading and opening legacy databases it is important that a +store be able to indicate which version of elephant was used to create +it. This governs the chosen serializer, mappings between elephant +symbols used in an old vs. new version, etc. Because this is called +to initialize the serializer, it must directly implemented by the +backend without using the serializer. @include includes/fun-elephant-backend-database-version.texinfo -These functions are important utilities for implementing +There are some utilities for serializing simple data without a +serializer using the memutil package. + +@include + +These functions are useful utilities for implementing store-controllers. @include includes/fun-elephant-backend-get-con.texinfo

1 0

[elephant-cvs] CVS elephant/src/elephant
by ieslick 30 Mar '07

30 Mar '07

Update of /project/elephant/cvsroot/elephant/src/elephant In directory clnet:/tmp/cvs-serv13013/src/elephant Modified Files: variables.lisp Log Message: Fixed circular name dependency due to new asdf load order --- /project/elephant/cvsroot/elephant/src/elephant/variables.lisp 2007/03/30 14:34:35 1.11 +++ /project/elephant/cvsroot/elephant/src/elephant/variables.lisp 2007/03/30 17:28:50 1.12 @@ -58,6 +58,18 @@ "The transaction which is currently in effect.") ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;; +;; Forward references +;; +;; Elephant needs to export these symbols in order to +;; properly load in asdf due to some circular dependencies +;; between lisp files + +(eval-when (load-toplevel compile-toplevel) + (mapcar (lambda (symbol) + (intern symbol :elephant)) + '(get-cached-instance))) + +;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;; ;;; Utilities ;; get rid of spot idx and adjust the arrray

1 0

[elephant-cvs] CVS elephant/src/contrib/eslick/db-lisp
by ieslick 30 Mar '07

30 Mar '07

Update of /project/elephant/cvsroot/elephant/src/contrib/eslick/db-lisp In directory clnet:/tmp/cvs-serv7809/src/contrib/eslick/db-lisp Added Files: transactions.lisp Log Message: Some working files that were missing --- /project/elephant/cvsroot/elephant/src/contrib/eslick/db-lisp/transactions.lisp 2007/03/30 15:03:46 NONE +++ /project/elephant/cvsroot/elephant/src/contrib/eslick/db-lisp/transactions.lisp 2007/03/30 15:03:46 1.1 (in-package :db-lisp) ;; ;; Btree Locks and transaction log ;; (defclass mt-btree (btree) ((log :accessor btree-log :initarg :log :documentation "The transaction log")))

1 0

[elephant-cvs] CVS elephant/tests
by ieslick 30 Mar '07

30 Mar '07

Update of /project/elephant/cvsroot/elephant/tests In directory clnet:/tmp/cvs-serv7809/tests Added Files: stress-test.lisp Log Message: Some working files that were missing --- /project/elephant/cvsroot/elephant/tests/stress-test.lisp 2007/03/30 15:03:46 NONE +++ /project/elephant/cvsroot/elephant/tests/stress-test.lisp 2007/03/30 15:03:46 1.1 (in-package :elephant-tests) (defparameter *spec* '(:bdb "/Users/eslick/Work/db/test")) (defparameter *names* '("David" "Jim" "Peter" "Thomas" "Arthur" "Jans" "Klaus" "James" "Martin")) (defclass person () ((name :initform (elt *names* (random (length *names*))) :accessor name :index t) ;; Actually the index t shouldn't be needed, but since elephant ;; sometimes complained that "person is not an index class", I try if this fixes it. (age :initform (random 100) :accessor age :index t) ;; (made-by :initform (elephant-utils::ele-thread-hash-key)) (updated-by :initform nil :accessor updated-by)) (:metaclass elephant:persistent-metaclass)) (defparameter *nr-persons* 10000) ;; Should be 10000, but for me elephant can't allocate memory after 3000. ;; I think the problem it is becuase the number of locks (999) is = max 1000. see db_stat -e (defparameter +age+ 50) ;; I have tried different places for with-transaction below (defun make-persons (nr-objects &optional (batch-size 500)) (loop for i from 1 to (/ nr-objects batch-size) do (elephant:with-transaction () (loop for j from 1 to batch-size do (let ((person (make-instance 'person))) (when (zerop (mod (+ (* i batch-size) j) 1000)) (format t "~D ~a " (+ (* i batch-size) j) (name person)))))))) (defun ensure-clean-store () t) ;; (let ((dir (cl-fad:pathname-as-directory (second *spec*)))) ;; (when (cl-fad:directory-exists-p dir) ;; (cl-fad:delete-directory-and-files dir)) ;; (ensure-directories-exist dir))) (defun my-test-create () (ensure-clean-store) (elephant:with-open-store (*spec*) (make-persons *nr-persons*))) (defun subsets (size list) (let ((subsets nil)) (loop for elt in list for i from 0 do (when (= 0 (mod i size)) (setf (car subsets) (nreverse (car subsets))) (push nil subsets)) (push elt (car subsets))) (setf (car subsets) (nreverse (car subsets))) (nreverse subsets))) (defmacro do-subsets ((subset subset-size list) &body body) `(loop for ,subset in (subsets ,subset-size ,list) do ,@body)) (defun my-test-update (&key (new-age 27)) "Test updating all persons by changing their age." (elephant:with-open-store (*spec*) (do-subsets (subset 500 (elephant:get-instances-by-class 'person)) (format t "Doing subset~%") (elephant:with-transaction () (mapcar #'(lambda (person) (setf (age person) new-age)) subset))))) (defun my-test-load () "Test loading all persons by computing their average age." (let ((nr-persons 0) (total-age 0) (show-first nil)) (elephant:with-open-store (*spec*) (elephant:with-transaction () (mapcar #'(lambda (person) (incf nr-persons) (print nr-persons) (when (and show-first (> show-first)) (format t "Sample person ~a~%F" show-first) (describe person) (decf show-first)) (incf total-age (age person))) (elephant:get-instances-by-class 'person)))) (values (coerce (/ total-age nr-persons) 'float) nr-persons total-age))) (defun check-basic-setup () (my-test-update :new-age +age+) (multiple-value-bind (average nr-persons) (my-test-load) (assert (= +age+ average)) (assert (= nr-persons *nr-persons*))))

1 0

[elephant-cvs] CVS elephant/src/elephant
by ieslick 30 Mar '07

30 Mar '07

Update of /project/elephant/cvsroot/elephant/src/elephant In directory clnet:/tmp/cvs-serv4653/src/elephant Modified Files: backend.lisp package.lisp Log Message: Add exported symbols that were missing from backend.lisp --- /project/elephant/cvsroot/elephant/src/elephant/backend.lisp 2007/03/30 14:34:35 1.12 +++ /project/elephant/cvsroot/elephant/src/elephant/backend.lisp 2007/03/30 14:55:54 1.13 @@ -19,57 +19,21 @@ (in-package :cl-user) -(defpackage :elephant-backend +(defmacro defpackage-import-exported (name source-package &rest args) + "Define an export list, a source package and this macro will automatically + import from that package the exported symbol names." + (let* ((exports (find :export args :key #'car)) + (imports `(:import-from ,source-package ,@(cdr exports)))) + `(defpackage ,name + ,@(append args (list imports))))) + +(defpackage-import-exported :elephant-backend :elephant (:documentation "Backends should use this to get access to internal symbols of elephant that importers of elephant shouldn't see. Backends should also import elephant to get use-api generic function symbols, classes and globals") (:use #:elephant) - (:import-from #:elephant - ;; Variables - #:*dbconnection-spec* - #:connection-is-indeed-open - - ;; Persistent objects - #:oid #:get-con - #:next-oid - #:persistent-slot-writer - #:persistent-slot-reader - #:persistent-slot-boundp - #:persistent-slot-makunbound - - ;; Controllers - #:*elephant-code-version* - #:open-controller - #:close-controller - #:database-version - #:controller-spec - #:controller-serialize - #:controller-deserialize - #:root #:spec #:class-root - ;; Serialization - #:deserialize-from-base64-string - #:serialize-to-base64-string - ;; Cursor accessors - #:cursor-btree - #:cursor-oid - #:cursor-initialized-p - ;; Transactions - #:*current-transaction* - #:make-transaction-record - #:transaction-store - #:transaction-object - ;; Registration - #:register-backend-con-init - #:lookup-backend-con-init - ;; Misc - #:slot-definition-name - #:slots-and-values - #:struct-slots-and-values - #:remove-indexed-element-and-adjust - ) (:export ;; Variables - #:*cachesize* #:*dbconnection-spec* #:connection-is-indeed-open @@ -87,25 +51,37 @@ #:close-controller #:database-version #:controller-spec - #:controller-version + #:controller-serializer-version #:controller-serialize #:controller-deserialize #:root #:spec #:class-root - ;; Serialization + + ;; Serializer tools/api's + #:serialize #:deserialize #:deserialize-from-base64-string #:serialize-to-base64-string + #:initialize-serializer + #:serialize-database-version-key + #:serialize-database-version-value + #:deserialize-database-version-value + ;; Cursor accessors #:cursor-btree #:cursor-oid #:cursor-initialized-p + ;; Transactions #:*current-transaction* #:make-transaction-record #:transaction-store #:transaction-object + #:execute-transaction + ;; Registration #:register-backend-con-init #:lookup-backend-con-init + #:get-user-configuration-parameter + ;; Misc #:slot-definition-name #:slots-and-values --- /project/elephant/cvsroot/elephant/src/elephant/package.lisp 2007/03/30 14:34:35 1.26 +++ /project/elephant/cvsroot/elephant/src/elephant/package.lisp 2007/03/30 14:55:54 1.27 @@ -206,9 +206,10 @@ #:persistent #:persistent-object #:persistent-metaclass #:defpclass #:persistent-collection #:drop-pobject - #:btree #:make-btree - #:get-value #:remove-kv #:existp - #:indexed-btree #:make-indexed-btree + #:btree #:build-btree + #:get-value #:remove-kv #:existsp + #:indexed-btree #:build-indexed-btree + #:btree-index #:add-index #:get-index #:remove-index #:map-indices #:get-primary-key #:primary #:key-form #:key-fn #:with-btree-cursor #:map-btree #:map-index

1 0

[elephant-cvs] CVS elephant/src/db-bdb
by ieslick 30 Mar '07

30 Mar '07

Update of /project/elephant/cvsroot/elephant/src/db-bdb In directory clnet:/tmp/cvs-serv4653/src/db-bdb Modified Files: package.lisp Log Message: Add exported symbols that were missing from backend.lisp --- /project/elephant/cvsroot/elephant/src/db-bdb/package.lisp 2007/02/18 10:58:58 1.7 +++ /project/elephant/cvsroot/elephant/src/db-bdb/package.lisp 2007/03/30 14:55:54 1.8 @@ -30,7 +30,7 @@ Elephant, but with some magic for Elephant. In general there is a 1-1 mapping from functions here and functions in Berkeley DB, so refer to their documentation for details.") - (:use common-lisp uffi elephant-memutil elephant-backend elephant-utils elephant) + (:use common-lisp uffi elephant-memutil elephant elephant-backend elephant-utils) #+cmu (:use alien) #+sbcl

1 0

← Newer
1
...
10
11
12
13
14
15
16
...
86
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

elephant-cvs