another sagety proposal

From: [at]} <ftkachov{>
Date: Thu, 10 Jul 2003 01:09:20 +0400 (MSK DST)

----boundary-LibPST-iamunique-1996748822_-_-
Content-type: text/plain

(I've just fired-up the mail program when Doug's message arrived.
His example also points to the problem discussed below.
With the proposal described below, the assiggment rw := A.r
in his example would not be possible.)

Hi All!

Here is another little safety-tightening proposal for BB 1.5:

to allow a limited export for any pointer types based on records
or arrays.
The effect would be to prohibit explicit assignments to variables
of such pointer types except in the defining module.

This would allow the server module e.g. to guarantee that the
client has only one valid pointer to access and manipulate (via
calls to procedures in the server module) a data structure, so that
the server could reuse the data structure and return it to the
client.

I am dealing with some convoluted calculations that are hard to
have confidence in, whereas efficiency concerns that make me
wish for such a mechanism, are significant (factor 1.5 for CPU
time).

The description of the problem is attached -- there seems to be a
kind of a half-way quasi-solution, but it is incomplete and implies
serious inefficiencies of its own.

Cheers
Fyodor Tkachov
--------------------------------------------------------------
PS The problem description.

The mechanism we are talking about reduces the CPU time by a
factor of 1.5, which may translate into saved hours -- perhaps
days as the complexity of interesting problems in this family is
practically unlimited from above.

Suppose module A exports a pointer type, called Register, to be
used to provide an intermediate storage in a special kind of
calculations.
A Register object contains internal data structures whose size is
adapted dynamically (it is extremely hard to predict a priori what
could be needed).
Module A maintains a pool of Registers; the size of the pool is
also adapted dynamically.
Module A provides a Register from the pool to the client upon
request.
There is also a mechanism to "release" a Register back into the
pool when it is no longer needed.

It is this reuse of Registers (as profiling shows) that is responsible
for the 1.5 speed-up factor.

However, a variant of the problem of dangling pointers emerges:
the client program may preserve (by programmer's mistake) a
copy of the pointer to a Register that has already been released
into the pool and then requested from the pool again.

A quasi-solution is to embed the pointer to Register into an
auxiliary exported type:

Interface* = POINTER TO LIMITED r: Register RECORD.

All manipulations with Registers by the client (including release of
Registers) are supposed to be performed via the Interface
objects.
Furthermore, a new Interface object should be allocated each
time a Register is requested, even if the Register it refers to is
being reused.

Then the server can guarantee that even if the client maintains
several references to an Interface object, once a Register has
been "released" (via the corresponding Interface object), the field
r is NILed and erroneous access to the Register becomes
impossible.
Since Interface objects are much smaller than the Register
objects, garbage is accumulated much slower and the 50%
overhead is much reduced.

But then there is the problem of access to the data structures
hidden inside the Register: it's a bunch of arrays which the client
should be able to traverse.
If one gives client pointers to those arrays, the problem we
started from reemerges.
The only alternative is to give the client copies of the hidden
arrays, which, again, is expensive as the client may need to look
at the data several times.

May be I am missing a good solution.
--------------------------------------------------------------
--------------------------------------------

To unsubscribe from this mailing list, send a message containing the word "unsubscribe" to:
   blackbox-request{([at]})nowhere.xy

To get a list of valid e-mail commands and instructions on their usage, send a message containing the word "help" to the above address.

Send any problem reports or questions related to this email list to the list owner at
   owner-blackbox{([at]})nowhere.xy

Current posting policy:

a) To post you should use the same address by which you are subscribed to the mailing list. That way, the list server will recognize you as subscriber and forward your posting immediately, without creating any overhead.

b) If, for some reason, you cannot post from the address, by which you are subscribed, your message will be moderated to avoid spam. Please understand that moderation will often cause some delay, in particular over weekends or holydays.


----boundary-LibPST-iamunique-1996748822_-_-
Content-type: application/rtf
Content-transfer-encoding: base64
Content-Disposition: attachment; filename="rtf-body.rtf"

e1xydGYxXGFuc2lcYW5zaWNwZzEyNTJcZnJvbXRleHQgXGRlZmYwe1xmb250dGJsDQp7XGYwXGZz
d2lzcyBBcmlhbDt9DQp7XGYxXGZtb2Rlcm4gQ291cmllciBOZXc7fQ0Ke1xmMlxmbmlsXGZjaGFy
c2V0MiBTeW1ib2w7fQ0Ke1xmM1xmbW9kZXJuXGZjaGFyc2V0MCBDb3VyaWVyIE5ldzt9fQ0Ke1xj
b2xvcnRibFxyZWQwXGdyZWVuMFxibHVlMDtccmVkMFxncmVlbjBcYmx1ZTI1NTt9DQpcdWMxXHBh
cmRccGxhaW5cZGVmdGFiMzYwIFxmMFxmczIwIChJJ3ZlIGp1c3QgZmlyZWQtdXAgdGhlIG1haWwg
cHJvZ3JhbSB3aGVuIERvdWcncyBtZXNzYWdlIGFycml2ZWQuXHBhcg0KSGlzIGV4YW1wbGUgYWxz
byBwb2ludHMgdG8gdGhlIHByb2JsZW0gZGlzY3Vzc2VkIGJlbG93LlxwYXINCldpdGggdGhlIHBy
b3Bvc2FsIGRlc2NyaWJlZCBiZWxvdywgdGhlIGFzc2lnZ21lbnQgcncgOj0gQS5yXHBhcg0KaW4g
aGlzIGV4YW1wbGUgd291bGQgbm90IGJlIHBvc3NpYmxlLilccGFyDQpccGFyDQpIaSBBbGwhXHBh
cg0KXHBhcg0KSGVyZSBpcyBhbm90aGVyIGxpdHRsZSBzYWZldHktdGlnaHRlbmluZyBwcm9wb3Nh
bCBmb3IgQkIgMS41OlxwYXINClxwYXINCnRvIGFsbG93IGEgbGltaXRlZCBleHBvcnQgZm9yIGFu
eSBwb2ludGVyIHR5cGVzIGJhc2VkIG9uIHJlY29yZHNccGFyDQpvciBhcnJheXMuXHBhcg0KVGhl
IGVmZmVjdCB3b3VsZCBiZSB0byBwcm9oaWJpdCBleHBsaWNpdCBhc3NpZ25tZW50cyB0byB2YXJp
YWJsZXNccGFyDQpvZiBzdWNoIHBvaW50ZXIgdHlwZXMgZXhjZXB0IGluIHRoZSBkZWZpbmluZyBt
b2R1bGUuXHBhcg0KXHBhcg0KVGhpcyB3b3VsZCBhbGxvdyB0aGUgc2VydmVyIG1vZHVsZSBlLmcu
IHRvIGd1YXJhbnRlZSB0aGF0IHRoZVxwYXINCmNsaWVudCBoYXMgb25seSBvbmUgdmFsaWQgcG9p
bnRlciB0byBhY2Nlc3MgYW5kIG1hbmlwdWxhdGUgKHZpYVxwYXINCmNhbGxzIHRvIHByb2NlZHVy
ZXMgaW4gdGhlIHNlcnZlciBtb2R1bGUpIGEgZGF0YSBzdHJ1Y3R1cmUsIHNvIHRoYXRccGFyDQp0
aGUgc2VydmVyIGNvdWxkIHJldXNlIHRoZSBkYXRhIHN0cnVjdHVyZSBhbmQgcmV0dXJuIGl0IHRv
IHRoZVxwYXINCmNsaWVudC5ccGFyDQpccGFyDQpJIGFtIGRlYWxpbmcgd2l0aCBzb21lIGNvbnZv
bHV0ZWQgY2FsY3VsYXRpb25zIHRoYXQgYXJlIGhhcmQgdG9ccGFyDQpoYXZlIGNvbmZpZGVuY2Ug
aW4sIHdoZXJlYXMgZWZmaWNpZW5jeSBjb25jZXJucyB0aGF0IG1ha2UgbWVccGFyDQp3aXNoIGZv
ciBzdWNoIGEgbWVjaGFuaXNtLCBhcmUgc2lnbmlmaWNhbnQgKGZhY3RvciAxLjUgZm9yIENQVVxw
YXINCnRpbWUpLlxwYXINClxwYXINClRoZSBkZXNjcmlwdGlvbiBvZiB0aGUgcHJvYmxlbSBpcyBh
dHRhY2hlZCAtLSB0aGVyZSBzZWVtcyB0byBiZSBhXHBhcg0Ka2luZCBvZiBhIGhhbGYtd2F5IHF1
YXNpLXNvbHV0aW9uLCBidXQgaXQgaXMgaW5jb21wbGV0ZSBhbmQgaW1wbGllc1xwYXINCnNlcmlv
dXMgaW5lZmZpY2llbmNpZXMgb2YgaXRzIG93bi5ccGFyDQpccGFyDQpDaGVlcnNccGFyDQpGeW9k
b3IgVGthY2hvdlxwYXINCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t
LS0tLS0tLS0tLS0tLS0tLS0tLS0tXHBhcg0KUFMgVGhlIHByb2JsZW0gZGVzY3JpcHRpb24uXHBh
cg0KXHBhcg0KVGhlIG1lY2hhbmlzbSB3ZSBhcmUgdGFsa2luZyBhYm91dCByZWR1Y2VzIHRoZSBD
UFUgdGltZSBieSBhXHBhcg0KZmFjdG9yIG9mIDEuNSwgd2hpY2ggbWF5IHRyYW5zbGF0ZSBpbnRv
IHNhdmVkIGhvdXJzIC0tIHBlcmhhcHNccGFyDQpkYXlzIGFzIHRoZSBjb21wbGV4aXR5IG9mIGlu
dGVyZXN0aW5nIHByb2JsZW1zIGluIHRoaXMgZmFtaWx5IGlzXHBhcg0KcHJhY3RpY2FsbHkgdW5s
aW1pdGVkIGZyb20gYWJvdmUuXHBhcg0KXHBhcg0KU3VwcG9zZSBtb2R1bGUgQSBleHBvcnRzIGEg
cG9pbnRlciB0eXBlLCBjYWxsZWQgUmVnaXN0ZXIsIHRvIGJlXHBhcg0KdXNlZCB0byBwcm92aWRl
IGFuIGludGVybWVkaWF0ZSBzdG9yYWdlIGluIGEgc3BlY2lhbCBraW5kIG9mXHBhcg0KY2FsY3Vs
YXRpb25zLlxwYXINCkEgUmVnaXN0ZXIgb2JqZWN0IGNvbnRhaW5zIGludGVybmFsIGRhdGEgc3Ry
dWN0dXJlcyB3aG9zZSBzaXplIGlzXHBhcg0KYWRhcHRlZCBkeW5hbWljYWxseSAoaXQgaXMgZXh0
cmVtZWx5IGhhcmQgdG8gcHJlZGljdCBhIHByaW9yaSB3aGF0XHBhcg0KY291bGQgYmUgbmVlZGVk
KS5ccGFyDQpNb2R1bGUgQSBtYWludGFpbnMgYSBwb29sIG9mIFJlZ2lzdGVyczsgdGhlIHNpemUg
b2YgdGhlIHBvb2wgaXNccGFyDQphbHNvIGFkYXB0ZWQgZHluYW1pY2FsbHkuXHBhcg0KTW9kdWxl
IEEgcHJvdmlkZXMgYSBSZWdpc3RlciBmcm9tIHRoZSBwb29sIHRvIHRoZSBjbGllbnQgdXBvblxw
YXINCnJlcXVlc3QuXHBhcg0KVGhlcmUgaXMgYWxzbyBhIG1lY2hhbmlzbSB0byAicmVsZWFzZSIg
YSBSZWdpc3RlciBiYWNrIGludG8gdGhlXHBhcg0KcG9vbCB3aGVuIGl0IGlzIG5vIGxvbmdlciBu
ZWVkZWQuXHBhcg0KXHBhcg0KSXQgaXMgdGhpcyByZXVzZSBvZiBSZWdpc3RlcnMgKGFzIHByb2Zp
bGluZyBzaG93cykgdGhhdCBpcyByZXNwb25zaWJsZVxwYXINCmZvciB0aGUgMS41IHNwZWVkLXVw
IGZhY3Rvci5ccGFyDQpccGFyDQpIb3dldmVyLCBhIHZhcmlhbnQgb2YgdGhlIHByb2JsZW0gb2Yg
ZGFuZ2xpbmcgcG9pbnRlcnMgZW1lcmdlczpccGFyDQp0aGUgY2xpZW50IHByb2dyYW0gbWF5IHBy
ZXNlcnZlIChieSBwcm9ncmFtbWVyJ3MgbWlzdGFrZSkgYVxwYXINCmNvcHkgb2YgdGhlIHBvaW50
ZXIgdG8gYSBSZWdpc3RlciB0aGF0IGhhcyBhbHJlYWR5IGJlZW4gcmVsZWFzZWRccGFyDQppbnRv
IHRoZSBwb29sIGFuZCB0aGVuIHJlcXVlc3RlZCBmcm9tIHRoZSBwb29sIGFnYWluLlxwYXINClxw
YXINCkEgcXVhc2ktc29sdXRpb24gaXMgdG8gZW1iZWQgdGhlIHBvaW50ZXIgdG8gUmVnaXN0ZXIg
aW50byBhblxwYXINCmF1eGlsaWFyeSBleHBvcnRlZCB0eXBlOlxwYXINClxwYXINCkludGVyZmFj
ZSogPSBQT0lOVEVSIFRPIExJTUlURUQgcjogUmVnaXN0ZXIgUkVDT1JELlxwYXINClxwYXINCkFs
bCBtYW5pcHVsYXRpb25zIHdpdGggUmVnaXN0ZXJzIGJ5IHRoZSBjbGllbnQgKGluY2x1ZGluZyBy
ZWxlYXNlIG9mXHBhcg0KUmVnaXN0ZXJzKSBhcmUgc3VwcG9zZWQgdG8gYmUgcGVyZm9ybWVkIHZp
YSB0aGUgSW50ZXJmYWNlXHBhcg0Kb2JqZWN0cy5ccGFyDQpGdXJ0aGVybW9yZSwgYSBuZXcgSW50
ZXJmYWNlIG9iamVjdCBzaG91bGQgYmUgYWxsb2NhdGVkIGVhY2hccGFyDQp0aW1lIGEgUmVnaXN0
ZXIgaXMgcmVxdWVzdGVkLCBldmVuIGlmIHRoZSBSZWdpc3RlciBpdCByZWZlcnMgdG8gaXNccGFy
DQpiZWluZyByZXVzZWQuXHBhcg0KXHBhcg0KVGhlbiB0aGUgc2VydmVyIGNhbiBndWFyYW50ZWUg
dGhhdCBldmVuIGlmIHRoZSBjbGllbnQgbWFpbnRhaW5zXHBhcg0Kc2V2ZXJhbCByZWZlcmVuY2Vz
IHRvIGFuIEludGVyZmFjZSBvYmplY3QsIG9uY2UgYSBSZWdpc3RlciBoYXNccGFyDQpiZWVuICJy
ZWxlYXNlZCIgKHZpYSB0aGUgY29ycmVzcG9uZGluZyBJbnRlcmZhY2Ugb2JqZWN0KSwgdGhlIGZp
ZWxkXHBhcg0KciBpcyBOSUxlZCBhbmQgZXJyb25lb3VzIGFjY2VzcyB0byB0aGUgUmVnaXN0ZXIg
YmVjb21lc1xwYXINCmltcG9zc2libGUuXHBhcg0KU2luY2UgSW50ZXJmYWNlIG9iamVjdHMgYXJl
IG11Y2ggc21hbGxlciB0aGFuIHRoZSBSZWdpc3RlclxwYXINCm9iamVjdHMsIGdhcmJhZ2UgaXMg
YWNjdW11bGF0ZWQgbXVjaCBzbG93ZXIgYW5kIHRoZSA1MCVccGFyDQpvdmVyaGVhZCBpcyBtdWNo
IHJlZHVjZWQuXHBhcg0KXHBhcg0KQnV0IHRoZW4gdGhlcmUgaXMgdGhlIHByb2JsZW0gb2YgYWNj
ZXNzIHRvIHRoZSBkYXRhIHN0cnVjdHVyZXNccGFyDQpoaWRkZW4gaW5zaWRlIHRoZSBSZWdpc3Rl
cjogaXQncyBhIGJ1bmNoIG9mIGFycmF5cyB3aGljaCB0aGUgY2xpZW50XHBhcg0Kc2hvdWxkIGJl
IGFibGUgdG8gdHJhdmVyc2UuXHBhcg0KSWYgb25lIGdpdmVzIGNsaWVudCBwb2ludGVycyB0byB0
aG9zZSBhcnJheXMsIHRoZSBwcm9ibGVtIHdlXHBhcg0Kc3RhcnRlZCBmcm9tIHJlZW1lcmdlcy5c
cGFyDQpUaGUgb25seSBhbHRlcm5hdGl2ZSBpcyB0byBnaXZlIHRoZSBjbGllbnQgY29waWVzIG9m
IHRoZSBoaWRkZW5ccGFyDQphcnJheXMsIHdoaWNoLCBhZ2FpbiwgaXMgZXhwZW5zaXZlIGFzIHRo
ZSBjbGllbnQgbWF5IG5lZWQgdG8gbG9va1xwYXINCmF0IHRoZSBkYXRhIHNldmVyYWwgdGltZXMu
XHBhcg0KXHBhcg0KTWF5IGJlIEkgYW0gbWlzc2luZyBhIGdvb2Qgc29sdXRpb24uXHBhcg0KLS0t
LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t
LS1ccGFyDQotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLVxwYXIN
ClxwYXINClRvIHVuc3Vic2NyaWJlIGZyb20gdGhpcyBtYWlsaW5nIGxpc3QsIHNlbmQgYSBtZXNz
YWdlIGNvbnRhaW5pbmcgdGhlIHdvcmQgInVuc3Vic2NyaWJlIiB0bzpccGFyDQogICBibGFja2Jv
eC1yZXF1ZXN0QG9iZXJvbi5jaFxwYXINClxwYXINClRvIGdldCBhIGxpc3Qgb2YgdmFsaWQgZS1t
YWlsIGNvbW1hbmRzIGFuZCBpbnN0cnVjdGlvbnMgb24gdGhlaXIgdXNhZ2UsIHNlbmQgYSBtZXNz
YWdlIGNvbnRhaW5pbmcgdGhlIHdvcmQgImhlbHAiIHRvIHRoZSBhYm92ZSBhZGRyZXNzLlxwYXIN
ClxwYXINClNlbmQgYW55IHByb2JsZW0gcmVwb3J0cyBvciBxdWVzdGlvbnMgcmVsYXRlZCB0byB0
aGlzIGVtYWlsIGxpc3QgdG8gdGhlIGxpc3Qgb3duZXIgYXRccGFyDQogICBvd25lci1ibGFja2Jv
eEBvYmVyb24uY2hccGFyDQpccGFyDQpDdXJyZW50IHBvc3RpbmcgcG9saWN5OlxwYXINClxwYXIN
CmEpIFRvIHBvc3QgeW91IHNob3VsZCB1c2UgdGhlIHNhbWUgYWRkcmVzcyBieSB3aGljaCB5b3Ug
YXJlIHN1YnNjcmliZWQgdG8gdGhlIG1haWxpbmcgbGlzdC4gVGhhdCB3YXksIHRoZSBsaXN0IHNl
cnZlciB3aWxsIHJlY29nbml6ZSB5b3UgYXMgc3Vic2NyaWJlciBhbmQgZm9yd2FyZCB5b3VyIHBv
c3RpbmcgaW1tZWRpYXRlbHksIHdpdGhvdXQgY3JlYXRpbmcgYW55IG92ZXJoZWFkLlxwYXINClxw
YXINCmIpIElmLCBmb3Igc29tZSByZWFzb24sIHlvdSBjYW5ub3QgcG9zdCBmcm9tIHRoZSBhZGRy
ZXNzLCBieSB3aGljaCB5b3UgYXJlIHN1YnNjcmliZWQsIHlvdXIgbWVzc2FnZSB3aWxsIGJlIG1v
ZGVyYXRlZCB0byBhdm9pZCBzcGFtLiBQbGVhc2UgdW5kZXJzdGFuZCB0aGF0IG1vZGVyYXRpb24g
d2lsbCBvZnRlbiBjYXVzZSBzb21lIGRlbGF5LCBpbiBwYXJ0aWN1bGFyIG92ZXIgd2Vla2VuZHMg
b3IgaG9seWRheXN9fQBkZXJhdA==


----boundary-LibPST-iamunique-1996748822_-_---
Received on Wed Jul 09 2003 - 23:09:20 UTC

This archive was generated by hypermail 2.3.0 : Thu Sep 26 2013 - 06:29:09 UTC