Re: A Question about TextMappers.Scanner

From: [at]} <Gérard>
Date: Fri, 20 Sep 2002 22:06:58 +0200

----boundary-LibPST-iamunique-1664718915_-_-
Content-type: text/plain

> If I scan the following text via the TextMappers.Scanner
> ... ELSIF sc.string = "SHORTINT" THEN DoSomeThing; ...
> then I receive the token
> 3 ELSIF
> 3 sc
> 1 .
> 3 string
> 1 > 3 SHORTINT
> 3 THEN
> 3 DoSomeThing
> 1 ;
>
> If I scan the following text via the TextMappers.Scanner
> ... ELSIF sc.string = SHORTINT THEN DoSomeThing; ....
> then I receive the token
> 3 ELSIF
> 3 sc
> 1 .
> 3 string
> 1 > 3 SHORTINT
> 3 THEN
> 3 DoSomeThing
> 1 ;
>
> How do I distinguish between ... "SHORTINT" ... and ... SHORTINT ... ?
>
> Regards
>
> Helmut Zinn

You can use the reader included in the scanner to test the first character
of the string. Don't forget to record its last position and to restore it
before scanning again.

Regards.

Gérard

MODULE TestString;

 IMPORT

  StdLog, TextControllers, TextMappers, TextModels;

 CONST

  quotedString*= 2;

 PROCEDURE Try*;

  VAR

   c: TextControllers.Controller;
   s: TextMappers.Scanner;
   r: TextModels.Reader;
   pos, beg, end: INTEGER;

  BEGIN (*Try*)
   c:= TextControllers.Focus();
   IF c# NIL THEN
    StdLog.Open;
    s.ConnectTo(c.text);
    c.GetSelection(beg, end);
    IF beg< end THEN
     s.SetPos(beg);
    END;
    REPEAT
     REPEAT
      s.Scan;
     UNTIL (s.type= TextMappers.eot) OR (s.type= TextMappers.string);
     IF s.type= TextMappers.string THEN
      r:= s.rider;
      pos:= r.Pos();
      r.SetPos(s.start);
      r.Read;
      IF (r.char= '"') OR (r.char= "'") THEN
       StdLog.Int(quotedString);
      ELSE
       StdLog.Int(TextMappers.string);
      END;
      StdLog.Tab;
      StdLog.String(s.string);
      StdLog.Ln;
      r.SetPos(pos);
     END;
    UNTIL s.type= TextMappers.eot;
   END;
  END Try;

 END TestString.

TestString.Try;

--------------------------------------------

To unsubscribe from this mailing list, send a message containing the word "unsubscribe" to:
   blackbox-request{([at]})nowhere.xy

To get a list of valid e-mail commands and instructions on their usage, send a message containing the word "help" to the above address.

Send any problem reports or questions related to this email list to the list owner at
   owner-blackbox{([at]})nowhere.xy

Current posting policy:

a) To post you should use the same address by which you are subscribed to the mailing list. That way, the list server will recognize you as subscriber and forward your posting immediately, without creating any overhead.

b) If, for some reason, you cannot post from the address, by which you are subscribed, your message will be moderated to avoid spam. Please understand that moderation will often cause some delay, in particular over weekends or holydays.


----boundary-LibPST-iamunique-1664718915_-_-
Content-type: application/rtf
Content-transfer-encoding: base64
Content-Disposition: attachment; filename="rtf-body.rtf"

e1xydGYxXGFuc2lcYW5zaWNwZzEyNTJcZnJvbXRleHQgXGRlZmYwe1xmb250dGJsDQp7XGYwXGZz
d2lzc1xmY2hhcnNldDAgQXJpYWw7fQ0Ke1xmMVxmbW9kZXJuIENvdXJpZXIgTmV3O30NCntcZjJc
Zm5pbFxmY2hhcnNldDIgU3ltYm9sO30NCntcZjNcZm1vZGVyblxmY2hhcnNldDAgQ291cmllciBO
ZXc7fX0NCntcY29sb3J0YmxccmVkMFxncmVlbjBcYmx1ZTA7XHJlZDBcZ3JlZW4wXGJsdWUyNTU7
fQ0KXHVjMVxwYXJkXHBsYWluXGRlZnRhYjM2MCBcZjBcZnMyMCA+IElmIEkgc2NhbiB0aGUgZm9s
bG93aW5nIHRleHQgdmlhIHRoZSBUZXh0TWFwcGVycy5TY2FubmVyXHBhcg0KPiAuLi4gRUxTSUYg
c2Muc3RyaW5nID0gIlNIT1JUSU5UIiBUSEVOIERvU29tZVRoaW5nOyAuLi5ccGFyDQo+IHRoZW4g
SSByZWNlaXZlIHRoZSB0b2tlblxwYXINCj4gMyBFTFNJRlxwYXINCj4gMyBzY1xwYXINCj4gMSAu
XHBhcg0KPiAzIHN0cmluZ1xwYXINCj4gMSA9XHBhcg0KPiAzIFNIT1JUSU5UXHBhcg0KPiAzIFRI
RU5ccGFyDQo+IDMgRG9Tb21lVGhpbmdccGFyDQo+IDEgO1xwYXINCj5ccGFyDQo+IElmIEkgc2Nh
biB0aGUgZm9sbG93aW5nIHRleHQgdmlhIHRoZSBUZXh0TWFwcGVycy5TY2FubmVyXHBhcg0KPiAu
Li4gRUxTSUYgc2Muc3RyaW5nID0gU0hPUlRJTlQgVEhFTiBEb1NvbWVUaGluZzsgLi4uLlxwYXIN
Cj4gdGhlbiBJIHJlY2VpdmUgdGhlIHRva2VuXHBhcg0KPiAzIEVMU0lGXHBhcg0KPiAzIHNjXHBh
cg0KPiAxIC5ccGFyDQo+IDMgc3RyaW5nXHBhcg0KPiAxID1ccGFyDQo+IDMgU0hPUlRJTlRccGFy
DQo+IDMgVEhFTlxwYXINCj4gMyBEb1NvbWVUaGluZ1xwYXINCj4gMSA7XHBhcg0KPlxwYXINCj4g
SG93IGRvIEkgZGlzdGluZ3Vpc2ggYmV0d2VlbiAuLi4gIlNIT1JUSU5UIiAuLi4gYW5kIC4uLiBT
SE9SVElOVCAuLi4gP1xwYXINCj5ccGFyDQo+IFJlZ2FyZHNccGFyDQo+XHBhcg0KPiBIZWxtdXQg
WmlublxwYXINClxwYXINCllvdSBjYW4gdXNlIHRoZSByZWFkZXIgaW5jbHVkZWQgaW4gdGhlIHNj
YW5uZXIgdG8gdGVzdCB0aGUgZmlyc3QgY2hhcmFjdGVyXHBhcg0Kb2YgdGhlIHN0cmluZy4gRG9u
J3QgZm9yZ2V0IHRvIHJlY29yZCBpdHMgbGFzdCBwb3NpdGlvbiBhbmQgdG8gcmVzdG9yZSBpdFxw
YXINCmJlZm9yZSBzY2FubmluZyBhZ2Fpbi5ccGFyDQpccGFyDQpSZWdhcmRzLlxwYXINClxwYXIN
CkdcJ2U5cmFyZFxwYXINClxwYXINCk1PRFVMRSBUZXN0U3RyaW5nO1xwYXINClxwYXINCiBJTVBP
UlRccGFyDQpccGFyDQogIFN0ZExvZywgVGV4dENvbnRyb2xsZXJzLCBUZXh0TWFwcGVycywgVGV4
dE1vZGVscztccGFyDQpccGFyDQogQ09OU1RccGFyDQpccGFyDQogIHF1b3RlZFN0cmluZyo9IDI7
XHBhcg0KXHBhcg0KIFBST0NFRFVSRSBUcnkqO1xwYXINClxwYXINCiAgVkFSXHBhcg0KXHBhcg0K
ICAgYzogVGV4dENvbnRyb2xsZXJzLkNvbnRyb2xsZXI7XHBhcg0KICAgczogVGV4dE1hcHBlcnMu
U2Nhbm5lcjtccGFyDQogICByOiBUZXh0TW9kZWxzLlJlYWRlcjtccGFyDQogICBwb3MsIGJlZywg
ZW5kOiBJTlRFR0VSO1xwYXINClxwYXINCiAgQkVHSU4gKCpUcnkqKVxwYXINCiAgIGM6PSBUZXh0
Q29udHJvbGxlcnMuRm9jdXMoKTtccGFyDQogICBJRiBjIyBOSUwgVEhFTlxwYXINCiAgICBTdGRM
b2cuT3BlbjtccGFyDQogICAgcy5Db25uZWN0VG8oYy50ZXh0KTtccGFyDQogICAgYy5HZXRTZWxl
Y3Rpb24oYmVnLCBlbmQpO1xwYXINCiAgICBJRiBiZWc8IGVuZCBUSEVOXHBhcg0KICAgICBzLlNl
dFBvcyhiZWcpO1xwYXINCiAgICBFTkQ7XHBhcg0KICAgIFJFUEVBVFxwYXINCiAgICAgUkVQRUFU
XHBhcg0KICAgICAgcy5TY2FuO1xwYXINCiAgICAgVU5USUwgKHMudHlwZT0gVGV4dE1hcHBlcnMu
ZW90KSBPUiAocy50eXBlPSBUZXh0TWFwcGVycy5zdHJpbmcpO1xwYXINCiAgICAgSUYgcy50eXBl
PSBUZXh0TWFwcGVycy5zdHJpbmcgVEhFTlxwYXINCiAgICAgIHI6PSBzLnJpZGVyO1xwYXINCiAg
ICAgIHBvczo9IHIuUG9zKCk7XHBhcg0KICAgICAgci5TZXRQb3Mocy5zdGFydCk7XHBhcg0KICAg
ICAgci5SZWFkO1xwYXINCiAgICAgIElGIChyLmNoYXI9ICciJykgT1IgKHIuY2hhcj0gIiciKSBU
SEVOXHBhcg0KICAgICAgIFN0ZExvZy5JbnQocXVvdGVkU3RyaW5nKTtccGFyDQogICAgICBFTFNF
XHBhcg0KICAgICAgIFN0ZExvZy5JbnQoVGV4dE1hcHBlcnMuc3RyaW5nKTtccGFyDQogICAgICBF
TkQ7XHBhcg0KICAgICAgU3RkTG9nLlRhYjtccGFyDQogICAgICBTdGRMb2cuU3RyaW5nKHMuc3Ry
aW5nKTtccGFyDQogICAgICBTdGRMb2cuTG47XHBhcg0KICAgICAgci5TZXRQb3MocG9zKTtccGFy
DQogICAgIEVORDtccGFyDQogICAgVU5USUwgcy50eXBlPSBUZXh0TWFwcGVycy5lb3Q7XHBhcg0K
ICAgRU5EO1xwYXINCiAgRU5EIFRyeTtccGFyDQpccGFyDQogRU5EIFRlc3RTdHJpbmcuXHBhcg0K
XHBhcg0KVGVzdFN0cmluZy5Ucnk7XHBhcg0KXHBhcg0KLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t
LS0tLS0tLS0tLS0tLS0tLS0tLS1ccGFyDQpccGFyDQpUbyB1bnN1YnNjcmliZSBmcm9tIHRoaXMg
bWFpbGluZyBsaXN0LCBzZW5kIGEgbWVzc2FnZSBjb250YWluaW5nIHRoZSB3b3JkICJ1bnN1YnNj
cmliZSIgdG86XHBhcg0KICAgYmxhY2tib3gtcmVxdWVzdEBvYmVyb24uY2hccGFyDQpccGFyDQpU
byBnZXQgYSBsaXN0IG9mIHZhbGlkIGUtbWFpbCBjb21tYW5kcyBhbmQgaW5zdHJ1Y3Rpb25zIG9u
IHRoZWlyIHVzYWdlLCBzZW5kIGEgbWVzc2FnZSBjb250YWluaW5nIHRoZSB3b3JkICJoZWxwIiB0
byB0aGUgYWJvdmUgYWRkcmVzcy5ccGFyDQpccGFyDQpTZW5kIGFueSBwcm9ibGVtIHJlcG9ydHMg
b3IgcXVlc3Rpb25zIHJlbGF0ZWQgdG8gdGhpcyBlbWFpbCBsaXN0IHRvIHRoZSBsaXN0IG93bmVy
IGF0XHBhcg0KICAgb3duZXItYmxhY2tib3hAb2Jlcm9uLmNoXHBhcg0KXHBhcg0KQ3VycmVudCBw
b3N0aW5nIHBvbGljeTpccGFyDQpccGFyDQphKSBUbyBwb3N0IHlvdSBzaG91bGQgdXNlIHRoZSBz
YW1lIGFkZHJlc3MgYnkgd2hpY2ggeW91IGFyZSBzdWJzY3JpYmVkIHRvIHRoZSBtYWlsaW5nIGxp
c3QuIFRoYXQgd2F5LCB0aGUgbGlzdCBzZXJ2ZXIgd2lsbCByZWNvZ25pemUgeW91IGFzIHN1YnNj
cmliZXIgYW5kIGZvcndhcmQgeW91ciBwb3N0aW5nIGltbWVkaWF0ZWx5LCB3aXRob3V0IGNyZWF0
aW5nIGFueSBvdmVyaGVhZC5ccGFyDQpccGFyDQpiKSBJZiwgZm9yIHNvbWUgcmVhc29uLCB5b3Ug
Y2Fubm90IHBvc3QgZnJvbSB0aGUgYWRkcmVzcywgYnkgd2hpY2ggeW91IGFyZSBzdWJzY3JpYmVk
LCB5b3VyIG1lc3NhZ2Ugd2lsbCBiZSBtb2RlcmF0ZWQgdG8gYXZvaWQgc3BhbS4gUGxlYXNlIHVu
ZGVyc3RhbmQgdGhhdCBtb2RlcmF0aW9uIHdpbGwgb2Z0ZW4gY2F1c2Ugc29tZSBkZWxheSwgaW4g
cGFydGljdWxhciBvdmVyIHdlZWtlbmRzIG9yIGhvbHlkYXl9fQAgd2lsbCA

----boundary-LibPST-iamunique-1664718915_-_---
Received on Fri Sep 20 2002 - 22:06:58 UTC