annotate mayachemtools/docs/modules/txt/SimpleCalcYYLexer.txt @ 3:e420415a1799 draft

Uploaded
author deepakjadmin
date Wed, 20 Jan 2016 12:16:47 -0500
parents 73ae111cf86f
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
0
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
1 NAME
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
2 Parsers::SimpleCalcYYLexer
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
3
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
4 SYNOPSIS
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
5 use Parsers::SimpleCalcYYLexer;
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
6
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
7 use Parsers::SimpleCalcYYLexer qw(:all);
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
8
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
9 DESCRIPTION
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
10 SimpleCalcYYLexer class provides the following methods:
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
11
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
12 new, YYLex, GetYYLex, StringifySimpleCalcYYLexer
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
13
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
14 Parser::SimpleCalcYYLexer class is derived from Parser::YYLexer class,
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
15 which in turn is derived from base class Parser::Lexer that provides all
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
16 the underlying lexer functionality. SimpleCalcYYLexer class is designed
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
17 to be used with yyparse code generated by running byacc on a parser
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
18 defined using parser definition SimpleCalcParser.yy file.
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
19
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
20 The parser package and token table files, SimpleCalcParser.pm and
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
21 SimpleCalcParser.tab.ph, are automatically generated from parser grammar
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
22 definition file, SimpleCalcParser.yy, using byacc available through
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
23 perl-byacc1.8 modified with perl5-byacc-patches-0.5 for generation of
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
24 object oriented parser:
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
25
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
26 byacc -l -P -d -b SimpleCalcParser SimpleCalcParser.yy
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
27 mv SimpleCalcParser.tab.pl SimpleCalcParser.pm
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
28
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
29 SimpleCalcYYLexer.pm class implements a lexer for a simple calculator
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
30 and is provided to highlight usasge of YYLex through yyparse.
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
31
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
32 The default specification of lexer tokens for SimpleCalcYYLexer.pm
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
33 includes:
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
34
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
35 @YYLexerTokensSpec = (
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
36 [ 'LETTER', qr/[a-zA-Z]/ ],
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
37 [ 'NUMBER', qr/\d+/ ],
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
38 [ 'SPACE', qr/[ ]*/,
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
39 sub { my($This, $TokenLabel, $MatchedText) = @_; return ''; }
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
40 ],
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
41 [ 'NEWLINE', qr/(?:\r\n|\r|\n)/,
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
42 sub { my($This, $TokenLabel, $MatchedText) = @_; return "\n"; }
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
43 ],
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
44 [ 'CHAR', qr/./ ]
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
45 );
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
46
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
47 The default SimpleCalcParser.tab.ph file containing token identifiers
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
48 for SimpleCalcParser.yy includes:
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
49
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
50 $NUMBER=257;
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
51 $LETTER=258;
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
52
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
53 METHODS
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
54 new
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
55 $SimpleCalcYYLexer = new Parsers::SimpleCalcYYLexer($Input);
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
56
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
57 Using specified *Input*, new method generates a new
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
58 SimpleCalcYYLexer and returns a reference to newly created
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
59 SimpleCalcYYLexer object.
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
60
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
61 Examples:
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
62
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
63 # Input string...
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
64 $InputText = "3 + 4 +6\nx=3\ny=5\nx+y\nx+z\n";
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
65
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
66 $YYLexer = new Parsers::SimpleCalcYYLexer($InputText);
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
67 $YYLex = $YYLexer->GetYYLex();
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
68
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
69 $Debug = 0;
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
70 $CalcParser = new Parsers::SimpleCalcParser($YYLex,
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
71 \&Parsers::SimpleCalcParser::yyerror, $Debug);
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
72 $Value = $SimpleCalcParser->yyparse();
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
73 print "Value: $Value\n";
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
74
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
75 # Input file...
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
76 $InputFile = "Input.txt";
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
77 open INPUTFILE, "$InputFile" or die "Couldn't open $InputFile: $!\n";
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
78 $YYLexer = new Parsers::SimpleCalcYYLexer($InputFile);
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
79 $YYLex = $YYLexer->GetYYLex();
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
80
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
81 $CalcParser = new Parsers::SimpleCalcParser($YYLex,
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
82 \&Parsers::SimpleCalcParser::yyerror);
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
83 $Value = $SimpleCalcParser->yyparse();
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
84 print "Value: $Value\n";
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
85
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
86 # Input file iterator...
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
87 $InputFile = "TestSimpleCalcParser.txt";
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
88 open INPUTFILE, "$InputFile" or die "Couldn't open $InputFile: $!\n";
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
89 $InputIterator = sub { return <INPUTFILE>; };
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
90 $YYLexer = new Parsers::SimpleCalcYYLexer($InputIterator);
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
91 $YYLex = $YYLexer->GetYYLex();
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
92
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
93 $CalcParser = new Parsers::SimpleCalcParser($YYLex,
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
94 \&Parsers::SimpleCalcParser::yyerror);
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
95 $Value = $SimpleCalcParser->yyparse();
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
96 print "Value: $Value\n";
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
97
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
98 StringifySimpleCalcYYLexer
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
99 $YYLexerString = $YYLexer->StringifySimpleCalcYYLexer();
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
100
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
101 Returns a string containing information about *YYLexer* object.
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
102
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
103 AUTHOR
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
104 Manish Sud <msud@san.rr.com>
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
105
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
106 SEE ALSO
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
107 Lexer.pm, YYLexer.pm, SimpleCalcParser.yy
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
108
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
109 COPYRIGHT
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
110 Copyright (C) 2015 Manish Sud. All rights reserved.
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
111
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
112 This file is part of MayaChemTools.
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
113
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
114 MayaChemTools is free software; you can redistribute it and/or modify it
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
115 under the terms of the GNU Lesser General Public License as published by
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
116 the Free Software Foundation; either version 3 of the License, or (at
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
117 your option) any later version.
73ae111cf86f Uploaded
deepakjadmin
parents:
diff changeset
118