Package antlr
Class CSharpCodeGenerator
java.lang.Object
antlr.CodeGenerator
antlr.CSharpCodeGenerator
Generates MyParser.cs, MyLexer.cs and MyParserTokenTypes.cs
-
Field Summary
FieldsModifier and TypeFieldDescription(package private) int(package private) intstatic final int(package private) String(package private) String(package private) String(package private) String(package private) RuleBlock(package private) HashtableUsed to keep track of which AST variables have been defined in a rule (except for the #rule_name and #rule_name_in var's(package private) Stringprotected boolean(package private) String(package private) String(package private) String(package private) Stringprotected static final StringSpecial value used to mark duplicate in treeVariableMap(package private) intprotected booleanprotected int(package private) String(package private) HashtableMapping between the ids used in the current alt, and the names of variables used to represent their AST values.(package private) booleanFields inherited from class antlr.CodeGenerator
analyzer, antlrTool, behavior, BITSET_OPTIMIZE_INIT_THRESHOLD, bitsetsUsed, bitsetTestThreshold, charFormatter, currentOutput, DEBUG_CODE_GENERATOR, DEFAULT_BITSET_TEST_THRESHOLD, DEFAULT_MAKE_SWITCH_THRESHOLD, grammar, makeSwitchThreshold, tabs, TokenTypesFileExt, TokenTypesFileSuffix -
Constructor Summary
ConstructorsConstructorDescriptionCreate a CSharp code-generator using the given Grammar. -
Method Summary
Modifier and TypeMethodDescriptionprotected intaddSemPred(String predicate) Adds a semantic predicate string to the sem pred vector These strings will be used to build an array of sem pred names when building a debugging parser.voidvoidgen()Generate the parser, lexer, treeparser, and token types in CSharpvoidgen(ActionElement action) Generate code for the given grammar element.voidgen(AlternativeBlock blk) Generate code for the given grammar element.voidgen(BlockEndElement end) Generate code for the given grammar element.voidgen(CharLiteralElement atom) Generate code for the given grammar element.voidGenerate code for the given grammar element.voidgen(LexerGrammar g) Generate the lexer CSharp filevoidgen(OneOrMoreBlock blk) Generate code for the given grammar element.voidgen(ParserGrammar g) Generate the parser CSharp filevoidgen(RuleRefElement rr) Generate code for the given grammar element.voidgen(StringLiteralElement atom) Generate code for the given grammar element.voidGenerate code for the given grammar element.voidgen(TokenRefElement atom) Generate code for the given grammar element.voidgen(TreeElement t) Generate code for the given grammar element.voidGenerate the tree-parser CSharp filevoidgen(WildcardElement wc) Generate code for the given grammar element.voidgen(ZeroOrMoreBlock blk) Generate code for the given grammar element.protected voidgenAlt(Alternative alt, AlternativeBlock blk) Generate an alternative.protected voidprotected voidgenASTDeclaration(AlternativeElement el, String node_type) protected voidgenASTDeclaration(AlternativeElement el, String var_name, String node_type) protected voidgenBitsets(Vector bitsetList, int maxVocabulary) Generate all the bitsets to be used in the parser or lexer Generate the raw bitset data like "long _tokenSet1_data[] = {...};" and the BitSet object declarations like "BitSet _tokenSet1 = new BitSet(_tokenSet1_data);" Note that most languages do not support object initialization inside a class definition, so other code-generators may have to separate the bitset declarations from the initializations (e.g., put the initializations in the generated constructor instead).protected voidGenerate the init action for a block, which may be a RuleBlock or a plain AlternativeBLock.protected voidGenerate the header for a block, which may be a RuleBlock or a plain AlternativeBLock.voidvoidvoidprotected voidGenerate a series of case statements that implement a BitSet test.genCommonBlock(AlternativeBlock blk, boolean noTestForSingle) Generate common code for a block of alternatives; return a postscript that needs to be generated at the end of the block.protected voidGenerate a header that is common to all CSharp filesvoidprotected voidprotected voidgenMatch(GrammarAtom atom) protected voidprotected voidvoidGenerate the nextToken() rule.voidgenRule(RuleSymbol s, boolean startSymbol, int ruleNum, TokenManager tm) Gen a named rule block.protected voidgenSemPred(String pred, int line) protected voidWrite an array of Strings which are the semantic predicate expressions.protected voidgenSynPred(SynPredBlock blk, String lookaheadExpr) protected voidvoidGenerate a static array containing the names of the tokens, indexed by the token type values.protected voidGenerate the token types CSharp fileGet a string for an expression to generate creation of an AST subtree.getASTCreateString(GrammarAtom atom, String astCtorArgs) Get a string for an expression to generate creating of an AST nodegetASTCreateString(String astCtorArgs) Returns a string expression that creates an AST node using the specified AST constructor argument string.protected StringgetBitsetName(int index) Given the index of a bitset in the bitset list, generate a unique name.protected StringgetLookaheadTestExpression(Alternative alt, int maxDepth) Generate a lookahead test expression for an alternate.protected StringgetLookaheadTestExpression(Lookahead[] look, int k) protected StringgetLookaheadTestTerm(int k, BitSet p) Generate a depth==1 lookahead test expression given the BitSet.getRangeExpression(int k, int[] elems) Return an expression for testing a contiguous renage of elementsHelper method that returns the name of the interface/class/enum type for token type constants.protected booleanlookaheadIsEmpty(Alternative alt, int maxDepth) Is the lookahead for this alt empty?mapTreeId(String idParam, ActionTransInfo transInfo) Map an identifier to it's corresponding tree-node variable.protected StringprocessActionForSpecialSymbols(String actionStr, int line, RuleBlock currentRule, ActionTransInfo tInfo) Lexically process tree-specifiers in the action.Process a string for an simple expression for use in xx/action.g it is used to cast simple tokens/references to the right type for the generated language.voidsetupOutput(String className) This method exists so a subclass, namely VAJCodeGenerator, can open the file in its own evil way.String[]Methods inherited from class antlr.CodeGenerator
_print, _printAction, _println, decodeLexerRuleName, elementsAreRange, encodeLexerRuleName, extractIdOfAction, extractIdOfAction, extractTypeOfAction, extractTypeOfAction, genTokenInterchange, getFIRSTBitSet, getFOLLOWBitSet, markBitsetForGen, print, printAction, println, printTabs, removeAssignmentFromDeclaration, reverseLexerRuleName, setAnalyzer, setBehavior, setGrammar, setTool
-
Field Details
-
syntacticPredLevel
protected int syntacticPredLevel -
genAST
protected boolean genAST -
saveText
protected boolean saveText -
usingCustomAST
boolean usingCustomAST -
labeledElementType
String labeledElementType -
labeledElementASTType
String labeledElementASTType -
labeledElementInit
String labeledElementInit -
commonExtraArgs
String commonExtraArgs -
commonExtraParams
String commonExtraParams -
commonLocalVars
String commonLocalVars -
lt1Value
String lt1Value -
exceptionThrown
String exceptionThrown -
throwNoViable
String throwNoViable -
currentRule
RuleBlock currentRule -
currentASTResult
String currentASTResult -
treeVariableMap
Hashtable treeVariableMapMapping between the ids used in the current alt, and the names of variables used to represent their AST values. -
declaredASTVariables
Hashtable declaredASTVariablesUsed to keep track of which AST variables have been defined in a rule (except for the #rule_name and #rule_name_in var's -
astVarNumber
int astVarNumber -
NONUNIQUE
Special value used to mark duplicate in treeVariableMap -
caseSizeThreshold
public static final int caseSizeThreshold- See Also:
-
saveIndexCreateLevel
int saveIndexCreateLevel -
blockNestingLevel
int blockNestingLevel
-
-
Constructor Details
-
CSharpCodeGenerator
public CSharpCodeGenerator()Create a CSharp code-generator using the given Grammar. The caller must still call setTool, setBehavior, and setAnalyzer before generating code.
-
-
Method Details
-
addSemPred
Adds a semantic predicate string to the sem pred vector These strings will be used to build an array of sem pred names when building a debugging parser. This method should only be called when the debug option is specified -
exitIfError
public void exitIfError() -
gen
public void gen()Generate the parser, lexer, treeparser, and token types in CSharp- Specified by:
genin classCodeGenerator
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
action- The {...} action to generateblk- The {...} action to generate
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
blk- The "x|y|z|..." block to generate
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
end- The block-end element to generate. Block-end elements are synthesized by the grammar parser to represent the end of a block.blk- The block-end element to generate. Block-end elements are synthesized by the grammar parser to represent the end of a block.
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
atom- The character literal reference to generateblk- The character literal reference to generate
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
r- The character-range reference to generateblk- The character-range reference to generate
-
gen
Generate the lexer CSharp file- Specified by:
genin classCodeGenerator- Throws:
IOException
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
blk- The (...)+ block to generate
-
gen
Generate the parser CSharp file- Specified by:
genin classCodeGenerator- Throws:
IOException
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
rr- The rule-reference to generateblk- The rule-reference to generate
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
atom- The string-literal reference to generateblk- The string-literal reference to generate
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
r- The token-range reference to generateblk- The token-range reference to generate
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
atom- The token-reference to generateblk- The token-reference to generate
-
gen
Description copied from class:CodeGeneratorGenerate code for the given grammar element.- Specified by:
genin classCodeGenerator
-
gen
Generate the tree-parser CSharp file- Specified by:
genin classCodeGenerator- Throws:
IOException
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
wc- The wildcard element to generate
-
gen
Generate code for the given grammar element.- Specified by:
genin classCodeGenerator- Parameters:
blk- The (...)* block to generate
-
genAlt
Generate an alternative.- Parameters:
alt- The alternative to generateblk- The block to which the alternative belongs
-
genBitsets
Generate all the bitsets to be used in the parser or lexer Generate the raw bitset data like "long _tokenSet1_data[] = {...};" and the BitSet object declarations like "BitSet _tokenSet1 = new BitSet(_tokenSet1_data);" Note that most languages do not support object initialization inside a class definition, so other code-generators may have to separate the bitset declarations from the initializations (e.g., put the initializations in the generated constructor instead).- Parameters:
bitsetList- The list of bitsets to generate.maxVocabulary- Ensure that each generated bitset can contain at least this value.
-
getBitsetName
Given the index of a bitset in the bitset list, generate a unique name. Specific code-generators may want to override this if the language does not allow '_' or numerals in identifiers.- Overrides:
getBitsetNamein classCodeGenerator- Parameters:
index- The index of the bitset in the bitset list.
-
genBlockInitAction
Generate the init action for a block, which may be a RuleBlock or a plain AlternativeBLock. -
genBlockPreamble
Generate the header for a block, which may be a RuleBlock or a plain AlternativeBLock. This generates any variable declarations and syntactic-predicate-testing variables. -
genBody
- Throws:
IOException
-
genInitFactory
-
genBody
- Throws:
IOException
-
genBody
- Throws:
IOException
-
genCases
Generate a series of case statements that implement a BitSet test.- Parameters:
p- The Bitset for which cases are to be generated
-
genCommonBlock
Generate common code for a block of alternatives; return a postscript that needs to be generated at the end of the block. Other routines may append else-clauses and such for error checking before the postfix is generated. If the grammar is a lexer, then generate alternatives in an order where alternatives requiring deeper lookahead are generated first, and EOF in the lookahead set reduces the depth of the lookahead. @param blk The block to generate @param noTestForSingle If true, then it does not generate a test for a single alternative. -
genASTDeclaration
-
genASTDeclaration
-
genASTDeclaration
-
genHeader
protected void genHeader()Generate a header that is common to all CSharp files -
genMatch
-
genMatch
-
genMatchUsingAtomText
-
genMatchUsingAtomTokenType
-
genNextToken
public void genNextToken()Generate the nextToken() rule. nextToken() is a synthetic lexer rule that is the implicit OR of all user-defined lexer rules. -
genRule
Gen a named rule block. ASTs are generated for each element of an alternative unless the rule or the alternative have a '!' modifier. If an alternative defeats the default tree construction, it must set_AST to the root of the returned AST. Each alternative that does automatic tree construction, builds up root and child list pointers in an ASTPair structure. A rule finishes by setting the returnAST variable from the ASTPair. - Parameters:
startSymbol- true if the rule is a start symbol (i.e., not referenced elsewhere)rule- The name of the rule to generate
-
genSemPred
-
genSemPredMap
protected void genSemPredMap()Write an array of Strings which are the semantic predicate expressions. The debugger will reference them by number only -
genSynPred
-
genTokenStrings
public void genTokenStrings()Generate a static array containing the names of the tokens, indexed by the token type values. This static array is used to format error messages so that the token identifers or literal strings are displayed instead of the token numbers. If a lexical rule has a paraphrase, use it rather than the token label. -
genTokenTypes
Generate the token types CSharp file- Throws:
IOException
-
genTokenDefinitions
- Throws:
IOException
-
processStringForASTConstructor
Process a string for an simple expression for use in xx/action.g it is used to cast simple tokens/references to the right type for the generated language. Basically called for every element in the vector to getASTCreateString(vector V)- Overrides:
processStringForASTConstructorin classCodeGenerator- Parameters:
str- A String.
-
getASTCreateString
Get a string for an expression to generate creation of an AST subtree.- Specified by:
getASTCreateStringin classCodeGenerator- Parameters:
v- A Vector of String, where each element is an expression in the target language yielding an AST node.
-
getASTCreateString
Get a string for an expression to generate creating of an AST node- Specified by:
getASTCreateStringin classCodeGenerator- Parameters:
atom- The grammar node for which you are creating the nodeastCtorArgs- The text of the arguments to the AST constructionstr- The arguments to the AST constructor
-
getASTCreateString
Returns a string expression that creates an AST node using the specified AST constructor argument string. Parses the first (possibly only) argument in the supplied AST ctor argument string to obtain the token type -- ctorID. IF the token type is a valid token symbol AND it has an associated AST node type AND this is not a #[ID, "T", "ASTType"] constructor THEN generate a call to factory.create(ID, Text, token.ASTNodeType()) #[ID, "T", "ASTType"] constructors are mapped to astFactory.create(ID, "T", "ASTType") The supported AST constructor forms are: #[ID] #[ID, "text"] #[ID, "text", ASTclassname] -- introduced in 2.7.2- Parameters:
astCtorArgs- The arguments to the AST constructor
-
getLookaheadTestExpression
-
getLookaheadTestExpression
Generate a lookahead test expression for an alternate. This will be a series of tests joined by 'invalid input: '&'invalid input: '&'' and enclosed by '()', the number of such tests being determined by the depth of the lookahead. -
getLookaheadTestTerm
Generate a depth==1 lookahead test expression given the BitSet. This may be one of: 1) a series of 'x==X||' tests 2) a range test using >= invalid input: '&'invalid input: '&' invalid input: '<'= where possible, 3) a bitset membership test for complex comparisons- Parameters:
k- The lookahead levelp- The lookahead set for level k
-
getRangeExpression
Return an expression for testing a contiguous renage of elements- Parameters:
k- The lookahead levelelems- The elements representing the set, usually from BitSet.toArray().- Returns:
- String containing test expression.
-
lookaheadIsEmpty
Is the lookahead for this alt empty? -
mapTreeId
Map an identifier to it's corresponding tree-node variable. This is context-sensitive, depending on the rule and alternative being generated- Specified by:
mapTreeIdin classCodeGenerator- Parameters:
idParam- The identifier name to map- Returns:
- The mapped id (which may be the same as the input), or null if the mapping is invalid due to duplicates
-
processActionForSpecialSymbols
protected String processActionForSpecialSymbols(String actionStr, int line, RuleBlock currentRule, ActionTransInfo tInfo) Lexically process tree-specifiers in the action. This will replace #id and #(...) with the appropriate function calls and/or variables.- Specified by:
processActionForSpecialSymbolsin classCodeGenerator
-
setupOutput
This method exists so a subclass, namely VAJCodeGenerator, can open the file in its own evil way. JavaCodeGenerator simply opens a text file...- Throws:
IOException
-
getTokenTypesClassName
Helper method that returns the name of the interface/class/enum type for token type constants. -
split
-