Overview > klyn.code.vb > VbTokenizer
Version 0.2.1 Overview Index Tree Deprecated
VbTokenizer
classin packageklyn.code.vb
public class VbTokenizer extends CodeTokenizer
Object
└ CodeTokenizer
└ VbTokenizer

Specialized CodeTokenizer for Visual Basic / VB.NET source files (.vb, .bas, .vbs).

Handles case-insensitive keyword and type matching, ' and REM single-line comments, and "" doubled-quote string literals.

import klyn.code
import klyn.code.vb

tokenizer = VbTokenizer()
res = tokenizer.tokenizeLine("Public Function Total(x As Integer) As Integer ' comment")
assert res.spans[0].kind == TokenKind.KEYWORD
Inherited Properties
propertyInherited Properties from Object: type
Constructors
Modifier and Type Member Description
public VbTokenizer
VbTokenizer()
 Constructs a VbTokenizer configured with VbLanguage.profile().
Inherited Methods
methodInherited Methods from CodeTokenizer: appendLiteralSpans, classifyIdentifier, collectIdentifiers, identifierAt, identifierPrefixAt, isAsciiAlpha, isAsciiDigit, isCodePosition, isCodePositionInSource, isEscapedAt, isHexDigit, isIdentPart, isIdentStart, isNumberStart, isOperatorChar, isPreprocessorLine, isPunctuationChar, isValidIdentifier, isValidIdentifier, lineCommentAt, literalDelimiterAt, nextLineState, profile, renameIdentifier, scanEscapeEnd, scanNumberEnd, startsWithAt, startsWithIgnoreCaseAt, stringDelimiterAt, stringPrefixAt, stripLineComments, tokenize, tokenizeLine
methodInherited Methods from Object: deepCopy, fromJson, hash, toDict, toJson, toMap, toString, toXml