Overview > klyn.code > CodeTokenizer > CodeTokenizer
Version 0.2.1 Overview Index Tree Deprecated
klyn.code.CodeTokenizer.CodeTokenizer
constructor
public CodeTokenizer(languageProfile as LanguageProfile)
Description

Constructs a CodeTokenizer driven by the given LanguageProfile.

Parameters
ParameterDescription
languageProfileDeclarative language profile.
Example
import klyn.code

tokenizer = CodeTokenizer(LanguageProfile("c", "C").withLineComments(["//"]))