public class PythonTokenMarker extends TokenMarker
TokenMarker.LineInfocurrentTokenOffset, firstToken, lastLine, lastToken, length, lineIndex, lineInfo, nextLineRequested, offsetGap, PAT_EMPTY, syntaxListener| Constructor and Description | 
|---|
PythonTokenMarker()  | 
| Modifier and Type | Method and Description | 
|---|---|
static KeywordMap | 
getKeywords()  | 
protected byte | 
markTokensImpl(byte token,
              javax.swing.text.Segment line,
              int lineIndex,
              boolean externalTokenizer)
Splits a line up into tokens. 
 | 
addToken, deleteLines, ensureCapacity, getLineCount, getLineIndex, getLineOffsetString, getMaxLineWidth, getOffsetGap, getSyntaxListener, insertLines, isNextLineRequested, markTokens, markTokens, setLineWidth, setOffsetGap, setSyntaxListener, supportsMultilineTokensprotected byte markTokensImpl(byte token,
                              javax.swing.text.Segment line,
                              int lineIndex,
                              boolean externalTokenizer)
markTokensImpl in class TokenMarkertoken - The initial token type for this lineline - The line to be tokenizedlineIndex - The index of the line in the document, starting at 0externalTokenizer - true for an external tokenizerpublic static KeywordMap getKeywords()
Copyright © 2016, 2017, 2018, 2019, 2023, 2025 Herve Girod. All Rights Reserved. Documentation and source under the MIT licence