tokenize {styler}R Documentation

Obtain token table from text

Description

utils::getParseData() is used to obtain a flat parse table from text.

Usage

tokenize(text)

Arguments

text

A character vector.

Details

Apart from the columns provided by utils::getParseData(), the following columns are added:

Value

A flat parse table


[Package styler version 1.2.0 Index]