trtokens 0.20.25

There is a newer version of this package available.
See the version list below for details.
dotnet tool install --global trtokens --version 0.20.25                
This package contains a .NET tool you can call from the shell/command line.
dotnet new tool-manifest # if you are setting up this repo
dotnet tool install --local trtokens --version 0.20.25                
This package contains a .NET tool you can call from the shell/command line.
#tool dotnet:?package=trtokens&version=0.20.25                
nuke :add-package trtokens --version 0.20.25                

trtokens

Summary

Print tokens in a parse tree

Description

The trtokens command reads standard in for a parsing result set and prints out the tokens for each result. For each tree in a set, the first and last tokens for the tree are computed and printed, with a blank line separator.

Usage

trtokens

Examples

Input:

Assume the Arithmetic.g4 parser has been built.

Command:

trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens

Output:

Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]

[@0,0:0='1',<2>,1:0]

[@8,8:8='3',<2>,1:8]

[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]

[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]

Current version

0.20.25 Updates to trgen. NB: not all Trash tools supported yet.

Product Compatible and additional computed target framework versions.
.NET net7.0 is compatible.  net7.0-android was computed.  net7.0-ios was computed.  net7.0-maccatalyst was computed.  net7.0-macos was computed.  net7.0-tvos was computed.  net7.0-windows was computed.  net8.0 was computed.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed.  net9.0 was computed.  net9.0-android was computed.  net9.0-browser was computed.  net9.0-ios was computed.  net9.0-maccatalyst was computed.  net9.0-macos was computed.  net9.0-tvos was computed.  net9.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

This package has no dependencies.

Version Downloads Last updated
0.23.11 1,135 12/18/2024
0.23.10 96 12/12/2024
0.23.9 105 11/29/2024
0.23.8 140 11/1/2024
0.23.7 4,216 10/9/2024
0.23.6 750 9/21/2024
0.23.5 124 9/15/2024
0.23.4 118 9/7/2024
0.23.3 143 8/15/2024
0.23.2 144 6/28/2024
0.23.1 135 6/22/2024
0.23.0 211 4/25/2024
0.22.0 259 2/26/2024
0.21.16 286 11/16/2023
0.21.15 227 11/16/2023
0.21.14 157 11/15/2023
0.21.13 192 11/14/2023
0.21.12 304 10/27/2023
0.21.11 319 10/24/2023
0.21.9 387 9/27/2023
0.21.8 272 9/26/2023
0.21.7 359 9/26/2023
0.21.6 250 9/20/2023
0.21.5 263 9/18/2023
0.21.4 244 9/17/2023
0.21.3 239 9/14/2023
0.21.2 246 9/4/2023
0.21.1 390 8/15/2023
0.21.0 288 6/25/2023
0.20.27 271 6/15/2023
0.20.26 259 6/5/2023
0.20.25 283 6/3/2023
0.20.24 204 6/1/2023
0.20.23 221 5/31/2023
0.20.22 227 5/21/2023
0.20.21 254 5/15/2023
0.20.20 226 5/11/2023
0.20.19 218 5/8/2023
0.20.18 280 5/8/2023
0.20.17 285 5/4/2023
0.20.16 243 5/1/2023
0.20.15 265 4/27/2023
0.20.14 315 4/21/2023
0.20.13 285 4/13/2023
0.20.12 375 3/17/2023
0.20.11 362 3/15/2023
0.20.10 349 3/15/2023
0.20.9 361 3/14/2023
0.20.8 341 3/14/2023
0.20.7 358 3/13/2023
0.20.6 390 3/11/2023
0.20.5 378 3/11/2023
0.20.4 348 3/9/2023
0.20.3 357 3/8/2023
0.20.2 340 3/7/2023
0.20.1 374 3/7/2023
0.20.0 423 2/22/2023
0.19.3 429 2/19/2023
0.19.2 425 2/2/2023
0.19.1 433 1/28/2023
0.19.0 468 1/15/2023
0.19.0-alpha7 397 1/15/2023
0.19.0-alpha6 279 1/14/2023
0.19.0-alpha5 308 1/12/2023
0.19.0-alpha4 332 1/11/2023
0.19.0-alpha3 414 1/5/2023
0.19.0-alpha2 328 1/4/2023
0.19.0-alpha1 338 1/4/2023
0.18.1 557 11/11/2022
0.18.0 462 11/7/2022
0.17.0 522 9/11/2022
0.16.5 595 7/29/2022
0.16.4 586 6/13/2022
0.16.3 629 5/7/2022
0.16.2 554 5/6/2022
0.16.1 567 5/5/2022
0.16.0 652 4/13/2022
0.15.1 640 4/4/2022
0.15.0 557 3/20/2022
0.14.3 636 2/27/2022
0.14.2 557 2/18/2022
0.14.1 549 1/26/2022
0.14.0 578 1/26/2022
0.13.8 586 1/14/2022
0.13.7 576 1/13/2022
0.13.6 591 1/13/2022
0.13.5 588 1/12/2022
0.13.4 583 1/11/2022
0.13.3 589 1/10/2022
0.13.2 393 12/24/2021
0.13.1 437 12/24/2021
0.13.0 452 12/23/2021
0.12.0 467 12/6/2021
0.11.5 522 10/17/2021
0.11.4 446 10/17/2021
0.11.3 432 9/28/2021
0.11.2 461 9/26/2021
0.11.1 503 9/25/2021
0.11.0 489 9/24/2021
0.10.0 491 9/9/2021
0.8.9 411 8/13/2021
0.8.8 421 8/5/2021
0.8.7 432 7/20/2021
0.8.6 447 7/13/2021
0.8.5 435 7/6/2021
0.8.4 418 6/24/2021
0.8.3 501 6/13/2021
0.8.2 494 6/8/2021
0.8.1 452 6/2/2021
0.8.0 524 5/27/2021
0.7.0 426 5/10/2021
0.6.0 442 5/3/2021
0.5.5 424 4/22/2021
0.5.0 457 4/14/2021

# trtokens
## Summary
Print tokens in a parse tree
## Description
The trtokens command reads standard in for a parsing result set and prints out
the tokens for each result. For each tree in a set, the first and last tokens
for the tree are computed and printed, with a blank line separator.
## Usage
trtokens
## Examples
Input:
Assume the Arithmetic.g4 parser has been built.
Command:
trparse -i "1 * 2 + 3" | trxgrep " //expression" | trtokens
Output:
Time to parse: 00:00:00.0778212
# tokens per sec = 128.49968903075256
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@8,8:8='3',<2>,1:8]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@0,0:0='1',<2>,1:0]
[@1,1:1=' ',<15>,channel=1,1:1]
[@2,2:2='*',<7>,1:2]
[@3,3:3=' ',<15>,channel=1,1:3]
[@4,4:4='2',<2>,1:4]
[@5,5:5=' ',<15>,channel=1,1:5]
[@6,6:6='+',<5>,1:6]
[@7,7:7=' ',<15>,channel=1,1:7]
[@8,8:8='3',<2>,1:8]
## Current version
0.20.25 Updates to trgen. NB: not all Trash tools supported yet.