1Text::Template::Simple:U:sTeorkeCnoinzterri(b3u)ted PerlTeDxotc:u:mTeenmtpaltaitoen::Simple::Tokenizer(3)
2
3
4
6 Text::Template::Simple::Tokenizer - "Tokenizer"
7
9 use strict;
10 use warnings;
11 use Text::Template::Simple::Constants qw( :token );
12 use Text::Template::Simple::Tokenizer;
13 my $t = Text::Template::Simple::Tokenizer->new( $start_delim, $end_delim );
14 foreach my $token ( @{ $t->tokenize( $raw_data ) } ) {
15 printf "Token type: %s\n", $token->[TOKEN_ID];
16 printf "Token data: %s\n", $token->[TOKEN_STR];
17 }
18
20 This document describes version 0.90 of
21 "Text::Template::Simple::Tokenizer" released on "5 July 2016".
22
23 Splits the input into tokens with the defined delimiter pair.
24
26 new
27 The object constructor. Accepts two parameters in this order:
28 "start_delimiter" and "end_delimiter".
29
30 "tokenize"
31 Splits the input into tokens with the supplied delimiter pair. Accepts
32 a single parameter: the raw template string.
33
34 ESCAPE METHODS
35 tilde
36 Escapes the tilde character.
37
38 quote
39
40 Escapes double quotes.
41
43 Burak Gursoy <burak@cpan.org>.
44
46 Copyright 2004 - 2016 Burak Gursoy. All rights reserved.
47
49 This library is free software; you can redistribute it and/or modify it
50 under the same terms as Perl itself, either Perl version 5.24.0 or, at
51 your option, any later version of Perl 5 you may have available.
52
53
54
55perl v5.28.0 2018-07-1T5ext::Template::Simple::Tokenizer(3)