1Text::Template::Simple:U:sTeorkeCnoinzterri(b3u)ted PerlTeDxotc:u:mTeenmtpaltaitoen::Simple::Tokenizer(3)
2
3
4
6 Text::Template::Simple::Tokenizer
7
9 version 0.91
10
12 use strict;
13 use warnings;
14 use Text::Template::Simple::Constants qw( :token );
15 use Text::Template::Simple::Tokenizer;
16 my $t = Text::Template::Simple::Tokenizer->new( $start_delim, $end_delim );
17 foreach my $token ( @{ $t->tokenize( $raw_data ) } ) {
18 printf "Token type: %s\n", $token->[TOKEN_ID];
19 printf "Token data: %s\n", $token->[TOKEN_STR];
20 }
21
23 Splits the input into tokens with the defined delimiter pair.
24
26 Text::Template::Simple::Tokenizer - "Tokenizer"
27
29 new
30 The object constructor. Accepts two parameters in this order:
31 "start_delimiter" and "end_delimiter".
32
33 "tokenize"
34 Splits the input into tokens with the supplied delimiter pair. Accepts
35 a single parameter: the raw template string.
36
37 ESCAPE METHODS
38 tilde
39 Escapes the tilde character.
40
41 quote
42
43 Escapes double quotes.
44
46 Burak Gursoy <burak@cpan.org>
47
49 This software is copyright (c) 2004 by Burak Gursoy.
50
51 This is free software; you can redistribute it and/or modify it under
52 the same terms as the Perl 5 programming language system itself.
53
54
55
56perl v5.28.1 2018-12-2T5ext::Template::Simple::Tokenizer(3)