pub fn next(self: *Self) ?[]const T
Returns a slice of the current token, or null if tokenization is complete, and advances to the next token.
self: *Self
3340 3341 3342 3343 3344
pub fn next(self: *Self) ?[]const T { const result = self.peek() orelse return null; self.index += result.len; return result; }
Returns a slice of the current token, or null if tokenization is complete, and advances to the next token.