Module mouth 

The mouth is a thin interface over a file, responsible for reading characters and associating them with catcodes

Structs

Mouth

MouthOptions

Enums

FoodType

Functions

decode_input_bytes

Decode raw input bytes as text when no encoding has been declared: valid UTF-8 is taken as-is, anything else is a Latin-1 passthrough (byte → char).

tokenize

Tokenize a string under the standard catcode table — Perl Package.pm:Tokenize L1019-1023.

tokenize_bib_literal

Tokenize a string under the standard catcode table, reading % & # as ordinary characters rather than comment, alignment tab and parameter.

tokenize_internal

Tokenize a string under the style-file catcode table — Perl Package.pm:TokenizeInternal L1026-1030.