A few notes on “Towards a mathematical theory of meaningful communication” It starts from Shannon’s information theory and examines its rôle in biology.
More generally

II A 1 (Page 3)
This development is rather like an interpretation of a formal language in the predicate calculus wherein a set of objects is identified, a set of predicates, a table of which predicates are true of which tuples of objects and a map of object constants (in the language) to the objects. In that field no probabilities are considered. The language of the paper seems to consist only of nouns and digraph statistics between them.

I think that the paper studies the ability to convey designations thru a noisy channel where there is some mutually known digraph statistics in the intended designations.