Comments are supported in filter file, although the syntax of the filter file is not very clear. I had to look up in the source code (https://github.com/tinyproxy/tinyproxy/blob/master/src/filter.c#L82-L99) to convince myself.
I suggest adding a comment example in the filter file entries, to make it clear for everyone.