You reported some known problems.
The filtering is not based on the subject prefix Chat: ... to allow answers of any format from classic email clients. Instead, it is based on header meta-data, which should mostly work, except the missing filtering to show only specific chat-staring messages, instead of all received emails from the allowed contacts.
Would the linked method work to filter out those non-chat emails in your case to some degree?: