Is it possible to make so that people who are AFK wouldn't count towards rtv'ing or anything like that?

Either auto kick for x minutes of inactivity or just disable vote count.

tyvm