Room context is the first filter
A displaced item can start far from its home, so its current location is weak evidence. Ask where that object normally belongs, then compare the destination's existing sets. Cups and plates point toward dining or kitchen context; office objects point toward desks and shelves. Use visible game cues over real-house assumptions when they disagree.