Similar Items: Reflecting on Pre-Training Exercise