Digvijay Singh said that Narendra Modi's remark was not just limited to Shashi Tharoor and his wife, but it was an attack on all women.