“I think you have to be very, very careful about speculation,” Dr. Priya Banerjee tells PEOPLE ...