Neighbours have objected to plans for the new structure in Conwy after the last one was taken down.