La Grange officials rejected a special use permit for a medical services company to operate at ground level in the downtown business district.