Brown dwarfs and very low-mass stars are likely to harbour planetary systems with rocky planets. We discuss the possibility of detecting them using accurate radial velocity measurements with a cross-dispersed high-resolution spectrograph coupled to a ground-based extremely large telescope.