ENOfficial
Anas told that a man said, “Messenger of God, we were in an abode in which our numbers and our goods were many and changed to an abode in which our numbers and our goods have become few.” He replied, “Leave it, for it is reprehensible.” Abu Dawud transmitted it.
Source: sunnah.com
Other translations
Arabic
وَعَن أنس قَالَ: قَالَ رَجُلٌ: يَا رَسُولَ اللَّهِ إِنَّا كُنَّا فِي دَارٍ كَثُرَ فِيهَا عَدَدُنَا وَأَمْوَالُنَا فَتَحَوَّلْنَا إِلَى دَارٍ قَلَّ فِيهَا عَدَدُنَا وَأَمْوَالُنَا. فَقَالَ رَسُولُ اللَّهِ صَلَّى اللَّهُ عَلَيْهِ وَسَلَّمَ: «ذروها ذميمة» . رَوَاهُ أَبُو دَاوُد
sunnah.com