Smallness of numbers is not an issue

O ye believers of God! Be not concerned with the smallness of your numbers, neither be oppressed by the multitude of an unbelieving world. Five grains of wheat will be endued with heavenly blessing, whereas a thousand tons of tares will yield no results or effect. One fruitful tree will be conducive to the life of society, whereas a thousand forests of wild trees offer no fruits. The plain is covered with pebbles, but precious stones are rare. One pearl is better than a thousand wildernesses of sand...

- Abdul Baha

http://bahai-library.com/compilation_guidelines_teaching