You can check on openstreetmap.org whether the data is on OSM at all. If it isn't, you can add it yourself, there are many ways to edit OSM and tutorials where you can learn it. The specific documentation for address keys is here: https://wiki.openstreetmap.org/wiki/Key:addr:*
In general, OsmAnd definitely does support searching for house numbers if they are correctly mapped in OSM. I've done it many times and tried it out just now too. So if it can't find any house numbers in the area you're looking at, that probably means they are just not on the map yet. OSM is and will always be a work in progress.