Area: I supposed a 5x5 meters room is the minimum for dwelling and smaller shapes are closer and closer to pixel size, hence prone to errors: do we prefer more huts with higher false positive ratio? Of course the local community contribution is important, particularly on these issues.
Confidence: I took this suggestion that seems to me reasonable; if we had human resources that can check data quality broadly, I would drop this filter.
Anyway I think going for with relatively large and reliable objects could be a starting point: if needed, later you can populate further, following the same procedure.