While scientometrics is now an established field, there are challenges. A closer look at how scientometricians aggregate building blocks into artfully made products, and point-represent these (e.g. as the map of field X) allows one to overcome the dependence on judgements of scientists for validation, and replace or complement these with intrinsic validation, based on quality checks of the several steps. Such quality checks require qualitative analysis of the domains being studied. Qualitative analysis is also necessary when noninstitutionalized domains and/or domains which do not emphasize texts are to be studied. A further challenge is to reflect on the effects of scientometrics on the development of science; indicators could lead to ‘induced’ aggregation. The availability of scientometric tools and insights might allow scientists and science to become more reflexive.