the Lucene query itself: read the literature on this subject

the number of object loaded: use pagination (always ;-) ) or index projection (if needed)

the way Hibernate Search interacts with the Lucene readers: defines the appropriate Reader strategy.