Let's assume we've got something like this:
populations <- factor(c("A", "A", "B", "B", "C", "C"))
design <- model.matrix(~ populations)
colnames(design) <- c("Intercept", "B", "C")
The intercept represents the log-expression level of group A, while coefficients B and C represent the log-fold change of groups B and C over A, respectively.
Now, imagine that we want to test for DE between A and the others. For the first proposal, I assume that when you say "crossing" the lists, you want to intersect the results of A versus B with the results of A versus C. This will give you the genes that are significantly DE in both comparisons, though it is a rather conservative operation (i.e., the true FDR is probably much lower than the nominal threshold at which you defined the DE genes in each comparison). Also, you don't control for the direction of DE, though this can be easily fixed by only intersecting genes that have the same sign of the log-fold change.
For the second proposal, you can do this using the same design matrix. Just define a contrast like so:
con <- makeContrasts((B+C)/2, levels=design)
This can be passed to glmLRT via the contrast=
argument. It will then test for whether the expression in A is equal to the average expression across B and C. Thus, A can be compared to the other two groups. However, this will not work in all cases where there is DE between A and the other groups. For example, if B is upregulated relative to A, while C is downregulated relative to A, the average of B and C may be equal to A such that the contrast fails to reject the null hypothesis. The contrast may also reject where there is not DE between A and both other groups, e.g., if B is DE relative to A but C is not, the average of B and C will still be different from A. This may not be desirable if you only want genes that are DE between A and both groups.
For the final proposal, dropping the last two coefficients will test for significant differences between any of the groups. This means that the null may be rejected if there is DE between A and only one of the other groups.
So, in short, your choice depends on what you're willing to consider as DE between one population and the others. If you want to enforce DE between the chosen population and each of the others, then use approach 1. If you're willing to take DE between the chosen population and any of the other groups, then use approach 3. The second approach sits somewhere in the middle.