I was right, the answer was "parallel requests". lots of them.
old efficiency: 700% time compression, processing 14 batches per hour (8 in parallel)
new efficiency: 2200% time compression, processing 26 batches per hour (24 in parallel)
I haven't yet worked out how the percentages actually relate to the amount processed.
But it sure looks good on paper screen.
6,916 of 100,000 processed so far
3580 hours left = 150 days left. much better than 950
only 11 days of work done so far? that's got to be wrong. - or this new efficiency is much better than i thought.
i just checked, my actual logged processing time only adds up to 40 days anyway. that's 7/hr (averaged)
so 300% is more accurate.
time compression is all well and good, but it's the volume of work done in that time that really matters, there has to be a drop-off point eventually.
i'll try for 5000% tomorrow.