You can improve the performance of the Partner Ledger report by adjusting the Prefix Groups Threshold:

(increase the number from the default 4,000 to a higher number until you get acceptable performance)
In Developer Mode, visit Accounting --> Configuration --> Accounting --> Financial Reports and open the Partner Ledger report from there.