Residential Whole Loans - Net Gain/(Loss) on Residential Whole Loans Measured at Fair Value (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2025	Jun. 30, 2024	Jun. 30, 2025	Jun. 30, 2024
Accounts, Notes, Loans and Financing Receivable [Line Items]
Net gain/(loss) on residential whole loans measured at fair value through earnings	$ 33,611	$ 16,430	$ 87,991	$ 4,917
Residential whole loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Net gain/(loss) on residential whole loans measured at fair value through earnings	33,611	16,430	87,991	4,917
Residential whole loans \| Non-QM loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Net gain/(loss) on residential whole loans measured at fair value through earnings	28,122	32,107	73,318	29,569
Residential whole loans \| Business purpose loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Net gain/(loss) on residential whole loans measured at fair value through earnings	6,070	(11,474)	12,818	(13,587)
Residential whole loans \| Business purpose loans \| Single-family rental loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Net gain/(loss) on residential whole loans measured at fair value through earnings	11,178	18,442	29,010	17,607
Residential whole loans \| Business purpose loans \| Single-family transitional loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Net gain/(loss) on residential whole loans measured at fair value through earnings	(5,568)	(5,413)	(14,717)	(4,121)
Residential whole loans \| Business purpose loans \| Multifamily transitional loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Net gain/(loss) on residential whole loans measured at fair value through earnings	460	(24,503)	(1,475)	(27,073)
Residential whole loans \| Legacy RPL/NPL loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Net gain/(loss) on residential whole loans measured at fair value through earnings	(834)	(3,621)	114	(9,921)
Residential whole loans \| Other loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Net gain/(loss) on residential whole loans measured at fair value through earnings	$ 253	$ (582)	$ 1,741	$ (1,144)