The wholesale used-vehicle auction landscape is transforming as the business grapples with a major digital shift, new competitors, defecting dealer customers, shrinking vehicle inventories and big moves by leading players.