According to today's Daily Telegraph that is exactly what he intends to do.
The Conservatives are to order a radical reduction in the size of Government, which will see a smaller Cabinet and the number of ministers across Whitehall cut...Despite presiding over a Shadow Cabinet of 32, Mr Cameron believes his Cabinet needs to be smaller. The full Cabinet is likely to be closer to 20 with far fewer able to attend.All this will apparently become clear in a speech George Osborne is making later today. I couldn't be more delighted.
Decision-making is more difficult in such a large group, many Tory reformers believe and they are urging Mr Cameron to be bold in his push to streamline government.
In total there are 119 ministers and whips on the Government payroll. It is understood that Mr Cameron will look to try and get the number close to 100.
He has said he wants to make parliament smaller “by having fewer ministers.”