Justice Secretary David Lammy said a new system of “swift courts” could deal with cases a fifth faster than jury trials.
He added the move was necessary as current projections suggested case loads will reach 100,000 by 2028.
Announcing the criminal court reform in the Commons, Mr Lammy said: “Investment is not enough.
“I will create new swift courts within the crown court with a judge alone deciding verdicts in trial of either way cases with a likely sentence of three years or less as Sir Brian (Leveson) recommends.
“Sir Brian estimates that they will deliver justice at least 20% faster than jury trials, and whilst jury deliberations remain confidential, judges provide reasoning for their verdicts in open courts, so this will hardwire transparency in our new approach.”
A defendant’s right to a jury trial will be restricted to prevent them from “gaming the system”, Mr Lammy added.
In a statement to the Commons, Mr Lammy, who is also the Deputy Prime Minister, said: “Sir Brian also proposes restricting defendants’ right to elect for jury trials, a practice not found widely in other common law jurisdictions. And, let’s be honest, it’s a peculiar way to run a public service.
“Our world-leading judges should hear the most serious cases and I agree that they and the magistrate should decide where a case is heard. This will prevent defendants from gaming the system, choosing whichever court they think gives the best chance of success, and drawing out the process, hoping victims give up.
“I will limit appeals from the magistrates’ court so that they are only allowed on points of law to prevent justice being delayed further.
“Alongside these changes, we will increase magistrates’ court sentencing powers to 18 months, so they can take a greater proportion of lower level offending and relieve pressure on the Crown Court.
“I would also take power to extend that to two years, should it become necessary to leave further pressure. And when it comes to exceptionally technical and lengthy fraud and financial trials, judges will be able to sit without a jury where appropriate.”
