In a night where the National League was showered with 53 goals, there was a goal-fest at Arbour Park.
But unfortunately for Slough Town, it was their visitors Concord Rangers who progressed.
Warren Harris hit a double for the Rebels but goals from Kreshnic Krasniqi and Danny Green saw the Beachboys through.
King's Lynn Town piled on the misery for Hereford with a comfortable 3-0 win at Edgar Street - Ross Barrows and Alex Street had the Linnets two-up in the first ten minutes before Sonny Carey added another late on.
Dean Inman came back to haunt former club Billericay Town as Hampton & Richmond squeezed through.
Inman opened the scoring before Jake Robinson's leveller. Tom Lewthwaite settled things after 84 minutes.
Maidstone took the Kent bragging rights after seeing off Dartford courtesy of Iffy Allen's goal on the hour mark.
Dulwich Hamlet continued their fine form on the road with a 2-1 win over National League South counterparts Chippenham Town.
Danny Mills had the visitors ahead. Curtis McDonald pegged them back - but David Ijaha had the final say.
Elsewhere, Oxford City bowed out on penalties after an eight-goal thriller with Hornchurch in extra time.
Elliot Benyon had City ahead twice before their hosts forced an extra 30 minutes. City were then twice behind but goals from Josh Ashby and Stefan Brown forced a shootout.
Tuesday's FA Trophy final scores:
Billericay Town 1-2 Hampton & Richmond Borough
Chippenham Town 1-2 Dulwich Hamlet
Dartford 0-1 Maidstone
Hereford 0-3 King's Lynn Town
Hornchurch 4-4 Oxford City AET (Hornchurch win 4-1 on penalties)
Slough Town 2-3 Concord Rangers
Reminder of FA Trophy First Round draw:
Tonbridge Angels v Hampton & Richmond Borough
Hornchurch v Dulwich Hamlet
Maidstone v Concord Rangers
For the full FA Trophy First Round draw click here.