The Wings chairman - who used to be in charge at Bromley - will be more hands-on next season.
The club parted with manager Steve King on Friday. Coach Garry Fiore will assist Goldberg going forward.
Goldberg's son Bradley plays as a striker for the National League South club, who lost the Promotion Final to Woking last month.
“We need to work with a budget that is more sustainable than that with which we operated with last year and does not put the club at risk,” he explained.
“Following Steve King’s departure we have looked at a number of options but feel that at this moment in time it is prudent to make better use of the resources available to us within the club’s hierarchy.
“With this in mind we have made the decision to appoint Garry Fiore as Director of Football to work closely with me so I can assume more of the football team management responsibilities whilst I still remain as chairman.
“Garry and I will work together with my newly appointed coaching staff to take on the responsibility of player recruitment and the coaching of the first team and most importantly to help bring through the great young talent that is currently being developed by our thriving Scholarship and Youth Academy programme.
“We are also welcoming back to the club Hugo Langton as first team coach and ex-Welling coaches Paul Barnes and Osei Sankofa as assistant coaches”