Although football had been played in the village from the turn of the century, North Ferriby United were not formally formed until 1934. They first took part in the local East Riding Church League and in 1938 won the Division One title.

After the Second World War the club were admitted to the East Riding Amateur League. The immediate post-war years proved to be very successful with the highlight being an appearance in the final qualifying round of the F.A. Amateur Cup during the 1949/50 campaign.

In 1969 North Ferriby joined Division Two of the Yorkshire League and the following season they captured the championship and also lifted the East Riding Senior Cup. 1975 saw them win the Yorkshire League Cup defeating Lincoln United 2-0 and twelve months later they finished runners up to Emley in Division One. The 1970s were a positive period for the club and saw them win the East Riding Senior Cup three times.

The 1980/81 season was indeed a momentous one. They reached the lofty heights of the F.A. Cup Third Qualifying Round, losing away to Boston United.

In 1982 they joined the newly formed Northern Counties East League, finishing runners-up in Division One North. Promotion to the Premier Division was offered but had to be declined because the ground facilities were not up to the required standard.

The 1985/86 season saw the villagers take the Division One title and this time they were promoted. They also reached the Fourth Round Proper of the F.A. Vase and the following year went out in the Fifth Round to Farsley Celtic by 2-1.

Three seasons later national recognition came to Ferriby when they advanced to the semi-final of the F.A. Vase, losing to Tamworth after just shading the first leg at Tamworth 2-1.

In 1991 United won the inaugural President's Cup, defeating the F.A. Vase winners Guiseley 8-5 on aggregate. They also lifted the East Riding Senior Cup for the first time in twelve years and in the League Cup Final they lost 1-0 to Guiseley.

1996/97 saw the villagers achieve the ambition of every English Club with an appearance at Wembley Stadium. A 3-1 aggregate victory over Guisborough Town in the semi-final saw them through to the F.A. Carlsberg Vase Final on Saturday 19th May 1997. A 3-0 defeat by Whitby Town only partially marred their great day and their name is now proudly entered in the record books.

The next two seasons saw Ferriby only a whisker away from promotion to the Unibond League, but in the 1999/2000 millennium season they won the Northern Counties East League Championship and achieved their long term goal of promotion.

The first season in the Unibond League was a satisfactory start at that level with a respectable 13th place finish. Season 2001/02 saw the club's progression continue with an 11th place finish. The campaign finished on another high as the club retained the East Riding Senior Cup for a sixth year in succession, thus equalling the all-time record held by Hull City in a period which straddled the Second World War.

The following season saw more progress, gaining a place in the promotion play-offs via a fourth place finish. Although the promotion push floundered on a tense evening at Radcliffe, that disappointment was assuaged by the club taking the outright record from Hull City with a seventh successive East Riding Senior Cup triumph.

Season 2003/04 wasn't a kind one with the side finishing in 17th place and ending the campaign without a trophy for the first time in nine years.

The 70th Anniversary Season 2004/05 proved to be one of the most rewarding in the club's history as the villagers clinched the Unibond League First Division Championship on the final day of the season at Mossley. The side led the division from early October and never relinquished their grip on top spot.

Season 2005/06 saw the club at the highest level in their history as they entered the Unibond Premier Division and led the table from the off until March. Despite missing out on automatic promotion, the club came close to joining Champions Blyth Spartans in the Conference North as they secured a place in the promotion play-offs thanks to a fifth place finish. They defeated third placed Frickley Athletic away from home before losing the final by the odd goal in three at Farsley Celtic after extra time.

In season 2006/07 the Club won the East Riding Senior Cup for the thirteenth time in their history, defeating Bridlington Town 1-0 in the KC Stadium.

North Ferriby successfully defended the East Riding Senior Cup in season 2007/08 with a 4-1 victory over Hall Road Rangers and again in 2008/09, overcoming Bridlington Town 3-1.

The club enjoyed a superb season in 2009/10, finishing 4th in the Unibond Premier Division, their highest ever position. Dreams of promotion to the Blue Square North were shattered however, when the villages went down 2-1 to Boston United in the play-off semi final. But silverware was forthcoming when the East Riding Senior Cup was retained following a 3-2 victory over Bridlington Town at the KC Stadium.

2010-11 saw the surprise and unexpected departure of manager Neil Allison who emigrated with his family to Australia. The Club had no hesitation in appointing his assistant John Anderson to the manager's role and he went on to lead The Villagers to a second successive play-off semi final, only to be denied 0-2 at Colwyn Bay. But Hall Road Rangers were beaten in the final of the East Riding Senior Cup as Ferriby retained the cup 3-1 in the KC Stadium.

A poor start to the 2011-12 season saw the resignation of John Anderson. The current managerial team of Billy Heath and Mark Carroll was appointed in October 2011 following the resignation of John Anderson. Heath and Carroll turned round the team's performances and the side eventually finished ninth on the Evostik Premier division. The Club won its first cup at this level, beating Rushall 4-1 in the Doodson Sport League Cup.

The 2012-13 season was the most successful in the Club's history. The side completed the League and Cup double and won the East Riding Senior Cup. Coincidentally, the side emulated the 2004-05 performance of leading the table from early October to the end of the season.

The team also equalled a long-standing Premier Division record by winning 16 away games. Ferriby became only the third team to retain the League Cup and the fifth to complete the NPL Title and Cup double.

The Villagers inaugural season in Conference North was truly remarkable. Having finished runners up, missing out on promotion on the last day, they also enjoyed excellent runs in the FA Cup and FA Trophy before ultimately signing off with another Senior Cup victory.

The 2014-15 season will go down as probably the most momentous in the Club’s history. The team reached the FA Cup Fourth Round Qualifying but this run was eclipsed by winning the FA Trophy at Wembley.

The Villagers staged a remarkable comeback from two goals down against Conference National side Wrexham to take the game to extra-time. Ferriby took the lead before Wrexham scored a late equaliser to take the game to penalties. Goalkeeper Adam Nicklin saved three of Wrexham’s six penalties as The Villagers triumphed 5-4.

The side finished mid-table in the Vanarama Conference North, largely due to too many drawn games and fixture congestion towards the end of the season.