Of course it matters. A new network will have to start from scratch and with the “nobody is there, so I won’t join”-mentality, potential growth is severely limited. By implementing federation, you will instantly have a base community to build on.