On the Fireside Fedi interview with Jerry ( the admin of Infosec.Exchange Mastodon instance ) a scary truth was suddenly revealed ( on 34:11 ): Just to keep the instance up and running he needs to spend up to $5000 a month, pretty much out of his pocket. Donations to the instance barely cover any of that. And if he will ask people to pay to use it, they will, rightfully so, switch to a different instance.

@blenderdumbass just to be clear, it was out of my pocket at one point, but the costs have been covered by donations for a long time now. Sorry if I didn’t make that clear on the show.

I think the donation model is working ok at this scale, but I don’t believe it will scale up to the hypothetical future we were discussing on the show where the fediverse became the social media platform for the masses.

Are there any places where there is a detailed report people can look at, explaining all the various numbers related to the money problem of your instances? If there isn't: How much you get from donations? How much you pay for each of the instances? How many people are on each of the instances? And what exactly are you paying for? Is it hosting? It is processing power? What is it that is so expensive?

I don’t use separate servers for the various instances, so I don’t have a breakdown of costs by instance type. My Hetzner bill is about $3200/month, though it fluctuates wildly lately due to the roller coaster foreign exchange rates, however it’s been trending up lately. That cost covers 9 rented servers. The majority of the cost is in the 4 Dell servers: 3 of the DX182’s and one DX293, as well as one AX102 that has extra NVME storage to host a minio server all on a 10G network. Shortly after the mass migration from Twitter to Mastodon, I tried scaling horizontally, running on lower end Hetzner systems and it was a lot of work. So, I eventually started migrating to the Dells, which are far more performant and much more reliable and maintainable (for example, they have built in out of band KVM access). The rest of the costs fluctuates a bit. I had been spending between $600 and $1000 per month on CDN expenses with Bunny.net, but I recently fully migrated to Fastly, which is providing much better pricing (~$50/month). My postgres database performs streaming backups to a Wasabi storage bucket, and that has been costing between $400 and $600 per month. I continue trying to find cheaper alternatives for that, but they never work as reliably as Wasabi, and I am not inclined to take risk with those backups. I have been spending about $200/month on DeepL translation services, though I also recently moved that to a self hosted instance of Libretranslate. I have a bunch of other less expensive costs, like about $65/month on DNS hosting, $50 or so (depending on renewal dates) for domain names, about $100/month for additional backup storage hosted with backblaze (for object storage backups), and so on. Going forward, the costs will be closer to $4000 given the DeepL and CDN changes.

I built this out when we had about 30,000 active users on infosec.exchange and it provided some headroom for more growth, but the opposite has been happening lately and infosec.exchange is now down to less than 13,000 active users.

The breakdown looks like this:

1 - https://infosec.exchange – 12.4k MAU

2 - https://relay.infosec.exchange – 164 connected instances

3 - https://video.infosec.exchange – 41 MAU

4 - https://infosec.press – 6 MAU

5 - https://pixel.infosec.exchange – 114 MAU

6 - https://matrix.infosec.exchange – Not really sure

7 - https://infosec.place – 21 MAU

8 - https://infosec.town – 45 MAU

9 - https://infosec.pub – 369 MAU

10 - https://fedia.io – 597 MAU

11 - https://fedia.social – 46 MAU

12 - https://books.infosec.exchange – 20 MAU

13 - https://meetups.infosec.exchange – minimal

14 - https://infosec.space – 51 MAU

15 - https://convo.casa – 134 MAU

I have been receiving about $5500/month in donations across liberapay, patreon, and ko-fi, but that has been dropping monthly, as the number of accounts declines, and so I’ve started working to optimize costs, and will start looking at moving to smaller servers and more consolidation in the near future.

Some people noticed that for $5K one can get a very descent computer. Why not just buy personal hardware and run the instances that way instead of paying for a service?

I'm not sure those people have experience with running these services. It's really not feasible to run this many services supporting that many accounts on a $5000 PC.

Now, it is true that I'm using more expensive hardware than I need. For one, it's much much easier to maintain, extra capacity/memory means that it runs into problems that require my intervention far less (in fact, it's quite rare that we have any unscheduled issues now), and it's let me absorb some of the shocks that happen when, for example, people bail on instragram and pile onto pixelfed or from reddit to lemmy and mbin.

I started infosec.exchange a bit over 8 years ago and it was a tiny little thing with terrible performance for a few years. I eventually moved it to a larger server and was quite impressed at how nice the experience was when not constrained by capacity. Soon after, twitter melted down. I was quite active in the infosec community on twitter and wanted to give a "soft landing" spot for anyone that wanted to leave, and that's how things really got going. Over time, the community asked me to run different things, like pixelfed, lemmy, iceshrimp, etc, which I obliged, but I felt (and still feel) that it's important to provide a good, reliable, and fast service, and that's honestly been my priority infrastructure-wise. In the early days, I was able to cover any funding gaps because I was earning quite a lot of money, but eventually donations caught up, and now I'm out of work so can't really do that any longer and have to ensure costs are equal to or lower than donations, and that's been working out.

There are a few other reasons I'm using Hetzner: first is scalability and flexibility. Sure, I could buy servers for less than I end up renting them for, but I've turned over the layout of the infrastructure a bunch of times. If I need to add another Dell server, I place an order and shortly I get access to it and receive another $500 charge at the end of the month. When I'm done with it, I just cancel it and I'm no longer charged for it. Next is support - I've had servers die on me (particularly the non-Dell ones) and I cannot tell you how nice it is to just open a support ticket and be running on a brand new copy of the same server (ok, it might actually be used, but you get the point). Last is hosting - I have 9 servers, 5 of them with 10Gbps connection to the internet. That is far from free, even if I own the server.

Would I like to have a 20Gbps connection to my house hosting a cabinet holding $20000 of servers with battery backups, cooling, redundant power, and whatnot? you bet! but that's not really an option for me, so this is the best I've come up with. Are there better options? Probably, but this is how I chose to approach things.

I've noticed you list a few options to support your instance with money. But it seems like some people will be rather unwilling to do that kind of thing, for various reasons. For example a lot of people that are very libre-software focused check that even the javascript code in their browser is libre. Mastodon is fine for them. But something like the blob stripe uses for Librepay transactions is not. How could those people, if they wanted to, send you money?

In 8 years, I think I had one person ask if I would accept crypto currency for donations. I really should set that up, but it's actually not been an issue for me.

It seems like crypto just adds a layer on top of the existing problem. Yes you can send crypto with libre software only, but buying / withdrawing it requires the same non-libre JS as with direct credit card use. But there are ways to send money without the use of computers at all. Like cash, deposit checks, wire transfers, western union and its competitors. And other options that I may not be able to remember from the top of my head.

No worries - I misunderstood. I have never had anyone ask for a way to donate like that.

It seems like a lot of people not seeing an option to do any of that just automatically assume that they don't want to donate and move on. I wonder how many more will donate if such option will be obviously available. The Free Software Foundation lists a lot of alternative options for such people and they also make sure the JS for transactions is libre: www.fsf.org/about/ways-to-donate

I'll run a poll to see if there is interest in that - the community here doesn't seem to be shy about asking for alternatives, which is how I ended up with patreon, liberapay, and ko-fi.

If some person has strong believes in libre software and really wants to donate in a method that is not listed. Is there an option for this person to contact you in some way, to figure out some custom way of donating?

I do list my email address in my profile, and I can objectively say that people have had no problems finding it to ask me all manner of questions 😂

On my website I do this gimmicky thing called petitions. I set a goal ( like say x amount of followers on mastodon ) and I do something when this goal is reached. On the website I use the mastodon API to fetch the followers amount and render a neat progress bar. Is there an API call I can do to get the data needed to render a progress bar of how much money you need to collect this month to have the instance running?

I think the challenge is how to distribute that across the services. I suspect if I fall below the level I need, I'll look into something like that. Since I had a modestly large follower count, I've been trying to focus on encouraging others to donate to their own respective instances - I think it's important to ensure that this place remains healthy and available as an alternative to corporate social media, and that requires instances to get the money they need. It doesn't do me any good if I have enough to run infosec. but others are having to close up shop. I've even started "adopting" instances rather than seeing them go under due to lack of funding (like convo.casa).

I hope I can make a page somewhere, maybe on my website, or somehow on the ActivityPub, which checks for the health of the Fediverse, so to speak. And gives information on who to donate to if the health falls below a comfortable level. Technically speaking, for you, Patreon and Kofi and Librepay should have an API, which you can access with your key. You can then setup a basic JSON dump thingie on one of the servers. That includes only the relevant numbers. And I could use that.

In one of the replies to the article I wrote you clarified yourself that you don't see how this donations model can be sustainable in the long run if a lot more people join the fediverse. What sort of thing do you think should change for that ( and by "that" I mean everybody uses only fediverse ) to be feasible?

I'm not sure where this went off the rails. I thought we were talking about a hypothetical future where the fediverse was intended to be THE social media network for the masses - i.e, hundreds of millions or billions of people. The point I was trying to make is we can't expect the scale of infrastructure required to support that many people to be funded through donations by people who generally view that as a "free" service (even if we don't think it really IS free or should be free).

There are other issues packed in there, though. The model we have today where almost all instances are maintained by hobbyists collecting donations to fund hardware/bandwidth/storage. At a scale where there are 100 or 1000 times the people that are currently on the fediverse, we are talking about some pretty large infrastructures that are going to require professional management. I honestly don't see the volunteer admin scaling to that level - I just don't think there are that many people willing to donate their free time, and I also think that the notion that everyone just runs their own instance works, either.

There are technical issues, too, like storage duplication and whatnot - my eyes bleed thinking about the storage bucket(s) and database servers I'd need to hold 100x the amount of data, even for smaller instances, that will equate to large amounts of remote data being stored. I know that can be overcome with protocol and application changes, but then I think we start asymptotically approaching the Bsky/AT model.

What are the ratios that one have to expect from such a project? As in how many people use the instance vs how many are donating? And also what is the average donation?

I'll have to count to give a good answer. My best guess is that there are around 500 donors which would be around 4%. Many seem to donate at the $5/month level, but there are some that do considerably more and some that do $1 (or whatever the minimum is for that donation channel).