Alternate account for @[email protected]

  • 120 Posts
  • 565 Comments
Joined 1 year ago
cake
Cake day: July 3rd, 2023

help-circle








  • The post is from 2 years ago but it does pose an important question which few people really talk about. The Fediverse isn’t scaling.

    Any distributed system is inefficient, for one, because it lacks the economy of scale.

    Sure, it’s probably worth the tradeoff, but what happens when we actually get so many people that servers start to collapse? Lemmy has ~45k active users, but let’s say we jump to 1 million active users. Small servers will stop working due to too much traffic, medium servers will need way more money to process the thousands of images per day, large servers will become too centralized. We’re already slowly going that way with the instance count steadily going down and users/instance going up.

    None of this matters now but within the next 5, 10 years I think we really need a game plan in order for these platforms to succeed. You can’t just increase the servers to spread the load, the load on all instances is steadily going up.






  • simple@lemm.eetoTechnology@lemmy.world*Permanently Deleted*
    link
    fedilink
    English
    arrow-up
    20
    ·
    edit-2
    14 days ago

    It’s big. According to Wikipedia they gained 30.5 million dollars in 2022 and have almost 170 employees - not mentioning probably hundreds of other volunteers. It sounds simple in concept but storing petabytes of data safely and maintaining complex software and hardware for it is impressive. That’s why there aren’t really any alternatives to it.

    They’re also much bigger than just the wayback machine, they have multiple projects like OpenLibrary which is a goodreads alternative and scans books to read online. The IA is also under constant legal fire for archiving copyrighted materials so I bet they spent millions of dollars on that alone.