Your self-hosted, globally interconnected microblogging community
Go to file
Eugen 6d6a429af8 Rewrite Atom generation from stream entries to use Ox instead of Nokogiri (#1124)
* Rewrite Atom generation from stream entries to use Ox instead of Nokogiri::Builder

StreamEntry is now limited to only statuses, which allows some optimization. Removed
extra queries on AccountsController#show. AtomSerializer instead of AtomBuilderHelper
used in AccountsController#show, StreamEntriesController#show, StreamEntryRenderer
and PubSubHubbub::DistributionWorker

PubSubHubbub::DistributionWorker moves n+1 DomainBlock query to PubSubHubbub::DeliveryWorker
instead.

All Salmon slaps that aren't based on StreamEntry still use AtomBuilderHelper and Nokogiri

* All Salmon slaps now use Ox instead of Nokogiri. No touch from status on account
2017-04-07 05:56:56 +02:00
app Rewrite Atom generation from stream entries to use Ox instead of Nokogiri (#1124) 2017-04-07 05:56:56 +02:00
bin Upgrade to Rails 5.0.0.1 2016-08-17 17:58:00 +02:00
config Make sure Rabl is using Oj 2017-04-05 19:29:30 +02:00
db Low-hanging fruit of query optimization, these indices were missing 2017-04-07 00:04:38 +02:00
docs Merge pull request #1042 from johnsudaar/feature/scalingo_one_click 2017-04-06 19:32:12 +02:00
lib Add maintenance task for updating counter caches 2017-03-31 13:01:00 +02:00
log Initial commit 2016-02-20 22:53:20 +01:00
public Improve emojis - use SVGs where possible 2017-03-29 22:27:24 +02:00
spec Split SalmonWorker into smaller parts, move profile updating into another job 2017-04-05 21:43:10 +02:00
storybook Fix up storybook 2017-03-02 18:55:15 +01:00
streaming Add heartbeat to websockets streaming API connections 2017-04-02 21:27:14 +02:00
vendor/assets Initial commit 2016-02-20 22:53:20 +01:00
.babelrc Debounce autosuggestions requests 2016-11-13 13:13:36 +01:00
.buildpacks Install nodejs before ruby 2017-04-05 13:53:30 +02:00
.codeclimate.yml Create .codeclimate.yml 2016-11-17 12:40:23 -05:00
.dockerignore Optimize Dockerfile 2017-04-06 15:42:16 +08:00
.env.production.sample [#817] Add email whitelist 2017-04-04 11:20:15 -04:00
.env.test Update .env.test 2016-11-29 17:51:16 +01:00
.env.vagrant Add a default LOCAL_DOMAIN=mastodon.dev to .env.vagrant 2017-01-26 19:22:59 +11:00
.eslintrc Don't show statuses to blocked users 2016-12-26 19:13:56 +01:00
.gitignore Add capistrano to development environment 2017-01-30 20:03:17 +01:00
.nvmrc set up Mocha/Chai/Enzyme for React component unit testing 2016-10-10 22:48:58 +02:00
.rspec Adding a Mention model, test stubs 2016-02-25 00:17:01 +01:00
.rubocop.yml Fix tests, add applications to eager loading/cache for statuses, fix 2017-01-15 14:01:33 +01:00
.ruby-version Upgrade ruby to 2.3.1 2016-11-12 01:55:33 +01:00
.slugignore Updates slugignore. 2017-04-06 07:53:48 -04:00
.travis.yml Fix #61 - Add list of blocked users to the UI; clean up failed push notifications API 2017-02-05 19:18:11 +01:00
CONTRIBUTING.md Corrected spelling mistake 2017-04-02 13:01:55 -04:00
Capfile Speed up capistrano deployments 2017-02-16 02:34:21 +01:00
Dockerfile add metadata to Dockerfile 2017-04-06 20:57:16 +02:00
Gemfile Rewrite Atom generation from stream entries to use Ox instead of Nokogiri (#1124) 2017-04-07 05:56:56 +02:00
Gemfile.lock Rewrite Atom generation from stream entries to use Ox instead of Nokogiri (#1124) 2017-04-07 05:56:56 +02:00
ISSUE_TEMPLATE.md Fix typo in ISSUE_TEMPLATE 2017-04-04 14:49:31 +02:00
LICENSE Fix #49 - License changed from GPL-2.0 to AGPL-3.0 2016-09-21 23:04:34 +02:00
Procfile Add sounds for notifications. Boop by @jk@mastodon.social 2017-01-17 20:09:03 +01:00
README.md add Docker microbadger to README.md 2017-04-06 20:59:20 +02:00
Rakefile Initial commit 2016-02-20 22:53:20 +01:00
Vagrantfile Add a couple of network performance tweaks to Vagrantfile. 2017-04-06 22:34:59 +02:00
app.json Added SMTP_FROM_ADDRESS to heroku deploy config 2017-02-17 14:45:31 +10:30
config.ru Fix rubocop issues, introduce usage of frozen literal to improve performance 2016-11-15 16:56:29 +01:00
docker-compose.yml Separate background jobs into different queues. ATTENTION: new queue "pull" 2017-04-04 00:53:20 +02:00
package.json Improve emojis - use SVGs where possible 2017-03-29 22:27:24 +02:00
scalingo.json Fix wrong url in scalingo.json 2017-04-05 17:28:11 +02:00
yarn.lock Improve emojis - use SVGs where possible 2017-03-29 22:27:24 +02:00

README.md

Mastodon

Build Status Code Climate

Mastodon is a free, open-source social network server. A decentralized solution to commercial platforms, it avoids the risks of a single company monopolizing your communication. Anyone can run Mastodon and participate in the social network seamlessly.

An alternative implementation of the GNU social project. Based on ActivityStreams, Webfinger, PubsubHubbub and Salmon.

Click on the screenshot to watch a demo of the UI:

Screenshot

Focus of the project on a clean REST API and a good user interface. Ruby on Rails is used for the back-end, while React.js and Redux are used for the dynamic front-end. A static front-end for public resources (profiles and statuses) is also provided.

If you would like, you can support the development of this project on Patreon. Alternatively, you can donate to this BTC address: 17j2g7vpgHhLuXhN4bueZFCvdxxieyRVWd

Resources

Features

  • Fully interoperable with GNU social and any OStatus platform Whatever implements Atom feeds, ActivityStreams, Salmon, PubSubHubbub and Webfinger is part of the network
  • Real-time timeline updates See the updates of people you're following appear in real-time in the UI via WebSockets
  • Federated thread resolving If someone you follow replies to a user unknown to the server, the server fetches the full thread so you can view it without leaving the UI
  • Media attachments like images and WebM Upload and view images and WebM videos attached to the updates
  • OAuth2 and a straightforward REST API Mastodon acts as an OAuth2 provider so 3rd party apps can use the API, which is RESTful and simple
  • Background processing for long-running tasks Mastodon tries to be as fast and responsive as possible, so all long-running tasks that can be delegated to background processing, are
  • Deployable via Docker You don't need to mess with dependencies and configuration if you want to try Mastodon, if you have Docker and Docker Compose the deployment is extremely easy

Configuration

  • LOCAL_DOMAIN should be the domain/hostname of your instance. This is absolutely required as it is used for generating unique IDs for everything federation-related
  • LOCAL_HTTPS set it to true if HTTPS works on your website. This is used to generate canonical URLs, which is also important when generating and parsing federation-related IDs

Consult the example configuration file, .env.production.sample for the full list. Among other things you need to set details for the SMTP server you are going to use.

Requirements

  • Ruby
  • Node.js
  • PostgreSQL
  • Redis
  • Nginx

Running with Docker and Docker-Compose

The project now includes a Dockerfile and a docker-compose.yml. You need to turn .env.production.sample into .env.production with all the variables set before you can:

docker-compose build

And finally

docker-compose up -d

As usual, the first thing you would need to do would be to run migrations:

docker-compose run --rm web rails db:migrate

And since the instance running in the container will be running in production mode, you need to pre-compile assets:

docker-compose run --rm web rails assets:precompile

The container has two volumes, for the assets and for user uploads. The default docker-compose.yml maps them to the repository's public/assets and public/system directories, you may wish to put them somewhere else. Likewise, the PostgreSQL and Redis images have data containers that you may wish to map somewhere where you know how to find them and back them up.

Note: The --rm option for docker-compose will remove the container that is created to run a one-off command after it completes. As data is stored in volumes it is not affected by that container clean-up.

Tasks

  • rake mastodon:media:clear removes uploads that have not been attached to any status after a while, you would want to run this from a periodic cronjob
  • rake mastodon:push:clear unsubscribes from PuSH notifications for remote users that have no local followers. You may not want to actually do that, to keep a fuller footprint of the fediverse or in case your users will soon re-follow
  • rake mastodon:push:refresh re-subscribes PuSH for expiring remote users, this should be run periodically from a cronjob and quite often as the expiration time depends on the particular hub of the remote user
  • rake mastodon:feeds:clear_all removes all timelines, which forces them to be re-built on the fly next time a user tries to fetch their home/mentions timeline. Only for troubleshooting
  • rake mastodon:feeds:clear removes timelines of users who haven't signed in lately, which allows to save RAM and improve message distribution. This is required to be run periodically so that when they login again the regeneration process will trigger

Running any of these tasks via docker-compose would look like this:

docker-compose run --rm web rake mastodon:media:clear

Updating

This approach makes updating to the latest version a real breeze.

git pull

To pull down the updates, re-run

docker-compose build

And finally,

docker-compose up -d

Which will re-create the updated containers, leaving databases and data as is. Depending on what files have been updated, you might need to re-run migrations and asset compilation.

Deployment without Docker

Docker is great for quickly trying out software, but it has its drawbacks too. If you prefer to run Mastodon without using Docker, refer to the production guide for examples, configuration and instructions.

Deployment on Scalingo

Deploy on Scalingo

You can view a guide for deployment on Scalingo here.

Deployment on Heroku (experimental)

Deploy

Mastodon can theoretically run indefinitely on a free Heroku app. You can view a guide for deployment on Heroku here.

Development with Vagrant

A quick way to get a development environment up and running is with Vagrant. You will need recent versions of Vagrant and VirtualBox installed.

You can find the guide for setting up a Vagrant development environment here.

Contributing

You can open issues for bugs you've found or features you think are missing. You can also submit pull requests to this repository. Here are the guidelines for code contributions

IRC channel: #mastodon on irc.freenode.net

Extra credits

  • The Emoji One pack has been used for the emojis
  • The error page image courtesy of Dopatwo

Mastodon error image