rssCloud and file sync

Lately, I’ve been testing services like dropbox, sugarsync, etc. The reason is bucket3:
1. I’d like to have a “local” copy of my content and be able to add or update it,
2. then have it automatically synced to my server,
3. where bucket3 would notice the changes and update my blog.
4. I would also like to have content added on the server side, by other means (ex. a script downloading my twitter updates daily), synced back to my laptop.

In order for this to work, first of all, I need a file syncing service. Most of the above mentioned are good in syncing files -even though Linux CLI support is very bad, and my server is a Linux box. So they are on the right track.

dropbox has a nice feature: they have an RSS feed of all the changes.

Then it struck me. We need an open source file syncing service that would use RSS to describe the changes on the “main” file repo, and then use rssCloud to notify the rest of the repos.

It would work like this:
1. A local repo knows when a new file is added or modified and pushes this change to the main repo.
2. The main repo updates its changes.xml rss feed and uses rssCloud to notify all local repos of changes.
3. Local repos pull the changes and everything is in sync.

Of course, it might me as easy to set the whole thing as a decentralized system, where no “central” or “main” repository exists, and all repositories notify the rest of any changes.

An extra bonus: it would be very easy for developers to implement action hooks, the github style: for example, I’d like to run a couple of bucket3 scripts when new content is added or updated.

And the whole mechanism is based on open standards, widespread knowledge and experience with RSS, aggregators and tools like rsync making it easy to can have different implementations per platform of programming language or needs.

6 Responses to rssCloud and file sync

  1. I like the idea. But wouldn’t this be a case for using a generic publish/subscribe infrastructure such as the implementations of XMPP XEP-0060 ?

  2. PanosJee says:

    What about security issues? Are those RSS Feed private ? Is it possible that someone stands in the middle and describes malicious files in the RSS ?

  3. Panayotis says:

    @Jean-Mark: rssCloud seems simpler to me and I tend to prefer the simplest available solution. But I may be wrong.

    @Panos: Everything I mentioned is standard web technologies. If we need more security, we can use HTTPS instead of HTTP and rsync with over SSH for file transfers.

  4. adamo says:

    A twisted mind would use DNS to do that :)

  5. Petros says:

    Το ζητούμενο feature (για RSS syncing) μοιάζει να είναι καλό χαρακτηριστικό (2DO?) και για το Πίθος (http://pithos.grnet.gr/support.html) …

  6. Petros says:

    This RSS syncing feature seems to be a nice feature to have for Pithos too (http://pithos.grnet.gr/support.html) …