views:

560

answers:

8

I suppose this question is a variation on a theme, but different.

Torrents will never replace HTTP, or even FTP download options. This said, why aren't there torrent links next to those options on more websites?

I'm imagining a web-system whereby downloaded files are able to be downloaded via HTTP, say from http://example.com/downloads/files/myFile.tar.bz2, torrents can be cheaply autogenerated and stored in /downloads/torrents/myFile.tar.bz2.torrent, and the tracker might be /downloads/tracker/.

Trackers are a well defined problem, and not incredibly difficult to implement, and there are many drop in place alternatives out there already. I imagine it wouldn't be difficult to customise one to do what is needed here.

The autogenerated torrent file can include the normal HTTP server as a permanent seed, the extensions to do this are very well supported by most, if not all, of the major torrent clients and requires no reconfiguration or special things on the server end (it uses stock standard HTTP Range headers).

Personally, if I setup such a system, I would then speed limit the /downloads/files/ directory to something reasonable, say maybe 40-50kb/s, depending on what exactly you were trying to serve.

Does such a file delivery system exist? Would you use it if it did: for your personal, company, or other website?

+3  A: 

I'm wondering if part of it is the stigma associated with torrents. The only software that I see providing torrent links are Linux distros, and not all of them (for example, the Ubuntu website does not provide torrents to download Ubuntu). However, if I said I was going to torrent something, most people associate it with illegal downloads (music, video, TV shows, etc).

I think this might come from the top. An engineer might propose using a torrent system to provide downloads, yet management shudders when they hear the word "torrent".

That said, I would indeed use such a system. Although I doubt I would be able to seed at home (I found that the bandwidth kills the connection for everyone else in the house). However, at school, I probably would not only use such a system, but seed for it as well.

Another problem, as mentioned in the other question, is that torrent software is not built into browsers. Until it is, you won't see widespread use of it.

Thomas Owens
There are all sorts of torrent addons for Firefox, and I assume other browsers too. There's a veritable plethora of non-browser clients (see the spec if you thought you could count them on one hand). And the problems with 'killing' bandwidth stem from people not limiting their client properly.
Matthew Scharley
Maybe it's an education issue as much as anything else... Ah well. Sometime in the future, hopefully.
Matthew Scharley
The problem with it killing the connection for everyone else in the house, comes from not having enough connections. Look at limiting the No. of connections used in the torrent client, and search for guides increasing the number of connections in your router and shortening the time they are alive.
mreggen
It can also be caused by flooding your upload channel if you're on a DSL connection of some type. Limiting your uploads to 2/3 or less of your 'maximum' upload limit really helps.
Matthew Scharley
Actually, Ubuntu does provide bittorrent downloads (at the bottom of the page): http://releases.ubuntu.com/8.04/
Bill Turner
I agree with it being the association with illegal downloads. Typical user comment on seeing one = "Oh yeah, torrents, I know them, that's how you steal music, right?"
Brian Knoblauch
So perhaps it's time for a lesson in the real world, for all involved? For users: It's a convenient way to share files... whatever they may be, just like vcr's and dvd's are convenient ways to share movies... oops. The day the RIAA and co shuts off a whole protocol is the day the internet dies IMHO
Matthew Scharley
There's a Bittorrent client built into Opera. I haven't ever used it (I use UTorrent), but it still exists :)
MetroidFan2002
I have to clean up this post, given these comments, but I'm at work in the middle of an intense coding/debugging session. I'll take care of it when I get home. :)
Thomas Owens
A: 

Perhaps its the ubiquity of http-enabled browsers, you don't see so much FTP download links anymore, so that could be the biggest factor (ease of use for the end-user).

Still, I think torrent downloads are a valid alternative, even if they won't be the primary download.

I even suggested Sourceforge auto-generate torrents for downloads, and they agreed it was a good idea.. but havn't implemented it (yet). Here's hoping they will.

gbjbaanb
I could see a system like the one I described catching on, even if it was only in the open source communities at first, especially if it was released under a BSD style licence... Maybe the guys at sourceforge would be good enough to GPL whatever solution they come up with?
Matthew Scharley
A: 

Something like this actually exists at speeddemosarchive.com. The server hosts a Metroid Prime speedrun and provides a permanent seed for it. I think that it's a very clever idea. Contrary to your idea, you don't need an HTTP URL.

You need some form of initial seed. Whether that's a HTTP link (which is already there, so why not use it?) or another client running on the server, it doesn't matter too much.
Matthew Scharley
+1  A: 

There are people who won't install a torrent client because they don't want the RIAA sending them extortion letters and running up legal fees in court when they (the RIAA) break into your computer and see MP3 files that are completely legal backup copies of CDs that were legally purchased.

There's a lot of fear about torrents out there and I'm not comfortable with any of the clients that would allow even limited access to my PC because that's the "camel's nose in the tent".

David
+1  A: 

The other posters are correct. There is a huge stigmata against Torrent files in general due to their use by hackers and people who violate copyright law. Look at PirateBay, that is all they "serve" are torrent files. A lot of cable companies in the US have started traffic shaping Torrent traffic on their networks as well because it is such a bandwidth hog.

Remember that torrents are not a download accellerator. They are meant to offload someone who cannot afford (or maybe just doesn't desire) to pay for all the bandwidth themselves. The users who are seeding take the majority of the load. No one seeding? You get no files.

The torrent protocol is also horrible for being so darn chatty. As much as 40% of your communications on the wire can be control flow messages and chat between clients asking for pieces. This is why cable companies hate it so much. There are some other problems of the torrent end game (where it asks a lot of people for final parts in an attempt to complete the torrent but can sometimes end up with 0 available parts so you are stuck with 99% and seeding for everyone).

http is also pretty well established and can be traffic shaped for load balancers, etc. So most legit companies that serve up their content can afford to host it, or use someone like Akamai to repeat the data and then load balance.

Jason Short
I think your 40% is very much a worst case number. I know from implementing and watching the bandwidths that practically speaking it should be nowhere near that. That said, yes, it can be chatty, definitely more so than HTTP. Then again, it's managing 100 connections, not just 1.
Matthew Scharley
I've written implementations of BitTorrent for large game companies... It is very chatty. In some cases over 80% of the traffic was update packets. That was about 3 years ago, maybe the protocol has been updated.
Jason Short
A: 

I think one of the reasons is that (currently) torrent links are not fully supported inside web browser... you have to fire up the torrent client and so on.

Maybe is time for a little firefox extension/plugin? Damn, now I am at work! :)

Myrrdyn
https://addons.mozilla.org/en-US/firefox/addon/4844 , enjoy.
Matthew Scharley
The one true browser (opera) has supported them for some time.
Martin Beckett
+7  A: 

first of all: http://torrent.ubuntu.com/ for torrents on ubuntu.

second of all: opera has a built in torrent client.

third: I agree with the stigma attached to p2p. So much so that we have sites that need to be called legaltorrents and such like because by default a torrent would be an illegal thing, and let us not kid ourselves, it is.

getting torrents into the main stream is an excellent idea. you can't tamper with the files you are seeding so there is no risk there.

the big reason is not really stigma. the big reason is analytics, and their protection. with torrents these people (companies like microsoft and such like) would not be able to gather important information about who is doing the downloads (not personally identifiable information, and quickly aggregated away). with torrents, other people would be able to see this information, at least partially. A company would love to seed the torrent of an evaluation version of a competing companys product, just to get an idea of how popular it is and where it is getting downloaded from. It is not as good as hosting the download on your webservers, but it is the next best thing.

this is possibly the reason why the vista download on microsofts sites, or its many service packs and SDKs are not in torrents.

Another thing is that people just wont participate, and that is not difficult to figure out why because of the number of hoops you have to jump through. you got to figure out the firewall, the NAT thing, and then uPNP thing, and then maybe your ISP is throttling your bandwidth, and so on.

Again, I would (and I do) seed my 1.5 times or beyond for the torrents that I download, but that is because these are linux, openoffice that sort of thing. I would probably feel funny seeding adobe acrobat, or some evaluation version or something, because those guys are making profits and I am not a fool to save money for them. Let them pay for http downloads.

edit: (based on the comment by monoxide) For the freeware out there and for SF.net downloads, their problem is that they cannot rely on seeders and will need their fallback on mirrors anyway, so for them torrents is adding to their expense. One more reason that pops to mind is that even in software shops, Internet access is now thoroughly controlled, and ports on which torrents rely plus the upload requirement is absolutely no-no. Since most people who need these sites and their downloads are in these kinds of offices, they will continue to use http.

BUT even that is not the answer. These people have in their licensing terms restrictions on redistribution. And so their problem is this: if you are seeding their software you are redistributing it. That is a violation of their licensing terms so if they host a torrent download and allow you to seed it, that is entrapment and they can be sued (I am not a lawyer, I learn from watching TV). They have to then delicately change their licensing to allow distribution by seeding torrents but not otherwise. This is an easy enough concept for most of us, but the vagaries of the English language and the dumb hard look on the face of the judge make it a very tricky thing to do. The judge may personally understand torrents, but sitting up their in the court he has to frown and pretend not to because it is not documented in legalese.

That there is the ditch they have dug and there they fall into it. Let us laugh at them and their misery. Yesterdays smart is todays stupid.

Cheers!

kinjal
NAT and uPNP generally works out of the box. Beyond that, I agree. For paid products it can present problems. But what about the huge volume of free... whatever out there on download sites from cnet.com to sf.net. These people don't have these issues, yet it still doesn't happen.
Matthew Scharley
+2  A: 

Kontiki (which is very similar to bittorrent), makes up about 10% of all internet traffic by volume in the UK, and is exclusively used for legal distribution of "big media" content.

Colin Pickard