views:

1556

answers:

7

We happily use SVN for SCM at work. Currently I've got our binary assets in the same SVN repository as our code. SVN supports very large files (it transmits them 'streamily' to keep memory usage sane), but it is SLOOWWWWW.

What asset management software do you recommend, for about a GB (and growing) worth of assets? We would prefer branching and merging (different assets & config files go to different customers).

A: 

Git has quite good performance and can be used in an SVN-like centralized environment, or distributed environments.

not true. git's performance normally great, but is abysmal with large files.
apenwarr
+2  A: 

Please be very aware that it is almost impossible to merge binary files! At least automatically. At least I've never heard of a program that supports three-way merging on a binary format. Let alone conflict resolving.

That's why most asset management tools don't have branching, since it makes little sense since you can't merge again. Locking and linear history is better. If you want to "branch", then make a copy of the file with history.

Hugo
A: 

@Hugo, well I want merging on the text config files, and for binary assets I don't really care about merging diffs of a single file but I'd like to be able to merge trees (additions and deletions)

Dustin Getz
this should be added as a comment to hugo's answer, not an answer itself.
nickf
nit much? I'd rather it be visible so more people don't ask the same question.
Dustin Getz
Then edit your question. This is a non-answer, -1
Carl Meyer
A: 

The use of Subversion should be limited to text files because keeping binary files in there doesn't add much benefit. For binary files, look into different backup management software. For starters, you can create a folder for each date and store them on external harddrive. Even if you take a daily backup for an year, you can fit in a my book.

Edit: The software/hardware choice really depends on the scale, your IT dept, budget and needs. The cheap and quick way might be to buy an external drive and get a consumer backup software. PC Magazine thinks Genie Backup Manager Pro is good (I've never heard of it). If it's something important for work, you can do something like a NAS from Dell connected by fast switch (so files copy fast), and use things like Backup Exec or UltraBac, and also rent a remote rack space so you can park the second NAS for remote backup.

eed3si9n
recommend any asset management software, per original question?
Dustin Getz
WTF, keeping assets in date named folders? Maybe for a school project. Get real!
gruszczy
@gruszczy, suppose we are talking about 1GB+ of recorded audio or video kind of thing, what do you propose as an available alternative solution for OP?
eed3si9n
We used for game assets (at the end of development about 10GB of data) in both SVN and Perforce. The former was used only due to legacy reasons. Not to mention that SVN tend to lost some data from time to time. Anyway, folders weren't an option.
gruszczy
+2  A: 

Perforce is the only version control system I've heard being used for huge files and whole projects. It's free for two seats, but pretty expensive for more users (around $900 per seat). I've heard it can handle repositories as large as a terabyte.

git might be another option. It behaves somewhat differently from SVN, but is made for bigger projects (e.g. the Linux kernel). I'm not sure if it's good for big binary files.

With GIT and Adobe Flash projects (45 mb .FLA files), I am begun seeing fatal: Out of memory, malloc failed. I have 2 GB in my machines, so I guess GIT is not good at handling large files.
neoneye
I used Perforce, when I was working in gaming industry. It is sometimes quite annoying, but it handles large files very well. All our assets were kept in perforce.
gruszczy
A: 

If you need to manage HUGE files, give a try to Plastic SCM (www.plasticscm.com). AFAIK Perforce is also an option but branching and merging are not that strong.

pablo
+1  A: 

At my company, we use Documentum as a ECMS, managing lots (and I mean really lots) of binary files. Documentum (or other ECMS like Alfresco) are supposed to be the "right" solution to manage documents. Documentum supprots tagging and branching, and can expose files as WebDAV (so integration into your workflow can be more or lessa transparent).

That's the theory. In practice, we found Documentum slow, hard to configure and manage. And honestly, even if we have lots of documents, most of them are not larger than a few 100's Mo.

This answer more of what you should not do than what you should do ... sorry ...

Guillaume