As far as content goes:
- Our SDLC methodology dictates what documents we need to write.
- Our document control process dictates how we name and version the files.
- Our CM process dictates how we persist these files.
We used to store everything on our LAN, across various drives and directories, depending on what product the documentation is for, and what functional area produced it. It was a mess. So, we moved everything into SharePoint thinking it would make finding documents easier. It wasn't. Then, we tried something different:
- All documentation for a product was organized into a single repository for that product. IOW, each product has their own document repository. We still keep everything in SharePoint, but we create a SharePoint site for each product and use a custom document library, with custom metadata, for the documents.
- We stopped naming documents using acronyms and abbreviations. The system test plan was simply called System_Test_Plan.doc. The buisness requirements specification was called Business_Requirements_Specification.doc.
- Rather than create folders in SharePoint, we create views to filter and group documents. Also, we find the metadata makes it easer for SharePoint to find documents when searching.
- For admin guides and system support type docs, we use a SharePoint wiki rather than documents, which also seems to make it easier for SharePoint to find things.
The key, as you allude to above, is to make finding the documents/information easy.