storage

How do applications collect statistics?

I need to collect statistics from my server application written in python. I am looking for some general guidance on how to setup models and exactly how to store the statistics information. I was thinking of storing and organizing all this information in a database, but my implementation is turning out to be too specific. I need to co...

.bss section in elf file

If I understand correctly, the .bss section in ELF files is used to allocate space for zero-initialized variables. Our tool chain produces ELF files, hence my question: does the .bss section actually have to contain all those zeroes? It seems such an awful waste of spaces that when, say, I allocate a global ten megabyte array, it results...

.net: virtual network shares that pull their content from databases or other sources

I'd like to expose data that can come from different sources (ie. a database, or various other folders locations) and make it available as a virtual network folder so that users could access the data, and also write data into this virtual folder structure, with a listener translating the action into what should be done with the file behi...

What is the best way to store usage reports over time?

Hello, I currently have a few server reports that return usage statistics whenever run. The data is collected from several different sources (mostly log files), so they're not in a database to begin with. The returned data are simple lists, for example, detailing how much disk space a user is using (user => space) average percent memor...

How to store documentation of programs, libraries and languages you use

As I often work without a fast or even any internet connection, I have a webserver that serves commonly used documentation, for example: Various programming languages (php, Python, Java, ...) Various libraries (for example pthreads) Various open books RFCs IETF drafts Wikipedia (text-only, the uncompressed English dumpfile weighs 20GB!...

error while truncating tables from oracle db

I am doing something like this in a procedure to clear all data from all tables in my database. LOOP dbms_utility.exec_ddl_statement('alter table ' || c.owner || '.' || c.table_name || ' disable constraint ' || c.constraint_name); END LOOP; . . . LOOP EXECUTE IMMEDIATE 'TRUNCATE TABLE ' || t.table_name ; END LOOP; Now ...

What is the best place to read/write/store a small amount of data online?

I want to be able to store, retrieve, and modify a small amount of textual data (< 2 mb) online. What service should I use to be able to do this programatically (in Java)? ...

Relative links automatically gain the session ID

Hello, Because the session ID is inserted in the current URL, relative links also automatically gain the session ID. In other words, if the user is currently stationed on Page1.aspx and clicks a relative link to Page2.aspx, the relative link includes the current session ID as part of the URL. The only real limitation of cookieless ...

Effectively Design a Simple Mail Client

Requirement : JAVA desktop mail client which could connect to existing gmail,y! mail a/c & will allow receive/send mails, support offline view of mails, plus with more features as & when it comes. i am using Java Mail Api's Underlying Mail Storage: I have decided to use HSQLDB with Hibernate. Email content can have attachments , HTML ...

How do video games efficiently store/retrieve large amounts of data?

For example, in Fallout 3, a save game stores the state and location of every single object and NPC in the game, and only takes up a few MB's. How do they do that!?!? And then, during game play, how is this data added/retrieved in/from memory such that it can be displayed to the player in real-time? UPDATED: (I'm going to make you wor...

Convert.FromBase64String()

Hello, Q1 - If character ‘C’ is saved into viewstate, then just before the page is rendered,Asp.Net serializes ‘C’(along with other data) into Base64 string. If on postback I issue the following code: protected void Page_Load(object sender, EventArgs e) { TextBox1.Text = "ABCDEF"; if (IsPostBack) { string v...

Saving images to db

I can save an image to the database streaming it to a byte array using the below code, but when it comes back out it has lost the alpha blending around the image and shows a blocky blue border. image.Save(stream, image.RawFormat); How can I get the original picture back out? ...

Best practices for storing production passwords for small groups

This is not a technical question. How do small organizations keep sensitive information that must be shared among several individuals safe, such as root passwords to production servers? Not all people that need to have access work in the same location.. new passwords can be distributed by phone, but what rules should be enforced for team...

I need to persist data on the client side (about 1M)

I need to persist my data on the client side, without it moving back and forth in each request (Kills the cookies option). I can't use special plugins/extensions. One thought I had was to generate a dynamic JS file with the needed data for the current session of the user and make sure it is cached. There is a small problem with that, as...

How to store a user-related information in .net apps?

What is the preferred way to store user-level information for .NET application. I could have used registry or config files - but some users don't have enough permissions to save/load from these. I have heard something about assembly private storage or smth like that, is it a way to go? My main concern is to make sure that even users w...

Really force file sync/flush in Java

How can data written to a file really be flushed/synced with the block device by Java. I tried this code with NIO: FileOutputStream s = new FileOutputStream(filename) Channel c = s.getChannel() while(xyz) c.write(buffer) c.force(true) s.getFD().sync() c.close() I supposed that c.force(true) togehter with s.getFD().sync() should b...

A lot of writes,but few reads - what Mysql storage engine to use?

I was wondering if anyone has a suggestion for what kind of storage engine to use. The programs needs to perform a lot of writes to database but very few reads. [edit] No foreign keys necessary. The data is simple, but it needs to preform the writes very fast. ...

Relational databases - there has to be more right?

I really enjoy database design and the whole concept of managing data semantically and all the logic that comes with it. My knowledge level when it comes to databases is however (I would guess) quite basic - I can model data relationships correctly with ER diagrams, connection tables, handling many-to-many, one-to-many etc etc. I'm expe...

Where do I put my custom Levels folder in XNA game?

I am quite lost with where and how to store the *.txt level files in my game. What I want in my game is the availability of a few "prebaked" levels that come installed with the game but also the ability for users to create their OWN levels. So what I did is created a new directory inside visual studio in the "Content" called levels, an...

What is the "best" way to store scripts?

I have hundreds of scripts for testing a component. Each of these scripts contain a set of subscripts and individual records. Subscripts can be used in multiple TC_Level scripts and even in other subscripts. Every script has a unique name. Example: TC_1 | (1) Subscript_a | | | (1) Record i | | | (2) Record ii ...