filesystems

Data structure/algorithm for variable length record storage and lookup on disk withsearch only on primary keys

I am looking for an algorithm / data structure that works well for large block based devices (eg a mechanical hard drive) which is optimised for insert, get, update and delete where searches are always done using the id of the data and where the data fields for any ID have a variable length. The B-Tree seems to be a commonly quoted stru...

Problem on Tag "Filesystem"

For recreational reasons I wrote a PHP class that classifies files with tags instead of in a hierarchical way, the tags are stored in the filename itself in the form of +tag1+tag2+tagN+MD5.EXTENSION and thus I'm stucked with the chars limit (255) imposed by the FS/OS. Here is the class: <?php class TagFS { public $FS = null; f...

Linux iNotify one shot and event mask problem

I'm trying to use iNotify in linux rhel5, kernel 2.6.18, glibc 2.5-18. I did not define the event as one shot but for some some reason it behaves as if I did. The impact is that I have to re-add a watch after each event. Any one ever used iNotify? Another problem is that the mask returned in the event object contains only one flag: IN_ON...

Howto disable password request on file creation on newly formatted hard disk

I have just formatted an external hard disk using this command: $ sudo mkfs -t ext3 /dev/sdc1 However, once this is done, whenever I want to create a directory or file in this hard disk, it always ask for password (i.e. permission requirement). Is there a way I can disable that? Note that I can't format the partition with mkfs unles...

how to investigate what a process is doing?

I know this can be checked from /proc/PID directory, but don't know how to, can any one show me the way? ...

Object reference not set to an instance of an object?

I wrote these lines but i have NullReferenceException. please help me how to fix it! string FullPath = TempPath + FileName; System.Drawing.Image Adimg = null; Adimg = System.Drawing.Image.FromFile(MapPath(FullPath)); I put these lines in a Public bool method and TempPath is class property and FileName is input for the method. excepti...

Data Transfer Speeds: NFS vs HTTP

Hello, Am currently considering using REST access to Nirvanix online storage to store/download files. However, Nirvanix also offers NFS access to the network storage. I was wondering if there are any known benchmarks or protocol-specific reasons for choosing REST over NFS? thanks. ...

Is there an open-source solution to XA-transactional file access in Java?

Hi, Is it possible to make XA-transactional access to the file system in Java? I want to manipulate files within the boundaries of a transaction and my transaction must participate in a distributed transaction via JTA (so I guess the file system needs to be accesses as a XAResource). I don't need support for fine-grained read/write fil...

Database/data storage for high volume of simple transactions

I have written a PHP application which requires storage of millions of integers between 0 and 10,000,000 inclusive. Each number is incremented by one very frequently (on average 100 values are updated every second) and read very frequently (20,000 reads per second). The numbers are reset to 0 either nightly, weekly, monthly or annually. ...

C++ Recursive File/Directory scanning using Cygwin

I'm looking to write a portable filesystem scanner, capable of listing all files on a given directory path recursively. To do this, I'm attempting to use cygwin for my compiler, making use of dirent.h and using the template: #include <dirent.h> #include <stdio.h> int main(void) { DIR *d; struct dirent *dir; d = opend...

Incorporating I/O driven scheduling into OS Kernel

IronPort developed a high performance file system and an I/O driven scheduler optimized for the asynchronous nature of messaging (hence "Async"OS). If you wanted to do the same but make it open source, what exactly would need to change? ...

Detecting a file opening

Is it possible in the Windows environment to detect if a file is being opened with with .NET I would like to place a handler on the file system to detect if a file or any file is being opened, is this possible? ...

blackberry simulator "fileconn.dir.photos" location?

I am facing a weird problem on BlackBerry JDE 4.2.0 and the 8100 simulator it comes with: String path = System.getProperty("fileconn.dir.photos"); This returns null! This works for all J2ME phones and emulators I've worked with so far. Is there anything special that I need to do to get it work on the Blackberry simulator? Note, that ...

Shred: Doesn't work on Journaled FS?

Shred documentation says shred is "not guaranteed to be effective" (See bottom). So if I shred a document on my Ext3 filesystem or on a Raid, what happens? Do I shred part of the file? Does it sometimes shred the whole thing and sometimes not? Can it shred other stuff? Does it only shred the file header? Thanks, Dan CAUTION: Not...

FSEvents weirdness on OS X Leopard

I want to monitor file-system events for a couple of directories on the mac. The directories I want to monitor might change at runtime, so using FSEvents here's what my app does: creates a global callback function to handle callbacks create a new FSEventStreamRef per folder, associating it with the callback created above and adding a c...

Ways of keeping DLLs up to date

I've recently joined a company which has had a number of developers of varying quality work for them over the years. The projects which have been created rely on outputs from other projects. However instead of creating dependencies in the normal manner and maintaining the code, DLLs have been copied from one place to another and referen...

How would you build a database filesystem (DBFS)?

A database file system is a file system that is a database instead of a hierarchy. Not too complex an idea initially but I thought I'd ask if anyone has thought about how they might do something like this? What are the issues that a simple plan is likely to miss? My first guess at an implementation would be something like a filesystem...

Why would two mysql files (same table, same contents) be different in size?

I took an existing MySQL database, and set up a copy on a new host. The file size for some tables on the new host are 1-3% smaller than their counterpart files on the old host. I am curious why that is. My guess is, the old host's files have grown over time, and within the b-tree structure for that file, there is more fragmentation. ...

How do I make my program watch for file modification in C++?

There are a lot of programs, Visual Studio for instance, that can detect when an outside program modifies a file and then reload the file if the user wants chooses. Is there a relatively easy way to do this sort of thing in C++ (doesn't necessarily have to be platform independent)? ...

Searching for a file from VB.NET

Given a filename, how do I efficiently search for that file on disk? (Visual Studio 2005, i.e. .NET 2.0) ...