I want to change the way text is represented internally in ANY Text Editor

Question

I want to use a algorithm to reduce memory used to save the particular text file.I don't really know how text is stored but i have an idea in mind.

Would it be better to extend a open source text editor (if yes than which one) or write a text editor myself.

It would be nice if someone could also give me a link or tutorial to some basics on how text editors work and the way data is stored.

Edited to add

To clarify, what I wanted to do is instead of saving duplicates of a word make a hash table and store the address where it needs to be placed.

That way I wouldn't be storing the duplicates.

This would have become specific to a particular text editor.

Answer 1

Text is basically stored as-is. i.e., every character takes up a byte or two (wide chars), and there is no conversion done on it when it's saved. It might add an end-of-file character or something though. Don't try coming up with your own algorithm to compress these files. That's why zip-files and other archives were created. They're really good at compressing text. If you wanted to add these feature to your text-editor, you'd have to add some sort of post-save hook to zip it, and then put a hook on the open command to unzip it. Unless you wanted to do it by hand every time. Don't try writing the text editor yourself from scratch, unless (maybe) you're writing notepad. Text editors with syntax highlighting aren't very easy to make, even with the proper libraries. I'd say write a plugin for something like Visual Studio or what have you. Or find an open-source text editor.

Answer 2

I want to use a algorithm to reduce memory used to save the particular text file

If you did this you would no longer have a text editor, but instead you would have created some sort of binary file editor.

The whole point of the text file format is that it is universal, meaning any text file can be open in any other text editor.

Answer 3

thanks everyone I got what all of you'll are trying to say. Anyways all i wanted to do is instead of saving duplicates of a word make a hash table and store the address where it needs to be placed.

This was i wouldn't be storing the duplicates.

Yes and this would have become specific to a particular text editor. never realized that.

Answer 4

Emacs handles compression transparently. Just create a text file with .gz extension. Emacs will automatically compress contents of the file during save operation, and decompress when you open the file next time.