indexing

Indexing strategy on table

I have an SQL Server 2005 table named 'EventTable' defined as such: EventID, EventTypeCode, EventStatusCode, EventDate Currently the table has a clustered index on the primary key 'EventID', there are no other indexes currently EventTypeCode and EventStatusCode columns are CHAR(3) (examples are 'NEW', 'SEN', 'SAL') and are foreign key...

[SQL 2000] To Index or Not to Index

I have a database that I used specifically for logging actions of users. The database has a few small tables that are aimed at specific types of actions. This data is rarely searched, but the rowcounts of the tables are starting to climb into multi-millions. I haven't noticed a large slow down, but I want to know if indexing the table fo...

SQL Server: Listing all indexes

I'm wondering what the simplest way to list all indexes for all tables in a database is. Should I call sp_helpindex for each table and store the results in a temp table, or is there an easier way? Can anyone explain why constraints are stored in sysobjects but indexes are not? ...

Data structure or algorithm for second degree lookups in sub-linear time?

Is there any way to select a subset from a large set based on a property or predicate in less than O(n) time? For a simple example, say I have a large set of authors. Each author has a one-to-many relationship with a set of books, and a one-to-one relationship with a city of birth. Is there a way to efficiently do a query like "get all...

Thinking Sphinx indexing non-expired records.

What would be the best approach to have Thinking Sphinx only index records where Today's date is less than or equal to the record's "expires_at" field? Thanks in advance. ...

SQL Server Index Dependency

I'm considering dropping an index from a table in a SQL Server 2005 instance. Is there a way that I can see which stored procedures might have statements that are dependent on that index? ...

Searching large data, all numeric, 1 billion bytes in PHP

I was wondering how I could quickly search a data string of up to 1 billion bytes of data. The data is all numeric. Currently, we have the data split into 250k files and the searches using strpos (fastest built-in function) on each file until it finds something. Is there a way I can index to make it go faster? Any suggestions? Eventuall...

How to access keywords for files generated by desktop search engines like Windows Search or Copernic Desktop Search

Dear Folks, I am trying order the files on a common fileshare of my department, containing thousands of documents of various filetypes. My idea was to sort them by content-related keywords. Only few files contain valid info in the keywords file attribute provided by Windows. My idea was to let some desktop search engine index the files ...

How can I speed up this SQL query on MySQL 4.1?

I have a SQL query that takes a very long time to run on MySQL (it takes several minutes). The query is run against a table that has over 100 million rows, so I'm not surprised it's slow. In theory, though, it should be possible to speed it up as I really only want to get back the rows from the large table (let's call it A) that have a r...

Thoughts on index creation for SQL Server for missing indexes

I'm working on performance tuning my SQL Server 2008 database and am using the output from various DMVs to identify missing indexes, indexes that aren't being used, etc. I am mainly using these 3 scripts (from SQLServerCentral.com) that rely on DMV data that SQL Server provides: The Ultimate Missing Index Finder The Ultimate Duplicate...

SQL: Get value at index in binary value

Is there a SQL command that could be used in a query, stored procedure, function, that would work against a Binary Type similar to the following C# code? if (someBinaryArray[index] == 0) { ... I'm wanting to check if an index of a position in the binary is a certain value instead of pulling the entire array down and doing the compari...

Adding ORDER BY clause to MySQL query makes it return in ~30 seconds, up from ~0.5

So I have this query that is relatively fast at ~0.5 seconds but when I add an ORDER BY clause it jumps up to nearly 30 seconds. Original query: (returns in ~0.5 seconds) SELECT table1.*,table2.* FROM table1 LEFT OUTER JOIN table2 ON table1.column2=table2.column3 WHERE table1.column1='value' LIMIT 4 Query with ORDER BY: (returns in ~...

Is it dangerous to leave your Django admin directory under the default url of admin?

Is it dangerous to have your admin interface in a Django app accessible by using just a plain old admin url? For security should it be hidden under an obfuscated url that is like a 64 bit unique uuid? Also, if you create such an obfuscated link to your admin interface, how can you avoid having anyone find out where it is? Does the goo...

How do you determine the size of an index in SQL Server?

I have an index -- let's call it IX_MY_INDEX -- in a SQL Server table (both compatibility modes 80 and 90) that I would like to determine the size of. How do I do this? Update: Allain Lalonde's second solution below only works when the compatibility mode is set to 90; however, the particular database I am working on is in compatibility ...

sql primary key and index

Say I have an ID row (int) in a database set as the primary key. If I query off the ID often do I also need to index it? Or does it being a primary key mean it's already indexed? Reason I ask is because in MS SQL Server I can create an index on this ID, which as I stated is my primary key. Edit: an additional question - will it do any ...

Office iFilter and Embedded Documents

Hello, Does office iFilter (offfilt.dll) support extracting content from embedded documents i.e. Excel Spreadsheet or PowerPoint in Word? If not, do you know if other iFilters do? Thanks, Kesha ...

Are UNIQUE indices case sensitive in MySQL?

Are indices (indexes) defined as UNIQUE case sensitive in MySQL? ...

How to update a Lucene.NET index?

I'm developing a Desktop Search Engine in Visual Basic 9 (VS2008) using Lucene.NET (v2.0). I use the following code to initialize the IndexWriter Private writer As IndexWriter writer = New IndexWriter(indexDirectory, New StandardAnalyzer(), False) writer.SetUseCompoundFile(True) If I select the same document folder (containing file...

[LUCENE.NET] How to use a field from Index to delete an entry?

I'm developing a Desktop Search Engine in VB 9 using Lucene.NET I wish to delete and create a new entry for a file that is updated. The Index stores complete file path and the last modified date. doc.Add(New Field("path", filepath, Field.Store.YES, Field.Index.UN_TOKENIZED)) doc.Add(New Field("modified", New FileInfo(filepath).LastWri...

Adding a index on my table for this query

This table gets hit with this query the most, so I want add a index to speed things up, this table will have 5 million rows it in. My query looks like this: SELECT someID FROM someTable WHERE myVarChar = @myVarChar AND MyBit = 0 AND MyBit2 = 1 AND MyBit3 = 0 myVarChar is unique also. What would the best index be for this t...