search-engine

ASP.NET KB system / search engine

Our company has a "MyAccount" where we would like to put a knowledge base behind. We have a CRM system where the help calls are recorded and some knowledge base articles are written into the database. The master problem (same basic help call) is tagged with keyword(s). We also have CHM help files for the software we sell (some users n...

Search engine to integrate in a .NET stack

I am looking for a very robust software search engine to integrate in a .Net web site. The current proposed solution is Lucene.NET a stack based on Lucene. However, I would like to evaluate other search engines before making my mind up. The feature set we need is the following: Ability to crawl arbitrary pages via HTTP Ability to pa...

Slow down spidering of website

Is there a way to force a spider to slow down its spidering of a wesbite? Anything that can be put in headers or robots.txt? I thought i remembered reading something about this being possible but cannot find anything now. ...

What are cons to not to use <meta name="keywords" content="some, words" />

If i only use <meta name="description" content="lorem impsum." /> I heard search engines does not give importance to Keywords. <meta name="keywords" content="some, words" /> So is it ok to not to use Keywords? ...

mysql return table name

let's say i have this mysql table structure: table : articles ---------------- id content table : news ------------ id news is there a way to search for a string in this two tables and then if the string occurs to return the table's name and the row id ? ...

Search engine indexing flash website ?

I am working on a website completely designed in Flex (flash).Can you please help suggesting whether search engines (like google/bing) can index flash content or not.If not then how do the websites made entirely in flash make themselves available on these search engines. Thanks for your help. ...

Building search to the website

I have a website which has about 200 to 300 static public pages. I am required to bring about some kind of search functionality on the website which will search all of its public pages. I don't want to use external tools like Google site search, etc. Is there a tool or open source code that will index the content and then display the sea...

Google Search Appliance (Google mini) for startups

Is Google Search Appliance a good fit for a startup like Stackoverflow (just an example)? How does it fare? I haven’t seen many examples or talk about this device being used in the startup circles. I need enhanced search experience with capabilities like stemming, spell check, relevancy, easy of indexing and retrieving and complete cust...

What effect does prefixing a title attribute with "blocked::" have on a link?

I have noticed that some websites prefix the titles of their links with blocked::. For example: <a href="http://www.a-url.com" title="blocked::http://www.a-url.com"&gt;www.a-url.com&lt;/a&gt; I have questions about how this affects browsers and search engines: Is this meant to have some effect on the browser? If so, what is the int...

Allow SE indexing on index.html only.

What would be the shortest method to block * and only allow just Major Search Engines to index the index page of the site only? User-agent: * Disallow: / User-agent: Googlebot Disallow: / Allow: index.html User-agent: Slurp Disallow: / Allow: index.html User-agent: msn Disallow: / Allow: index.html Would this work? ...

Does a Search engine rate the alt attribute on image tags?

Do search engines rate also the alt atribute in image tags? In my opinion the alt attribute was for blind peoples. ...

How to identify blog engine ?

I am writing a search engine whose purpose it is to search all kind of blogs for specific kinds of content. I'm particularly focusing on these blogs engines: Blogger LiveJournal MySpace Open Diary Tumblr TypePad Windows Live Spaces Wordpress.com Xanga Now my question is: Is there any way I can use google to find links that are from a s...

Designing a one EVERYTHING search box (date+address+keywords)

Hi! I'm storing information about local "events". They are described by 3 things - address, date, keywords(tags). I want to have only one search box for at least address and keywords. The date might go to a separate field. I'm assuming that most people will search for events that are taking place "today" so this filter won't get that mu...

Linq to SQL Search Query

Hey, I have a table of news, and I want to allow the user to search in it. Something like this: News.Where(p => p.Title == user_query); ...that will allow more advanced queries, like Differences Between "Linq to Objects" and "Linq to SQL" queries, etc. Also it should be incase-sensitive. Any ideas? Thank you. ...

Making sure googlebot is not spamming my mailbox

I have got a website running with an option to report abuse of functionality. This is being done by clicking a link. After the link is clicked the webmaster will get a report of the location where the content is that was reported as abuse. I have added an rel="NOFOLLOW" to the href of the particular links but this is not helping. It seem...

Prevent bot from crawling certain areas of site.

Hey, I don't know much about SEO and how web spiders work, so forgive my ignorance here. I'm creating a site (using ASP.NET-MVC) which has areas that displays information retrieved from the database. The data is unique to the user, so there's no real server-side output caching going on. However, since the data can contain things the us...

Django Haystack : search for a term with and without accents

I'm implementing a search system onto my django project, using django haystack. The problem is that some fields in my models have some french accents, and I would like to find the entries which contents the query with and without accents. I think the best Idea is to create a SearchIndex with both the fields with the accents, and the sam...

Best strategy to build custom batch search engine?

Hi I need to build a site similar to indeed.com and so many others, that tracks a number of advertising sites and parses the HTML to list the ads in my own site. I know that each source-site needs a particular strategy. That's no problem. My concern is that I want to scan the sites hourly in a batch-fashion. Is there a better suitable...

MS Search Server - ConfigurationException

Im getting a ConfigurationException whenever i try to perform QueryService.Query or QueryService.ExQuery. Same goes when i do GetSearchMetadata(). I can however do a GetPortalSearchInfo() and Status() without problems. Any hint of what can cause the problem? ...

How to determine search query forwarding user to my website?

Greetings, I'm trying to work out what query is being used to forward people to my website. I'd appreciate it if anyone could tell me what api call I should be looking into. I'm sure this is possible with javascript as well as ruby and php so any technology is fine. Just for learning sake I don't mind know what I should be using for ...