search-engine

Getting around the b/s with SEO..

Being a web developer for awhile, I've grown a huge distrust in SEO gurus etc. Most of what they say is just hearsay that no one can really prove. And at this point, I would take a lot of pride in calling them out on their deprecated b/s. :D Does anyone know a source of solid SEO information I can find? ...

Represent the search result by adding relevant description

hi, I'm developing simple search engine.If I search some thing using my search engine it will produce the list of urls which are relating with that search query. I want to represent the search result by giving small,relevant description under each resulting url.(eg:- if we search something on google,you can see they will provide small ...

List of relationship. HTML

I know nofollow tells search engines not to give credits to the link. And me means the link is a profile belonging to a user. What are other relationship (rel tag) that are used by search engines? Where can i get a list of rel and their meaning? ...

the best search engine written with python

i want to build an information support system which is an web app. and we gonna use Django as the frame,but i don't know which search engine to use ? can you give me some suggestions on the search engine which we can use in our project,it must be written with python. thanks ...

Xapian Vs Sphinx performance comparison ?

Can you guys point me out performance difference between Xapian and Sphinx ? In terms of indexing and search? Currently i am using Sphinx and i am loving performance of it , but i read that Xapian have Indexer for many documents (Word/PDF/manyy) . ...

Marking up a search result list with HTML5 semantics

Making a search result list (like in Google) is not very hard, if you just need something that works. Now, however, I want to do it with perfection, using the benefits of HTML5 semantics. The goal is to define the defacto way of marking up a search result list that potentially could be used by any future search engine. For each hit, I w...

Bespoke Search Engine Development

I currently use Google’s Custom Search for my site search requirements. The site is small with only 250 pages or so but I would like to have an ‘easy to use’ bespoke search facility. Can you give me some indication as to what is would cost to develop such a search engine. ...

Simple rating algorithm to sorting results according to user query

Hi, I'm developing a very basic web search engine that has several parts. After retrieving results according to a user query, I want to calculate rate of each result and then sort results by calculated rate. Here is my query: var tmpQuery = (from urls in _context.Urls join documents in _context.Documents ...

PHP based Business/Product Directory App with CRM backend?

I'm involved in a project whose goal is to create a web based portal to allow consumers to to search a database of local services. The services are to be organized in categories, but raw search is also to be provided and should lead to a flexible presentation of the relevant services and also some "premium listings" in addition to organi...

How to prevent search engine indexing of common utility words without JS

Google thinks my site is about ago, cancel, and edit. This is because those words appear on every comment. Why am I the only site who seems to suffer from this problem? In fact, if you search Google for the words ago, cancel, and edit (without quotes), my site comes up in the #2 spot (right below Stack Overflow in spot #1). Even if Goog...

How to implement search layer for Ruby on Rails site?

We are implementing a product review site using Ruby on Rails. Search is a core component of the user experience. We need to make searches fast and relevant. Should we use Lucene or another open source search layer? Should we use Google's search API and index against only our site? Or should we develop proprietary search functionali...

iFrames - how do search engines read them?

Hey, I know that search engines base part of the calculation of rankings on how many other sites point to a specific site, so I was just wondering, given the following situation: http://siteA/page.aspx contains an iFrame. This iFrame points to http://siteB/script.aspx?url=http://siteA/page.aspx. http://siteB/script.aspx generates a li...

Non-indexed file (?) still found in Google

How is it possible that my page /admin/login.asp is found in Google with the query "inurl:admin/login.asp" while it isn't with the "site:www.domain.xx" query? I've this line of code in my robots.txt: User-agent: * Disallow: /admin/ And this in the HTML code of the page: <meta name="robots" content="noindex, nofollow" /> Any ideas?...

PHP URL submitter

Can anyone please provide example how can submit URL to search engines by PHP? ...

search engine not going to correct url

Hi Guys, I have a site that when i search in google (ifiwereyou.co.uk) it takes me to a 123reg holding page. (it works fine in most other search engines) This is beacause google is showing the url as http://ifiwereyou.co.uk rather than http://www.ifiwereyou.co.uk Is this being caused by a missing dns entry or is there a way i can s...

Data structure for a search engine?

Which is the most efficient data structure or algorithm, which can be used for storing search engine data. Also which distributed file system could go with it? ...

Storing URLs with keywords - what's the best approach?

Hello all, I am developing a component that stores URLs and maintains a certain set of keywords associated with these URLs. For example- URL: http://www.imdb.com Keywords: search, movies, movie-index, reviews The keywords themselves are not restricted by number. The number of urls may be huge in number ranging between 10K to 100K. Wha...

optimizing google search

Hi, What are the tricks and tips one should follow to search in google for exactly getting the relevant search. I have heard and used about google hacks but still having a lot of problem in searching the relevant data on google or any other search engine. ...

Is there any python lib to scrape search engine(S) results?

I am looking for a python library to scrape results from search engines (google, yahoo, bing, etc). I only found for google -> http://github.com/kevinw/xgoogle/tree/253db7ddc8603a9dcb038ae42684cf3499a22a4b Does someone knows one for multiple search engines? ...

What should be the initial list of urls for a crawler to start its work

I want a list of urls from where my crawler can start crawling efficiently so that it can cover a maximum part of web. Do you have any other idea to create initial index for different host. Thanks you ...