How do I create a search engine like Google, bing etc.?

User profile picture
Aleph
Moderator
Posts: 39
Joined: 11 months ago

11 months ago

i want to create a search engine like that of Google or say bing.
but im kinda lost on the type er languages or algorithms that would best force performing this?

secondly are there any open source applications I can use, study, or adapt to perform these functions?

any usefull ans would be much appropriated please..



User profile picture
RuggedKross
Posts: 101
Joined: 11 months ago

11 months ago

Kleph wrote:i want to create a search engine like that of Google or say bing.
but im kinda lost on the type er languages or algorithms that would best force performing this?

secondly are there any open source applications I can use, study, or adapt to perform these functions?

any usefull ans would be much appropriated please..
You need to study articles like this (Google tech papers)
the concept of their own search engine is detailed there.

User profile picture
Isaiah
Keymaster
Posts: 101
Joined: 1 year ago

11 months ago

Hello Kleph,

Basically you'll need things like:

Afull text search engine to store and index data(s).

A web interface for querying the full text index

a web crawler (spider) which collects the content of web pages parsing the HTML and following links

If you're familiar with .NET, you could look at this implemetation and series of articles:
@
http://www.codeproject.com/Articles/339 ... N-jQuery-S

If you seriously want to do this, then you'll need a lot of resources in form of bandwidth and disk space to acquire and store all the data.

User profile picture
Aleph
Moderator
Posts: 39
Joined: 11 months ago

11 months ago

Hmm, thanks for your concerns,
but this whole idea seems mission impossible already.

Post Comment Previous topicNext topic