Question for the experts of /g/: >there's a bunch of

there's a reason Google sorts and omits over half of the "relevant" searches
What you're describing is essentially what was wrong with 90's search engines; too many people trying to include everything they can and ending up with a pile of garbage the client them self has to sort through
The point of a search engine is that it searches for you, and gives you what might be the most relevant site, not giving you 1000 sites that mentioned your keyword at some point

>>57592962
I'm not talking about a search engine utility.

Here's a good example of what I'm getting at with a totally different pretext:
>people go fishing in their secret spots
>every now and then, fisherman upload text files indicating where their secret spot is
>there's 7 websites that scan the web looking for these text files
>you can query these 7 websites by typing in your location, suburb, region or state; to see if there's any secret fishing spots nearby
>currently, these websites have varying amounts of data and different results
>I want to create a platform whereby you can automatically search all 7 websites for results

is this a little more clear?

>>57593045
I think I understand, what I'm saying is why? The point is to get better and less search results, not more and worse results

>>57593045
>scan the web
Also I'm not sure if you understand how most search engines work, you're not gonna get "deeper" results without going to specific databases not catalogued by major search engines (which is essentially all of them)

>>57593045
Sounds like the exact same scenario, just with fish, and told in an autistic and inefficient manner
What are you asking?

>>57593131
No, these closed source databases are not catalogued by search engines. Their front-end websites are though.

For example, if you simply googled the strings I'm aiming to find, you would not get them.

If you went to any of the websites who've catalogued them in their private databases and searched it there, you would get them.

What I simply need to know is what's the best way to go around automating the process to automatically run a search query through some website's built in search function

Jesus fucking christ you're all autists, why are you so difficult to deal with? Like instead of answering a fucking question you used even more effort and time from your day to point out why you think it's flawed (from your entirely misinterpreted understanding, too).

I thought you neckbeards were meant to be efficient & pragmatic for fucks sake.

Please, do get laid.

>>57594023
Fuck off, you are obviously too stupid for programming.
What you want to achieve is a simple python program of a few lines.
If you can't achieve it by yourself, give up.