Asked  7 Months ago    Answers:  5   Viewed   49 times

Google Web Search API has been deprecated and replaced with Custom Search API (see http://code.google.com/apis/websearch/).

I wanted to search the whole web but it looks like with the new API only custom sites can be searched.

Is there a way to search the whole web programmatically? I was able to query the old API using JSON from a Java program.

 Answers

21

You could just send them through like a browser does, and then parse the html, that is what I have always done, even for things like Youtube.

Tuesday, June 1, 2021
 
LoicTheAztec
answered 7 Months ago
16

It was missing the header field X-Ios-Bundle-Identifier.

NSString *bundleID = @"com.yourCompany.yourApp";
//...define request as above
[request setHTTPMethod:@"GET"];
[request setValue:bundleID forHTTPHeaderField:@"X-Ios-Bundle-Identifier"];
Thursday, August 5, 2021
 
Kai
answered 5 Months ago
Kai
88

There definitely are.

Here are two open source and free solutions that are very polished:

Piwik - Designed as a direct competitor to Google Analytics (it looks just as nice) that you host on your own servers

Open Web Analytics

Wednesday, August 11, 2021
 
Denis
answered 4 Months ago
85

Yes, you can sort and filter on custom meta tags.

First, put the data you want to filter on into meta tags: <meta name="color" value="blue">

Next, test that Google can find the tags by testing your URL with the Rich Snippet Tool Under the 'Structured data for filtering search results', you should see more:pagemap:metatags-color:blue.

Finally, query your custom search engine with the structured data string above. Putting more:pagemap:metatags-color:blue in the search box works, or use it with your query parameter (usually q) in the URL.

For numeric meta tags, you can sort with sort=more:pagemap:metatags-sales_rank (or whatever your attribute is).

To search on page title it should work to use Google's standard intitle: operator.

Saturday, August 28, 2021
 
lechup
answered 4 Months ago
15

I am going to briefly address each area for three popular Python frameworks. This is only based on my personal experiences and observations.

Development speed and convenience

For TurboGears, Pylons, and Django, development speed is roughly equal. Being modern frameworks, it's easy to get started on a new site and start throwing together pages. Python is famously fast to develop and debug and I would put any Python framework as having a shorter development time than any other setup I've worked with (including PHP, Perl, Embedded Perl, and C#/ASP.Net).

Barriers to entry - developer training and infrastructure

If you know Python and are willing to watch a 20 minute video tutorial, you can create a fairly complete wiki-type site from scratch. Or you can walk through a social-bookmarking site tutorial in 30 minutes (including installation). These are TurboGears examples but the other two frameworks have nearly identical tutorials as well.

The test/development infrastructure that comes out of the box with these frameworks is generally enough to complete most sites. At any point, you can swap out components to meet your production environment requirements. For example, SQLite is fine for setting up your models and loading test data, but you will want to install MySQL (for example) before going live or storing large amounts of data.

In all cases, the requirements are very low and dictated entirely by your scalability requirements and not any peculiarities of the framework. If you are comfortable with a certain template language or ORM, it will probably plug right in.

Lock-in

This is a generalized problem across all frameworks. When you select a language, you limit your code-reuse options. When you select a templater, you are again locked in (although that's easier to change, in general, than other things). The same goes for your ORM, database, and so on. There is nothing these frameworks do specifically that will help or hinder lock-in.

Flexibility

It's all about MVC with these three frameworks. As you said, that's a very different discussion!

Performance, scalability, and stability

Well, if you write good code, your site will perform well! Again, this is a problem across all frameworks addressed by different development techniques and is probably way outside the scope of this answer.

Monday, September 20, 2021
 
Mountains
answered 3 Months ago
Only authorized users can answer the question. Please sign in first, or register a free account.
Not the answer you're looking for? Browse other questions tagged :  
Share