Yahoo Query Language: Select * from Internet

Yahoo Query Language:select * from internetDerek Gathright

var map = new YMap(document.getElementById('map'));…varcurrentGeoPoint = new YGeoPoint( _c.Lat, _c.Lon ); map.addMarker(currentGeoPoint);……if (flickcurl_prepare(fc, "flickr.photos.geo.correctLocation", parameters, count)) { … }…http://search.yahooapis.com/ImageSearchService/V1/imageSearch?appid=YahooDemo&query=Corvette&results=2http://weather.yahooapis.com/forecastrss?p=FRXX0076&u=c

var map = new YMap(document.getElementById('map'));…varcurrentGeoPoint = new YGeoPoint( _c.Lat, _c.Lon ); map.addMarker(currentGeoPoint);……if (flickcurl_prepare(fc, "flickr.photos.geo.correctLocation", parameters, count)) { … }…http://search.yahooapis.com/ImageSearchService/V1/imageSearch?appid=YahooDemo&query=Corvette&results=2http://weather.yahooapis.com/forecastrss?p=FRXX0076&u=cYQLYQL stmt

Why YQL?Thousands of Web Services and sources that provide valuable dataRequire Developers to read documentation and form URLs/queries.Data is isolatedNeeds filtering, combining, tweaking, shaping even after it gets to the developer.

What is YQL?Cloud web service and SQL-Like Language Familiar to developersSynonymous with Data accessExpressive enough to get the right data.Self describing - show, desc tableAllows you to query, filter, join and update data across any structured data on the web / web servicesAnd Yahoo’s sherpa cloud storageReal time engine

YQL Statement Basicsshow: lists the supported tablesdesc: describes the structure of a tableselect: fetches datainsert/update/delete: modify datause: use an Open Data Tableset: define key-values across Open Data Tables

Insert / Update / DeleteWith INSERT/ UPDATE/ DELETESQL verbs you can modify data on the internet or cloudcreate tweets, add blog entries, update DBs etcstore tables or pieces of code in sherpaSome tables with I/U/DTwitter, Bit.ly shortenerYahoo profile status, application update streamAmazon SimpleDB

Demo: developer.yahoo.com/yql/

Open Data Tableshttp://github.com/yql/yql-tables/tree/master

datatables.orgmirrors the master and builds a single environment with all tables (faster serving)

Brings the power of the table model to new APIs

Schema defines mapping between YQL and Endpoint

Keys can either be query, path or matrix parameters

Keys can be marked as required

YQL Compiler validates existence of required keysYQLOpen Data Table example

ODT <execute> elementExtends Open Data Tables with server-side codeJavascript server-side scriptingNo DOM, events etc, pure JS scriptingE4X support - XML literals, filtering ...YQL no longer performs a GET request to the table binding URLYQL provides additional useful global objectsrequest, response, y.rest, y.include, y.query...Execute tag must return the data that will be the output of the YQL selectMove business logic of your application to the cloud

What you can do with <execute>access APIs that require authenticationNetflix OAuth, FlickrAuth, Google AuthSubjoin data across servicesgrab New York Times article tags and generate find associated flickr photoscombine multiple searches into a single result (twitter, web, news and images)augment data:city/state to APIs that just return zip codecreate APIs from web pagecelebrity birthdays scraped from imdb, caltraindata transformationconvert the result from xml to Google's kml format

hello world<table xmlns="http://query.yahooapis.com/v1/schema/table.xsd"><meta> <sampleQuery>select * from {table} where a=’hello' and b=’world';</sampleQuery></meta><bindings><select itemPath="" produces="XML"><urls><url>http://fake.url/{a}</url></urls><inputs><key id='a' type='xs:string' paramType='path' required="true" /><key id='b' type='xs:string' paramType='variable' required="true" /></inputs><execute><![CDATA[// Your javascript goes here. We will run it on our serversresponse.object = <item><url>{request.url}</url><a>{a}</a> <b>{b}</b> </item>; ]]></execute> </select> </bindings></table>

Scraping a page<select produces="XML" itemPath="deals.deal"> <urls><url>http://deals.yahoo.com</url></urls> <execute><![CDATA[vardealhtml = y.query("select * from html where url='http://deals.yahoo.com' and xpath='//div[contains(@class, \"product-display\")]'").results;var deals = <deals/>;function compress(object) { if (!object) return ""; return object.toString().replace(/\s+/, " ")}for each (var div in dealhtml.div) {var deal = <deal/>;deal.name += <name>{compress(div.h3.a.text())}</name>;deal.link += <link>{div.div[0].a.@href}</link>;…deal.description += <description>{compress(div.p[0].*)}</description>;deal.logo += <logo>{compress(div.div[1].*)}</logo>;deals.deal += deal;}response.object = deals; ]]></execute> </select>

Twitter Selectselect *from twitter.statuswhere id="2108869549"andusername="xxx"and password="yyy”<select itemPath="" produces="XML"> <urls><url>http://twitter.com/statuses/show/{id}.xml</url></urls> <inputs> <key id="username" type="xs:string" required="false" paramType="variable"/> <key id="password" type="xs:string" required="false" paramType="variable"/> <key id="id" type="xs:integer" required="true" paramType="path"/> </inputs> <execute><![CDATA[varr = null; if (username && password) { y.include("http://yqlblog.net/samples/base64.js");varauthheader = "Basic "+Base64.encode(username+":"+password);r = request.header("Authorization",authheader).get().response; } else {r = request.get().response; }response.object = r; ]]></execute></select>

Yahoo Query Language: Select * from Internet

More Related Content

Viewers also liked (20)

Similar to Yahoo Query Language: Select * from Internet (20)

Recently uploaded (20)

Yahoo Query Language: Select * from Internet