Connect Bigquery with python

박이삭
2019-09-03
BigQuery With Python

• Query 조회
• 배치 자동화
• 기계학습
Python with Bigquery BigQuery with Python
• Storage Upload
• 테이블 생성 자동화

pip install --upgrade google-auth
pip install --upgrade google-cloud-bigquery
pip install pandas-gbq
2019-08-23 기준 Anaconda에서 잘 작동됨.

• 빅쿼리에서 다운받은 key파일
• 이후 예시부터는 공식 홈페이지에 있는 예시를 이용했습니다.

from google.oauth2 import service_account
from google.cloud import bigquery
import pandas_gbq
cred_path = 'D:데이터분석BigQuerybigquery_IAM_key.json'
credentials = service_account.Credentials.from_service_account_file(cred_path)
client = bigquery.Client(credentials= credentials, project=＇프로젝트 이름')
sample_qry = '''
SELECT name FROM `bigquery-public-data.usa_names.usa_1910_2013`
WHERE state = "TX"
LIMIT 100
'''

df = client.query(sample_qry).to_dataframe()
df.head()
방법 1

방법 2
df_pandas = pandas_gbq.read_gbq(query=sample_qry,
project_id=＂프로젝트 이름",
credentials= credentials)

방법 3 – 변수 활용
def var_qry(state):
qry = f'''
SELECT name FROM `bigquery-public-data.usa_names.usa_1910_2013`
WHERE state = "{state}"
LIMIT 100
'''
return qry
df_pandas_var = pandas_gbq.read_gbq(query=var_qry(state='TX'),
project_id="프로젝트 이름",
credentials= credentials)

Connect Bigquery with python

More Related Content

What's hot (20)

Similar to Connect Bigquery with python (20)

Connect Bigquery with python