SlideShare a Scribd company logo
Updates on Fake
Object Pipeline
Song Huang (Kavli-IPMU) 

Alexie Leauthaud, Surhud More, Ryoma Murata, 

Claire Lackner, & Steve Bickerton

Special Thanks to the Pipeline Team
Why fakePipe?
?
Fake Galaxy Tests by DES Team
http://arxiv.org/pdf/1507.08336v1.pdf
http://arxiv.org/pdf/1411.0032v2.pdf
ufig+SExtractor
Balrog
https://github.com/emhuff/Balrog
We are on GitHub
https://github.com/clackner2007/fake-sources
https://github.com/clackner2007/fake-sources/blob/master/
doc/fakePipe_manual_v0.3.pdf
We have….something that looks like a manual
Log of Recent Tests
Some Technical Details
• Image simulation using GalSim
• Inject fake object onto single CCD image; Then run hscPipe on
these images.
• Can simulate: Star (using pipeline PSF); Galaxies using
Exponential/de Vaucouleurs/Sersic/Double Sersic models; Can
add g1/g2 shear; 

• Image of fake galaxy is truncated at 10xRe; It will be cropped at
the edge of each CCD; Random Gaussian noise is added. 

• Can help you generate random locations within a Tract; Visit; or a
(RA, DEC) range; Or help you put fakes close to real objects. 

• Will add a FAKE mask plane to the image
What You Need Before Running It
• Have access to computer with hscPipe installed; to HSC data reduced by the
pipeline. 

• Besides GalSim, also depends on Astropy.

• Prepare an input catalog with RA, DEC, and model information for each band (Be
creative)
• Select the Tract/Patch you wan to work on; And find out which Visits contribute to it.
You Need to Remember:
• The test is done using **Perfect** PSF and sky background. 

• Since we have a lot of **fake** objects on the images, we skip the stack.py
(uber-calibration) phase.
Model Selection
Mag Re (arcsec)
Sersic n
b/a
Filter the Fake Objects Through Mask Planes
With BRIGHT_OBJECT Without BRIGHT_OBJECT
It will be much easier to do this with the Random Data
Typical Number of Visits in one WIDE Tract
Create a lot of data…I just deleted all the single Visit data
after the test is done
The FAKE Mask Plane on Coadd Images
Tests using hscPipe 4.0.1
• Based on Yasuda-san’s recent DR_S16A rerun on Master@IPMU

• Only using data in HSC-I, HSC-G, HSC-R
• Using Tract=8766/8767 in WIDE/XMM-LSS

• Input catalog: Claire’s COSMOS catalog down to I_F814=25.2 mag

• Assuming (G-I) = 0.5 mag & (R-I) - 0.0 mag
• Adding 300-400 fake galaxies per Patch 

• 2 additional tests: BRIGHT (mag < 21.5); BLENDED (Fakes close to
real objects)
Star-Galaxy Separation
Magnitude difference between PSF and
cModel magnitudes
~3% of fakes are classified as star:
(classification.extendedness == 0)
“Blendedness” see Ryoma Murata’s talk for more details
Behaviour consistent
with real objects
cModel Magnitude in
HSC-I
cModel fails for ~0.5% of fakes
cModel Magnitude
v.s.
log(cModel (S/N))
Input Magnitude
v.s.
log(cModel (S/N))
Highly blended objects have lower S/N, as expected
cModel Magnitude in
HSC-I
Kron Magnitude in
HSC-I
Kron fails for ~4% of fakes
“Blendedness” and Magnitude Error
(G-I) color
cModel magnitude
Forced photometry
Most of these
faint ones have
b/a = 1.0
The open histograms are for 

galaxies brighter than 21.5 mag
ExpModelDevModel
cmodel.initial
ExpModel
Sersic Index
v.s.
cModel.fracDev
Next Steps
• Make it more efficient…with the help from the
pipeline team.
• Realistic SED/colors for multiband tests.
• More complicated models / Drop outs?
• Anything you want!
Backup Slides
Relative
difference of Re
cModel.ellipse.A
The open histograms are for 

galaxies brighter than 21.5 mag
Relative
difference of Re
Flux.Kron.Radius
The open histograms are for 

galaxies brighter than 21.5 mag
Basic Photometry Star-Galaxy Separation
…..Everything
Remove the “Diffuse” Objects
But……
Updates on the Fake Object Pipeline for HSC Survey

More Related Content

PDF
Streams processing with Storm
PDF
Demonstrating a Pre-Exascale, Cost-Effective Multi-Cloud Environment for Scie...
PPTX
Storm: a distributed ,fault tolerant ,real time computation
PDF
SkyhookDM - Towards an Arrow-Native Storage System
PDF
Running a GPU burst for Multi-Messenger Astrophysics with IceCube across all ...
PDF
Data Science at LHCb
PDF
Burst data retrieval after 50k GPU Cloud run
PDF
NRP Engagement webinar - Running a 51k GPU multi-cloud burst for MMA with Ic...
Streams processing with Storm
Demonstrating a Pre-Exascale, Cost-Effective Multi-Cloud Environment for Scie...
Storm: a distributed ,fault tolerant ,real time computation
SkyhookDM - Towards an Arrow-Native Storage System
Running a GPU burst for Multi-Messenger Astrophysics with IceCube across all ...
Data Science at LHCb
Burst data retrieval after 50k GPU Cloud run
NRP Engagement webinar - Running a 51k GPU multi-cloud burst for MMA with Ic...

What's hot (20)

PDF
SSN-TC workshop talk at ISWC 2015 on Emrooz
PPTX
Reactive Programming and RxJS
PDF
Data-intensive IceCube Cloud Burst
PPTX
Intro to Functional Programming with RxJava
PDF
Analyzing Larger RasterData in a Jupyter Notebook with GeoPySpark on AWS - FO...
PDF
Climate data in r with the raster package
PPTX
Getting to Know Airflow
PDF
Automatic Features Generation And Model Training On Spark: A Bayesian Approach
PPTX
"Building and running the cloud GPU vacuum cleaner"
PDF
QConSF 2014 talk on Netflix Mantis, a stream processing system
PPT
Network simulator 2
PPT
Network simulator 2
PPTX
20150924 rda federation_v1
PDF
Using A100 MIG to Scale Astronomy Scientific Output
PDF
Building Robust Pipelines with Airflow
PPTX
Deep Learning on Aerial Imagery: What does it look like on a map?
PDF
Monitoring Cloud Foundry: Learning about the Firehose
PPTX
PPTX
Airflow - a data flow engine
PDF
My Gentle Introduction to RxJS
SSN-TC workshop talk at ISWC 2015 on Emrooz
Reactive Programming and RxJS
Data-intensive IceCube Cloud Burst
Intro to Functional Programming with RxJava
Analyzing Larger RasterData in a Jupyter Notebook with GeoPySpark on AWS - FO...
Climate data in r with the raster package
Getting to Know Airflow
Automatic Features Generation And Model Training On Spark: A Bayesian Approach
"Building and running the cloud GPU vacuum cleaner"
QConSF 2014 talk on Netflix Mantis, a stream processing system
Network simulator 2
Network simulator 2
20150924 rda federation_v1
Using A100 MIG to Scale Astronomy Scientific Output
Building Robust Pipelines with Airflow
Deep Learning on Aerial Imagery: What does it look like on a map?
Monitoring Cloud Foundry: Learning about the Firehose
Airflow - a data flow engine
My Gentle Introduction to RxJS
Ad

Similar to Updates on the Fake Object Pipeline for HSC Survey (20)

PDF
A tale of two RTC fuzzing approaches
PDF
Integrating the NCBI BLAST+ suite into Galaxy
PDF
Microservices Application Tracing Standards and Simulators - Adrians at OSCON
PDF
k8s-batch-sig_-_Dask_on_Kubernetes.pptx__1_.pdf
PDF
Jose Selvi - Side-Channels Uncovered [rootedvlc2018]
PDF
Deep Learning through Examples
PDF
From Hello World to the Interactive Web with Three.js: Workshop at FutureJS 2014
PDF
PDF
Breaking Parser Logic: Take Your Path Normalization Off and Pop 0days Out!
PDF
Large volume data analysis on the Typesafe Reactive Platform
PDF
How to win data science competitions with Deep Learning
PDF
Cool JVM Tools to Help You Test
PDF
Deep dive into deeplearn.js
PPT
PDF
node.js, javascript and the future
PDF
Spock: Test Well and Prosper
PDF
Angular Advanced Workshop (+ Challenges)
PPTX
Virtual Science in the Cloud
PPTX
How Rackspace Cloud Monitoring uses Cassandra
PDF
Very Large Data Files, Object Stores, and Deep Learning—Lessons Learned While...
A tale of two RTC fuzzing approaches
Integrating the NCBI BLAST+ suite into Galaxy
Microservices Application Tracing Standards and Simulators - Adrians at OSCON
k8s-batch-sig_-_Dask_on_Kubernetes.pptx__1_.pdf
Jose Selvi - Side-Channels Uncovered [rootedvlc2018]
Deep Learning through Examples
From Hello World to the Interactive Web with Three.js: Workshop at FutureJS 2014
Breaking Parser Logic: Take Your Path Normalization Off and Pop 0days Out!
Large volume data analysis on the Typesafe Reactive Platform
How to win data science competitions with Deep Learning
Cool JVM Tools to Help You Test
Deep dive into deeplearn.js
node.js, javascript and the future
Spock: Test Well and Prosper
Angular Advanced Workshop (+ Challenges)
Virtual Science in the Cloud
How Rackspace Cloud Monitoring uses Cassandra
Very Large Data Files, Object Stores, and Deep Learning—Lessons Learned While...
Ad

Recently uploaded (20)

PPTX
Derivatives of integument scales, beaks, horns,.pptx
PPTX
BIOMOLECULES PPT........................
PPTX
TOTAL hIP ARTHROPLASTY Presentation.pptx
PPTX
famous lake in india and its disturibution and importance
PDF
Placing the Near-Earth Object Impact Probability in Context
PPTX
neck nodes and dissection types and lymph nodes levels
PPTX
Microbiology with diagram medical studies .pptx
PPTX
GEN. BIO 1 - CELL TYPES & CELL MODIFICATIONS
PDF
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...
PDF
. Radiology Case Scenariosssssssssssssss
DOCX
Viruses (History, structure and composition, classification, Bacteriophage Re...
PPTX
EPIDURAL ANESTHESIA ANATOMY AND PHYSIOLOGY.pptx
PDF
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
PPTX
2. Earth - The Living Planet Module 2ELS
PDF
The scientific heritage No 166 (166) (2025)
PPT
protein biochemistry.ppt for university classes
PPTX
ECG_Course_Presentation د.محمد صقران ppt
PDF
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
PPTX
Protein & Amino Acid Structures Levels of protein structure (primary, seconda...
PPT
POSITIONING IN OPERATION THEATRE ROOM.ppt
Derivatives of integument scales, beaks, horns,.pptx
BIOMOLECULES PPT........................
TOTAL hIP ARTHROPLASTY Presentation.pptx
famous lake in india and its disturibution and importance
Placing the Near-Earth Object Impact Probability in Context
neck nodes and dissection types and lymph nodes levels
Microbiology with diagram medical studies .pptx
GEN. BIO 1 - CELL TYPES & CELL MODIFICATIONS
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...
. Radiology Case Scenariosssssssssssssss
Viruses (History, structure and composition, classification, Bacteriophage Re...
EPIDURAL ANESTHESIA ANATOMY AND PHYSIOLOGY.pptx
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
2. Earth - The Living Planet Module 2ELS
The scientific heritage No 166 (166) (2025)
protein biochemistry.ppt for university classes
ECG_Course_Presentation د.محمد صقران ppt
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
Protein & Amino Acid Structures Levels of protein structure (primary, seconda...
POSITIONING IN OPERATION THEATRE ROOM.ppt

Updates on the Fake Object Pipeline for HSC Survey