Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
projects:kids:atlas [2015/04/14 14:53]
emhelmich
projects:kids:atlas [2016/06/17 14:37] (current)
gverdoes
Line 7: Line 7:
  
 == Status (last update 14 Apr 2015) == Status (last update 14 Apr 2015)
 +
 +See [[https://​docs.google.com/​presentation/​d/​1_LWxm17k6fAFb2w3nbjMmksYNXCNXp3Ed-yVlmD3cF8/​edit?​usp=sharing | ATLAS slides]]
  
 We are producing u,g,r,i (not z!) ATLAS coadds re-using/​adapting the KiDS pipeline.  ​ We are producing u,g,r,i (not z!) ATLAS coadds re-using/​adapting the KiDS pipeline.  ​
 +
 +== Gaps in coadded data
 +
 +Gaps between CCDs; in the release notes of ATLAS {{:​projects:​kids:​atlas_dr1.pdf|}}:​ is written that in data observed before November 2011 the vertical gaps between the CCDs are not always filled in well because of the way the observations were executed. I suppose this is what you are seeing.
 +
 +== South-West secondary star diagnosis
 +
 +Matt Owers notes:
 +- The issue I noted earlier with the small secondary star ~2" to the
 +southwest of brighter stars only appears in one g-band image. It is odd
 +that the secondary star is not the same brightness as the standard and I
 +can't really think what might cause this.
 +
 +[[http://​quality.astro-wise.org/​QualityWISE?​object_str=CoaddedRegriddedFrame&​object_id=1360ba421d1f42f1e053c016a9c3851e&​project=ATLAS | example case, g-band ATLAS data with  rawfitsdata with DATE-OBS=set([datetime.datetime(2011,​ 9, 25, 1, 9, 10), datetime.datetime(2011,​ 9, 25, 1, 7, 35)])
 +]]:
 +
 +
 +**Diagnosis**:​ poor image quality in raw science exposures. 3 Figures below show a zoom in on an area in the example case:
 + 
 +{{:​projects:​kids:​coaddatlas.png?​800|Coadded calibrated image}}
 +{{:​projects:​kids:​rawfits1.png?​800|RawFitsData exposure 1}}
 +{{:​projects:​kids:​rawfits2.png?​800|RawFitsData,​ exposure 2}}
 +
 +The RawFitsData with the "​secondary star" has DATE-OBS=2011-09-25T01:​09:​10.066.
 +
 +**DETECTION**:​ most direct on RawScience. Probably using PSF anisotropy (high ellipticity with fixed PA) information. In absence of PSF anisotropy information of RawScienceFrames on can look at it for a [[http://​quality.astro-wise.org/​QualityWISE?​object_str=ReducedScienceFrame&​object_id=12D50F3E66484BB3E053C016A9C3FF8A&​project=ATLAS&​progenitors=1#​progenitors | ReducedScienceFrame with 
 +DATE-OBS=2011-09-25T01:​09:​10.066]]. ​
 +
 +{{http://​ds.astro.rug.astro-wise.org:​8000/​QC-JMCFARLAND-OMEGACAM-------OCAM_g_SDSS-ESO_CCD_%2396---PSF_Anisotropy-ReducedScienceFrame-57115.6735075-04b68968a6ed53483c0909d1c30538bcb0d3753e.png?​800}}
 +
 +**ASTROMETRY NOTE**: this appears as one reason for bad astrometric residuals. See the correlated global astrometric parameters in the [[http://​quality.astro-wise.org/​QualityWISE?​object_str=CoaddedRegriddedFrame&​object_id=1360ba421d1f42f1e053c016a9c3851e&​project=ATLAS | example case, g-band ATLAS data with  rawfitsdata with DATE-OBS=set([datetime.datetime(2011,​ 9, 25, 1, 9, 10), datetime.datetime(2011,​ 9, 25, 1, 7, 35)])]].
  
 == ATLAS tiles mapping onto Astro-WISE classes == ATLAS tiles mapping onto Astro-WISE classes
 +
 +(work in progress by Gijs)
 +
 +Goal: define units of data for ATLAS in the same way as for KiDS. This ensures that whatever script/​approach we develop that works on one will work for the other. ​
  
 First the ATLAS observing strategy: ​ First the ATLAS observing strategy: ​
Line 20: Line 57:
 * Observations before 2011-10-31: more a mess. We are considering to clean it by creating manually same mapping as >​2011-10-31 * Observations before 2011-10-31: more a mess. We are considering to clean it by creating manually same mapping as >​2011-10-31
  
 +KiDS survey operations handle on units of data:
 +   * survey tile: data from all bands with a tile as defined by the survey. Example is the handling of multi-band productions (mult-band catalogs) and analysis (stellar locus, QSO/galaxy selection in color-color space)
 +   * ObservingBlock:​ all exposures that go into data from a single band. Example is the creation of coadded images and source extraction of those.
 +   * Template?
 +   * Exposure: a single exposure. ​
 +
 +For KiDS the mapping from survey tile to observing blocks to templates and exposures is straightforward:​
 +   * survey tile->​observing blocks: the tilename can be inferred from the observingblock name
 +   * observingblock->​exposures:​ all exposures have as observingblock dependency the observing block. NB: there exist no additional exposures with that observingblock as dependency.
 +
 +For ATLAS>​2011-10-31
 +   * survey tile -> observing blocks: the tilename can be inferred from the observingblock name
 +   * observingblock->​exposures:​ all exposures have as observingblock dependency the observing block. NB: there exist no additional exposures with that observingblock as dependency.  ​
  
 == Validation set: tile overlapping with SDSS == Validation set: tile overlapping with SDSS
Line 116: Line 166:
 == Coadd QC == Coadd QC
  
-Report 2015-04-14: QC of 225 ATLAS coadds in SAMI cluster regions+Report 2015-04-16: QC of 207 ATLAS coadds in SAMI cluster regions
  
 ^  QC check  ^  Nr OK  ^  Nr NOK  ^ ^  QC check  ^  Nr OK  ^  Nr NOK  ^
-| Cross-talk ​ |  ​225  ​| ​ 0  | +| Cross-talk ​ |  ​207  ​| ​ 0  | 
-| Bg subtr. ​ |  ​220  ​|  ​10  | +| Bg subtr. ​ |  ​206  ​|  ​ | 
-| Calibrations ​ |  ​221  ​|  ​ | +| Calibrations ​ |  ​207  ​|  ​ | 
-| Astrom ​ |  ​181  ​|  ​49  | +| Astrom ​ |  ​162  ​|  ​45  | 
-| Photom ​ |  ​230  ​| ​ 0  | +| Photom ​ |  ​207  ​| ​ 0  | 
-| PSF difference ​ |  ​216  ​|  ​14  | +| PSF difference ​ |  ​196  ​|  ​11  | 
-^ Overal verdict ​ ^  ​151  ​^  ​74  ^ +^ Overal verdict ​ ^  ​156  ​^  ​51  ^
- +
-7 pointings have multiple coadds: +
-4 x 2 coadds +
-1 x 3 coadds +
-1 x 4 coadds +
-1 x 6 coadds+
  
 **Astrometry statistics** **Astrometry statistics**
Line 138: Line 182:
  
 Data points: blue = u; green = g; red = r; magenta = i Data points: blue = u; green = g; red = r; magenta = i
-Dashed lines: QC limits ​used for KiDS coadds+Dashed lines: QC limits ​adopted in qcCoadd_ATLAS.py
  
 **PSF sizes and size variations** **PSF sizes and size variations**
Line 150: Line 194:
  
 [[http://​dbview.astro-wise.org/​DbView?​project=ATLAS&​set_cookie=&​QSort=&​QDesc=descending&​2ndQSort=&​2ndQDesc=descending&​numrows=rownum&​fcontext_project_only=on&​show_expanded=no&​Exportselect=NoDownload&​class_str=CoaddedRegriddedFrame&​mode=table_res&​depth=1&​python_dict=%2528dp0%250AS%2527query%2527%250Ap1%250A%2528dp2%250AsS%2527expanded%2527%250Ap3%250A%2528dp4%250AS%2527CoaddedRegriddedFrame%2527%250Ap5%250A%2528lp6%250AS%2527open%2527%250Ap7%250AaS%2527root%2527%250Ap8%250Aag5%250AasS%2527CoaddedRegriddedFrame.instrument%2527%250Ap9%250A%2528lp10%250AS%2527prefilled%2527%250Ap11%250AaS%2527link_property%2527%250Ap12%250AaS%2527Instrument%2527%250Ap13%250AasS%2527CoaddedRegriddedFrame.filter%2527%250Ap14%250A%2528lp15%250Ag11%250AaS%2527link_property%2527%250Ap16%250AaS%2527Filter%2527%250Ap17%250AassS%2527derived%2527%250Ap18%250A%2528dp19%250As.&​expanded_leaf=&​expanded_leaf_type=&​expanded_leaf_class=&​derived_leaf=&​node_state=&​CoaddedRegriddedFrame.expanded=open&​CoaddedRegriddedFrame.instrument.expanded=prefilled&​CoaddedRegriddedFrame.filter.expanded=prefilled&​CoaddedRegriddedFrame.is_valid.op=%3E&​CoaddedRegriddedFrame.is_valid=0&​CoaddedRegriddedFrame.instrument.name=OMEGACAM&​CoaddedRegriddedFrame.instrument.name.op=%3D&​CoaddedRegriddedFrame.regridded_frames.base=RegriddedFrame | coadds]] [[http://​dbview.astro-wise.org/​DbView?​project=ATLAS&​set_cookie=&​QSort=&​QDesc=descending&​2ndQSort=&​2ndQDesc=descending&​numrows=rownum&​fcontext_project_only=on&​show_expanded=no&​Exportselect=NoDownload&​class_str=CoaddedRegriddedFrame&​mode=table_res&​depth=1&​python_dict=%2528dp0%250AS%2527query%2527%250Ap1%250A%2528dp2%250AsS%2527expanded%2527%250Ap3%250A%2528dp4%250AS%2527CoaddedRegriddedFrame%2527%250Ap5%250A%2528lp6%250AS%2527open%2527%250Ap7%250AaS%2527root%2527%250Ap8%250Aag5%250AasS%2527CoaddedRegriddedFrame.instrument%2527%250Ap9%250A%2528lp10%250AS%2527prefilled%2527%250Ap11%250AaS%2527link_property%2527%250Ap12%250AaS%2527Instrument%2527%250Ap13%250AasS%2527CoaddedRegriddedFrame.filter%2527%250Ap14%250A%2528lp15%250Ag11%250AaS%2527link_property%2527%250Ap16%250AaS%2527Filter%2527%250Ap17%250AassS%2527derived%2527%250Ap18%250A%2528dp19%250As.&​expanded_leaf=&​expanded_leaf_type=&​expanded_leaf_class=&​derived_leaf=&​node_state=&​CoaddedRegriddedFrame.expanded=open&​CoaddedRegriddedFrame.instrument.expanded=prefilled&​CoaddedRegriddedFrame.filter.expanded=prefilled&​CoaddedRegriddedFrame.is_valid.op=%3E&​CoaddedRegriddedFrame.is_valid=0&​CoaddedRegriddedFrame.instrument.name=OMEGACAM&​CoaddedRegriddedFrame.instrument.name.op=%3D&​CoaddedRegriddedFrame.regridded_frames.base=RegriddedFrame | coadds]]
 +
 +{{:​projects:​kids:​atlascoaddsinkids.png?​200|}}
  
 == VST-ATLAS pipeline description == VST-ATLAS pipeline description
 
projects/kids/atlas.1429016026.txt.gz · Last modified: 2015/04/14 14:53 by emhelmich     Back to top
Recent changes RSS feed Powered by PHP Valid XHTML 1.0 Valid CSS Driven by DokuWiki