Improving Hot Pixel Detection Algorithm

  • Set out to create an improved algorithm for detecting hot pixels,
  • Set out to create a 3 by 3 pixel square which traces across the whole CCD chip, and looked at the 8 pixels surrounding the central one, and taking the median (mode could be an issue is no repeating values exist). This value is then compared to the central pixel, and if it is sufficiently larger than its surrounding its x,y and intensity values are noted.
  • Note, using this method pixels on the boundary of the image cannot be checked, as these do not have 8 nearest neighbours, so are not included using this method.
  • Also, using this method, a threshold of sorts still needs to be applied, when comparing the central pixel to the surrounding median.
  • Using this method, for similar thresholds for this and the previous method, it was found that this gave a slightly smaller value than was found previously (although of the same order of magnitude). Although it is worth noting our thresholds for the new method vary slightly with the median, although they remain relatively similar.

Overlaying found hot pixels over original image

  • We overlayed our found hot pixels over the original image by setting the threshold as $250 \times \rm{median \ threshold}$. This was done because usually the median threshold was around 160, whereas a typical hot pixel was more than 10000.
  • This is what we found. The pink points are the pixels detected.
overlay.png
  • If zoomed in we can see that the hot pixels were detected:
located_hot_pixel.png
  • However, some hot pixels were not detected if the surrounding pixels were bled into. This is because the median would be a high value as compared to the actual background, and therefore the threshold there was too high.
didnt_find.png
  • However, we noticed that at low exposures the pixels did not bleed. As we will be working at lower exposures, this should hopefully not prove to be too large an issue.
bleedingpng.png
  • If the threshold is set to 3 standard deviations of the median we get the following overlay. Note that due to random effects in the CCD, around 4500 hot pixels are expected to be seen due to statistical fluctuations ( 32761 hot pixels found).
3_std_threshold.png
  • Zoomed in it looks like the following:
3_std_threshold_zoom.png
  • It appears that it selected pixels that do not appear to be hot pixels.
  • At 5 standard deviations, this is what the overlay looks like:
5_std_threshold.png
  • 26860 hot pixels were found for 5 standard deviations.
  • At 10 standard deviations 19200 hot pixels were found and this is what the overlay looked like:
10_std_threshold.png
  • At 20 standard deviations 12696 hot pixels were found. The overlay is shown below:
20_std_threshold.png

'MIP' Peak Investigation

  • As seen last week, we observed that in the intensity of the hot pixels distribution (histogram) there was a unusually large peak present that did not fit in with the background. It was theorised that this could be due to a MIP (most ionising particle), and we investigated this here.
  • We isolated the peak from the previous image, and found the x and y positions of the hot pixels and overlayed this with the original image, the results of which can be seen below (for both upwards and angled 1 hour exposures).
MIP_peak_analysis_angle.png

MIP_peak_analysis_upwards.png

  • From this it can be seen that this is not from MIP's, as these would be randomly distributed over the chip, and instead they can be seen clustered around the edges of the chip, and this is perhaps due to electronic noise or other affects.
-- DavidHadden - 10 Nov 2015
Topic attachments
I Attachment History Action Size Date Who Comment
PNGpng 10_std_threshold.png r1 manage 374.5 K 10 Nov 2015 - 16:38 ElenaCukanovaite  
PNGpng 20_std_threshold.png r1 manage 333.5 K 10 Nov 2015 - 16:57 ElenaCukanovaite  
PNGpng 3_std_threshold.png r1 manage 343.6 K 10 Nov 2015 - 15:32 ElenaCukanovaite  
PNGpng 3_std_threshold_zoom.png r1 manage 47.1 K 10 Nov 2015 - 15:32 ElenaCukanovaite  
PNGpng 5_std_threshold.png r1 manage 371.9 K 10 Nov 2015 - 16:27 ElenaCukanovaite  
PNGpng MIP_peak_analysis.png r1 manage 206.6 K 10 Nov 2015 - 16:00 DavidHadden  
PNGpng MIP_peak_analysis_angle.png r1 manage 207.4 K 10 Nov 2015 - 16:18 DavidHadden  
PNGpng MIP_peak_analysis_upwards.png r1 manage 231.9 K 10 Nov 2015 - 16:19 DavidHadden  
PNGpng bleedingpng.png r1 manage 1451.7 K 10 Nov 2015 - 14:50 DavidHadden  
PNGpng didnt_find.png r1 manage 73.2 K 10 Nov 2015 - 14:34 ElenaCukanovaite  
PNGpng located_hot_pixel.png r1 manage 62.0 K 10 Nov 2015 - 14:34 ElenaCukanovaite  
PNGpng overlay.png r1 manage 122.3 K 10 Nov 2015 - 14:32 ElenaCukanovaite  
Edit | Attach | Watch | Print version | History: r10 < r9 < r8 < r7 < r6 | Backlinks | Raw View | Raw edit | More topic actions

Physics WebpagesRHUL WebpagesCampus Connect • Royal Holloway, University of London, Egham, Surrey TW20 0EX; Tel/Fax +44 (0)1784 434455/437520

Topic revision: r10 - 10 Nov 2015 - ElenaCukanovaite

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2025 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding RHUL Physics Department TWiki? Send feedback