Skip to content

Commit ec554ab

Browse files
committed
overfitting docs [skip ci]
1 parent ad8e067 commit ec554ab

File tree

2 files changed

+36
-1
lines changed

2 files changed

+36
-1
lines changed

docs/overfitting.png

186 KB
Loading

docs/using_everest.rst

Lines changed: 36 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -329,10 +329,45 @@ the model beforehand:
329329
Custom Detrending
330330
=================
331331

332-
As of version **2.0.8**, users can de-trend their own raw *K2* FITS files
332+
As of version **2.0.9**, users can de-trend their own raw *K2* FITS files
333333
using the :py:func:`everest.standalone.DetrendFITS` function, which is
334334
a wrapper for the :py:class:`everest.detrender.rPLD` detrender.
335335

336+
Overfitting Metrics
337+
===================
338+
339+
As we discussed above, :py:func:`everest` is known to overfit transits when
340+
they are not properly masked. Users can now compute an estimate of the degree
341+
of overfitting in any light curve by typing
342+
343+
everest 201601162 -o
344+
345+
into a terminal. This will compute and plot two overfitting metrics: the
346+
**unmasked overfitting metric** and the **masked overfitting metric**. Both
347+
correspond to the fractional decrease in a transit depth due to overfitting
348+
and are computed by running transit injection/recovery tests at every
349+
cadence in a light curve.
350+
For EPIC 201601162, computing these metrics took about 2 minutes on my laptop.
351+
Here is what a snippet of the diagnostic plot looks like:
352+
353+
.. figure:: overfitting.png
354+
:width: 600px
355+
:align: center
356+
:figclass: align-center
357+
358+
The top panel shows the unmasked overfitting metric: the degree of overfitting
359+
when transits are not masked. This is evaluated at every cadence. The distribution
360+
of values is shown as the histogram at the right, indicating a median overfitting
361+
of 0.07 (7%), with a typical spread (median absolute deviation, or MAD) of 0.036 (3.6%).
362+
The bottom panel shows the masked overfitting metric: the degree of overfitting
363+
when transits are masked (see above). This is much smaller and is zero on average,
364+
indicating that :py:obj:`everest` **does not overfit** when transits are excluded
365+
from the regression.
366+
367+
The actual PDF has several more rows, corresponding to the overfitting metrics for
368+
different injected transit depths. In general, overfitting gets worse the lower the
369+
signal-to-noise ratio of the light curve.
370+
336371
.. raw:: html
337372

338373
<script>

0 commit comments

Comments
 (0)