Katana VentraIP

Total operating characteristic

The total operating characteristic (TOC) is a statistical method to compare a Boolean variable versus a rank variable. TOC can measure the ability of an index variable to diagnose either presence or absence of a characteristic. The diagnosis of presence or absence depends on whether the value of the index is above a threshold. TOC considers multiple possible thresholds. Each threshold generates a two-by-two contingency table, which contains four entries: hits, misses, false alarms, and correct rejections.[1]

The receiver operating characteristic (ROC) also characterizes diagnostic ability, although ROC reveals less information than the TOC. For each threshold, ROC reveals two ratios, hits/(hits + misses) and false alarms/(false alarms + correct rejections), while TOC shows the total information in the contingency table for each threshold.[2] The TOC method reveals all of the information that the ROC method provides, plus additional important information that ROC does not reveal, i.e. the size of every entry in the contingency table for each threshold. TOC also provides the popular area under the curve (AUC) of the ROC.


TOC is applicable to measure diagnostic ability in many fields including but not limited to: land change science, medical imaging, weather forecasting, remote sensing, and materials testing.

History[edit]

Robert Gilmore Pontius Jr, professor of Geography at Clark University, and Kangping Si in 2014 first developed the TOC for application in land change science.

Brier score

Coefficient of determination

Constant false alarm rate

Detection error tradeoff

Detection theory

F1 score

False alarm

Precision and recall

ROCCET

Receiver operating characteristic

Pontius Jr, Robert Gilmore; Si, Kangping (2014). "The total operating characteristic to measure diagnostic ability for multiple thresholds". International Journal of Geographical Information Science. 28 (3): 570–583. :10.1080/13658816.2013.862623. S2CID 29204880.

doi

Pontius Jr, Robert Gilmore; Parmentier, Benoit (2014). "Recommendations for using the Relative Operating Characteristic (ROC)". Landscape Ecology. 29 (3): 367–382. :10.1007/s10980-013-9984-8. S2CID 254740981.

doi

Mas, Jean-François; Filho, Britaldo Soares; Pontius Jr, Robert Gilmore; Gutiérrez, Michelle Farfán; Rodrigues, Hermann (2013). . ISPRS International Journal of Geo-Information. 2 (3): 869–887. Bibcode:2013IJGI....2..869M. doi:10.3390/ijgi2030869.

"A suite of tools for ROC analysis of spatial models"

Pontius Jr, Robert Gilmore; Pacheco, Pablo (2004). "Calibration and validation of a model of forest disturbance in the Western Ghats, India 1920–1990". GeoJournal. 61 (4): 325–334. :10.1007/s10708-004-5049-5. S2CID 155073463.

doi

Pontius Jr, Robert Gilmore; Batchu, Kiran (2003). "Using the relative operating characteristic to quantify certainty in prediction of location of land cover change in India". Transactions in GIS. 7 (4): 467–484. :10.1111/1467-9671.00159. S2CID 14452746.

doi

Pontius Jr, Robert Gilmore; Schneider, Laura (2001). "Land-use change model validation by a ROC method for the Ipswich watershed, Massachusetts, USA". Agriculture, Ecosystems & Environment. 85 (1–3): 239–248. :10.1016/s0167-8809(01)00187-6.

doi

An Introduction to the Total Operating Characteristic: Utility in Land Change Model Evaluation

TOC utilization in Wildfire Risk

How to run the TOC Package in R

TOC R package on Github

Excel Workbook for generating TOC curves

Google Earth Engine TOC Curve Tutorial

Google Earth Engine TOC Curve Source Code

$_$_$DEEZ_NUTS#2__titleDEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#2__descriptionDEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#10__titleDEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#10__descriptionDEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__titleDEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__subtextDEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--0DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--0DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--0DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--1DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--1DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--1DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--2DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--2DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--2DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--3DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--3DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--3DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--4DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--4DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--4DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--5DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--5DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--5DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--6DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--6DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--6DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--7DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--7DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--7DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--8DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--8DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--8DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--9DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--9DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--9DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--10DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--10DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--10DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--11DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--11DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--11DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__quote--12DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__name--12DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#12__company_or_position--12DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#4__titleDEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#4__subtextDEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#4__quote--0DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#4__name--0DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#4__company_or_position--0DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#11__titleDEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#11__subtextDEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#11__quote--0DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#11__name--0DEEZ_NUTS$_$_$

$_$_$DEEZ_NUTS#11__company_or_position--0DEEZ_NUTS$_$_$