time-to-botec

Benchmark sampling in different programming languages
Log | Files | Refs | README

README.md (5030B)


      1 <!--
      2 
      3 @license Apache-2.0
      4 
      5 Copyright (c) 2018 The Stdlib Authors.
      6 
      7 Licensed under the Apache License, Version 2.0 (the "License");
      8 you may not use this file except in compliance with the License.
      9 You may obtain a copy of the License at
     10 
     11    http://www.apache.org/licenses/LICENSE-2.0
     12 
     13 Unless required by applicable law or agreed to in writing, software
     14 distributed under the License is distributed on an "AS IS" BASIS,
     15 WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
     16 See the License for the specific language governing permissions and
     17 limitations under the License.
     18 
     19 -->
     20 
     21 # incrmmape
     22 
     23 > Compute a moving [mean absolute percentage error][mean-absolute-percentage-error] incrementally.
     24 
     25 <section class="intro">
     26 
     27 For a window of size `W`, the [mean absolute percentage error][mean-absolute-percentage-error] is defined as
     28 
     29 <!-- <equation class="equation" label="eq:mean_absolute_percentage_error" align="center" raw="\operatorname{MAPE}  = \frac{100}{W} \sum_{i=0}^{W-1} \biggl| \frac{a_i - f_i}{a_i} \biggr|" alt="Equation for the mean absolute percentage error."> -->
     30 
     31 <div class="equation" align="center" data-raw-text="\operatorname{MAPE}  = \frac{100}{W} \sum_{i=0}^{W-1} \biggl| \frac{a_i - f_i}{a_i} \biggr|" data-equation="eq:mean_absolute_percentage_error">
     32     <img src="https://cdn.jsdelivr.net/gh/stdlib-js/stdlib@f13330c8d3bb837438b30381f6cd70dbccd4837c/lib/node_modules/@stdlib/stats/incr/mmape/docs/img/equation_mean_absolute_percentage_error.svg" alt="Equation for the mean absolute percentage error.">
     33     <br>
     34 </div>
     35 
     36 <!-- </equation> -->
     37 
     38 where `f_i` is the forecast value and `a_i` is the actual value.
     39 
     40 </section>
     41 
     42 <!-- /.intro -->
     43 
     44 <section class="usage">
     45 
     46 ## Usage
     47 
     48 ```javascript
     49 var incrmmape = require( '@stdlib/stats/incr/mmape' );
     50 ```
     51 
     52 #### incrmmape( window )
     53 
     54 Returns an accumulator `function` which incrementally computes a moving [mean absolute percentage error][mean-absolute-percentage-error]. The `window` parameter defines the number of values over which to compute the moving [mean absolute percentage error][mean-absolute-percentage-error].
     55 
     56 ```javascript
     57 var accumulator = incrmmape( 3 );
     58 ```
     59 
     60 #### accumulator( \[f, a] )
     61 
     62 If provided input values `f` and `a`, the accumulator function returns an updated [mean absolute percentage error][mean-absolute-percentage-error]. If not provided input values `f` and `a`, the accumulator function returns the current [mean absolute percentage error][mean-absolute-percentage-error].
     63 
     64 ```javascript
     65 var accumulator = incrmmape( 3 );
     66 
     67 var m = accumulator();
     68 // returns null
     69 
     70 // Fill the window...
     71 m = accumulator( 2.0, 3.0 ); // [(2.0,3.0)]
     72 // returns ~33.33
     73 
     74 m = accumulator( 1.0, 4.0 ); // [(2.0,3.0), (1.0,4.0)]
     75 // returns ~54.17
     76 
     77 m = accumulator( 3.0, 9.0 ); // [(2.0,3.0), (1.0,4.0), (3.0,9.0)]
     78 // returns ~58.33
     79 
     80 // Window begins sliding...
     81 m = accumulator( 7.0, 3.0 ); // [(1.0,4.0), (3.0,9.0), (7.0,3.0)]
     82 // returns ~91.67
     83 
     84 m = accumulator( 5.0, 3.0 ); // [(3.0,9.0), (7.0,3.0), (5.0,3.0)]
     85 // returns ~88.89
     86 
     87 m = accumulator();
     88 // returns ~88.89
     89 ```
     90 
     91 </section>
     92 
     93 <!-- /.usage -->
     94 
     95 <section class="notes">
     96 
     97 ## Notes
     98 
     99 -   Input values are **not** type checked. If provided `NaN` or a value which, when used in computations, results in `NaN`, the accumulated value is `NaN` for **at least** `W-1` future invocations. If non-numeric inputs are possible, you are advised to type check and handle accordingly **before** passing the value to the accumulator function.
    100 
    101 -   As `W` (f,a) pairs are needed to fill the window buffer, the first `W-1` returned values are calculated from smaller sample sizes. Until the window is full, each returned value is calculated from all provided values.  
    102 
    103 -   **Warning**: the [mean absolute percentage error][mean-absolute-percentage-error]  has several shortcomings: 
    104 
    105     -   The measure is **not** suitable for intermittent demand patterns (i.e., when `a_i` is `0`).
    106     -   The [mean absolute percentage error][mean-absolute-percentage-error] is not symmetrical, as the measure cannot exceed 100% for forecasts which are too "low" and has no limit for forecasts which are too "high".
    107     -   When used to compare the accuracy of forecast models (e.g., predicting demand), the measure is biased toward forecasts which are too low.
    108 
    109 </section>
    110 
    111 <!-- /.notes -->
    112 
    113 <section class="examples">
    114 
    115 ## Examples
    116 
    117 <!-- eslint no-undef: "error" -->
    118 
    119 ```javascript
    120 var randu = require( '@stdlib/random/base/randu' );
    121 var incrmmape = require( '@stdlib/stats/incr/mmape' );
    122 
    123 var accumulator;
    124 var v1;
    125 var v2;
    126 var i;
    127 
    128 // Initialize an accumulator:
    129 accumulator = incrmmape( 5 );
    130 
    131 // For each simulated datum, update the moving mean absolute percentage error...
    132 for ( i = 0; i < 100; i++ ) {
    133     v1 = ( randu()*100.0 ) + 50.0;
    134     v2 = ( randu()*100.0 ) + 50.0;
    135     accumulator( v1, v2 );
    136 }
    137 console.log( accumulator() );
    138 ```
    139 
    140 </section>
    141 
    142 <!-- /.examples -->
    143 
    144 <section class="links">
    145 
    146 [mean-absolute-percentage-error]: https://en.wikipedia.org/wiki/Mean_absolute_percentage_error
    147 
    148 </section>
    149 
    150 <!-- /.links -->