Differences between revisions 36 and 37
⇤ ← Revision 36 as of 2018-04-17 11:17:40 →
Size: 14556
Editor: weh
Comment:
← Revision 37 as of 2018-04-17 13:39:47 → ⇥
Size: 14641
Editor: weh
Comment:
Deletions are marked like this. Additions are marked like this.
Line 21: Line 21:
The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It doesn't take any real complexity differences into account, take it with a huge grain of salt. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. Example of calibrating with only character count as a source variable: https://i.imgur.com/xCWwrs9.png The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It doesn't take any real complexity differences into account, take it with a huge grain of salt; also, '''it assumes as ~475 characters/minute reading speed''', not like 300 or 200. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. Example of calibrating with only character count as a source variable: https://i.imgur.com/xCWwrs9.png

I just rewrote the stats tools. These are the stats output by the new tools. They differ slightly from the old stats because the rewrite deals with a few edge cases differently. The differences are within a margin of error, or when the difference is big, the old stats tools are probably doing something wrong.

If you got linked here for a statistic that isn't here (like the Core 6k stats), look at the Old Stats page instead.

For now, see the Old Stats page for more details. If you want to add a script, post it to the Requests page.

See also Changes.

You can get the new analysis tools here (you need this too). They're easier to use than the previous ones, but they require python 3.6 or newer, and if you're not on Windows, you need to patch and recompile mecab yourself to fix a bug (instructions included) (you CANNOT use mecab as compiled by your distribution's maintainer).

Higher is easier: Hayashi; custom metric

Lower is easier: kanji (unique); kanji(2+); chars/line; chars/sentence; freqlistX% Target

The "Hayashi" metric are an estimate of structural complexity. The Hayashi metric is inherently flawed and should only be used as a general guideline.

The "custom metric" is like "Hayashi", and uses similar data, but it's designed to correlate well with "freqlist92.5% target". This is another estimate of structural complexity, but because it estimates the "freqlist92.5% target" metric, it's arbitrary.

The "freqlistX% Target" metrics are an estimate of lexical complexity. High measurements mean that the script uses uncommon words more frequently, or common words less frequently. Commonness is based on every long-enough script combined, not on general purpose frequency lists or the frequency list of the single script in question.

The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It doesn't take any real complexity differences into account, take it with a huge grain of salt; also, it assumes as ~475 characters/minute reading speed, not like 300 or 200. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. Example of calibrating with only character count as a source variable: https://i.imgur.com/xCWwrs9.png

script name kanji (unique) kanji (2+) lines sentences chars /line chars /sentence characters lexemes sjis bytes sjis (dedup) hours estimate Hayashi custom metric freqlist 90% Target freqlist 92.5% Target freqlist 95% Target
aete mushisuru 1987 1723 36629 41691 13.83 11.68 506616 285261 1287119 1238044 17.74 80.76 74.10 5598.86 8076.27 12272.59
ao no kanata 2129 1846 44234 57107 20.20 15.24 893350 504764 2125556 2065379 31.46 79.14 74.59 4201.67 5573.50 8462.33
astelight shuushuubako 2982 2595 9461 14515 51.53 33.45 487535 291731 1166666 1157863 18.65 62.44 48.15 13836.85 17691.00 23422.60
axanael 1861 1585 34375 42538 12.17 9.18 418504 207002 1139513 1053681 12.86 81.09 73.51 6549.93 8588.60 13328.16
biman1 1750 1394 7641 12526 23.79 14.05 181779 98089 448539 439945 6.27 78.72 75.45 8598.10 11447.89 19794.98
chronobox trials 1265 914 3160 5460 19.99 11.29 63177 35006 160474 157777 2.24 81.82 76.67 4941.38 7051.27 9088.75
chronobox 1985 1737 23036 41201 21.60 11.78 497566 274526 1261732 1236591 17.54 79.04 74.39 6046.80 8583.29 12123.09
cloverpoint 2258 1995 42677 60322 20.19 13.68 861662 472360 2146495 2073383 29.68 78.74 73.73 5899.90 8361.96 12051.97
daitoshokan fandisk 2035 1760 28827 34367 16.22 13.33 467657 267247 1134885 1113236 16.96 77.88 73.88 5385.00 7763.50 12334.71
daitoshokan 2312 2055 68258 76633 16.00 13.86 1092295 625870 2647706 2562769 39.49 77.45 72.58 5014.90 7019.07 11047.90
dies irae 2790 2554 58314 88559 28.76 18.16 1677110 952246 4005512 3830009 60.02 69.97 68.66 6935.11 9248.75 12803.50
dracuriot 2218 1944 51751 84258 23.36 13.65 1208987 660083 2956248 2832280 40.95 80.31 74.84 4225.80 5579.51 8500.80
eustia 2454 2210 64697 69324 15.16 13.65 980871 564560 2397710 2292286 34.92 78.84 76.83 6573.25 9809.18 14469.80
fate stay night 2556 2320 75159 90847 23.04 17.88 1731549 965201 4260695 3870323 59.09 71.48 67.03 6863.51 8802.31 13720.68
flowers1+2+3 2412 2178 35460 49370 24.17 17.34 856990 519241 1979933 1949229 32.04 72.20 66.75 7340.00 10465.35 15563.02
flowers1 1979 1690 13289 18873 23.85 16.78 316955 191587 737313 726823 11.81 73.94 69.35 5624.00 8256.00 12582.46
flowers2 2032 1731 10695 14634 24.14 17.65 258169 155373 595039 587710 9.67 70.74 65.04 9036.76 12961.23 17825.38
flowers3 2084 1808 11476 16109 24.56 17.52 281866 172781 647581 639731 10.59 71.72 65.49 7910.80 10913.20 16043.76
flyable heart 1849 1626 44569 56254 18.36 13.93 818168 458851 1963723 1872189 28.58 83.65 82.02 2566.00 3730.91 5669.88
fortissimoexs 2306 2107 45040 66462 28.59 19.15 1287702 725062 3138289 3033401 46.03 70.06 60.51 5204.13 6991.76 9827.20
fortunearterial 2186 1942 65296 66515 13.52 12.80 882508 503887 2153109 2036302 31.55 80.40 77.97 4669.12 6660.60 9426.00
fureraba 2083 1853 50051 66377 20.05 14.57 1003649 556765 2425789 2352972 34.79 80.29 75.22 3910.10 5686.16 8716.75
futsuu no fantasy 2018 1777 53492 59776 13.98 12.03 747795 421718 1793697 1730775 26.26 79.61 79.52 4891.31 6623.79 8253.70
gensou no idea 2481 2225 32461 47681 25.32 17.16 821785 475016 1958269 1929489 29.69 78.89 68.32 6546.14 8768.86 11780.85
hanachirasu 2149 1742 5877 7823 23.91 17.90 140515 87663 349599 345074 5.50 72.57 62.20 10348.30 13869.66 19713.65
hanahira 947 654 3571 4263 13.40 10.88 47866 25278 124311 120902 1.61 87.59 83.63 4116.16 5829.85 9905.10
hatsukoi yohou 1834 1586 30370 48340 20.26 12.39 615425 351700 1523937 1483369 21.96 81.41 77.15 3237.15 4386.61 6077.00
henkoi 1897 1602 21719 48348 25.13 11.00 545804 294522 1373860 1361135 18.42 80.41 72.35 5806.55 8675.91 13323.42
hoshimemo 2080 1864 54205 60836 16.99 14.68 921017 537002 2073147 1997427 32.91 82.82 76.60 6331.73 8767.39 12549.85
iinchou shounin 2051 1789 32743 57165 18.25 10.10 597436 329258 1508808 1481290 20.45 81.00 76.65 4774.96 7124.65 11205.22
imakoi 1446 1157 5991 9542 24.60 15.16 147388 81016 342955 341436 5.10 82.87 75.70 3887.80 5222.35 6864.10
inganock 2065 1816 17648 32300 23.39 11.92 412809 228753 968180 896988 14.13 76.22 67.21 8437.20 11458.01 15807.46
itsusora 2465 2182 30247 36196 19.68 16.10 595181 355594 1433403 1386755 21.77 82.58 77.66 5647.83 7671.62 11110.47
jingai makyou 2495 2208 35361 53182 23.75 13.92 839691 451756 2055351 1804776 28.07 74.33 75.60 6535.90 8886.60 13482.88
kagerou 2938 2598 21148 27024 37.73 29.67 797910 488504 1912123 1897640 30.67 71.14 63.19 13033.30 16702.00 20799.48
kajiri akebono 2861 2565 32668 52551 32.12 19.43 1049349 624008 2515798 2457232 39.36 80.75 70.97 8757.92 11907.19 16078.10
kamimaho 2159 1945 44145 51492 20.02 16.94 883782 523540 2152608 2117316 32.85 78.50 72.80 4695.70 6729.53 9228.97
katahane 1865 1659 46768 40574 13.15 14.30 614909 330445 1481610 1425979 20.09 82.46 76.26 4918.62 6887.62 9875.95
kaziklu 2068 1726 6099 10068 34.54 20.67 210682 122656 484567 482447 7.66 67.93 72.08 6691.98 8886.46 12018.47
kimikoe 2222 1981 44891 56879 16.57 12.70 743935 418580 1819039 1772716 26.39 81.05 75.79 5437.40 6534.98 9687.75
kirakira 2281 1986 35716 50270 30.25 21.12 1080238 630810 2557768 2519197 38.90 74.75 71.38 4833.19 7010.56 9688.42
leyline1+2+3 2019 1795 57821 76028 19.90 14.70 1150758 667259 2777676 2694759 41.09 83.67 78.43 3409.53 5023.30 8203.27
leyline1 1596 1323 17968 23564 18.62 13.73 334620 194618 813931 791074 11.93 86.85 80.70 3234.30 4816.73 8370.11
leyline2 1748 1473 21063 27396 20.49 15.33 431582 251488 1036671 1009047 15.44 83.47 78.12 3330.30 4844.31 7897.59
leyline3 1661 1441 18790 25796 20.43 14.60 383865 223425 926788 909650 13.83 82.01 77.16 3689.78 5303.04 8359.05
magical charming 2118 1803 37239 55448 17.75 11.63 661122 365137 1649810 1611665 22.92 80.49 80.38 3903.40 5863.10 8985.60
majokoi 1970 1709 37288 46138 15.83 11.85 590196 320054 1490266 1349107 19.68 84.50 85.56 3853.35 5317.35 7495.55
muramasa 3070 2793 80564 87653 15.30 13.75 1232446 733011 3176908 3019944 46.79 75.48 62.77 10855.10 14135.89 19071.60
nanarin 1851 1589 39789 42928 17.83 10.27 709247 248506 1830351 1120735 15.83 79.26 82.89 3907.63 5364.68 8295.11
nanatsuiro 1543 1312 26930 36064 17.12 12.61 460913 269083 1122537 1122517 16.50 83.64 82.48 2931.60 4199.70 7910.93
noratoto 2050 1783 41303 58114 16.35 11.27 675396 365327 1692782 1636726 22.74 84.67 80.82 4272.36 6138.68 9488.98
nursery rhyme 2046 1779 32500 41516 20.63 15.78 670321 374822 1616247 1577109 23.50 81.65 76.18 4145.17 5907.71 9133.35
oretsuba afterstory 2131 1827 16417 26109 25.53 15.72 419120 231391 995689 979710 14.56 81.45 72.59 6284.10 8629.14 12476.20
oretsuba prelude 2171 1798 8816 15168 31.09 17.69 274070 150433 634811 625030 9.41 79.57 66.71 8990.20 12052.73 16419.60
oretsuba 2770 2482 56675 89741 30.23 17.71 1713369 908305 3978483 3692838 56.59 80.60 71.64 7880.57 10496.30 15053.89
parfait 2134 1859 36576 50540 19.56 11.77 715599 340032 1786866 1463197 21.43 73.26 74.39 5751.08 8314.49 10933.65
prawfclwyd 2018 1766 25602 34977 18.99 13.57 486264 270053 1217811 1187626 17.17 74.35 75.16 6008.66 8734.83 14052.55
princessfrontier 2342 2096 48063 61194 16.86 12.89 810467 449604 1965704 1927480 27.99 81.85 75.86 7263.10 10518.45 15172.05
rabuobu 2169 1904 34143 53700 19.47 11.64 664852 356575 1613985 1530452 22.10 83.09 77.88 6465.14 8907.00 13489.00
rinshin 2210 1949 28964 46057 26.02 15.53 753720 414396 1787780 1707720 25.88 78.39 71.66 6852.03 8576.15 12628.68
sansha mendan 2042 1841 34816 64406 34.77 18.37 1210691 621255 2817128 2785920 41.26 77.20 61.68 6272.17 8685.31 11300.93
satsukoi 1882 1587 23111 23947 12.80 11.93 295846 169260 743615 710642 10.52 80.51 76.62 4837.70 6273.03 9734.35
senmomo 2513 2235 48841 54049 16.87 14.91 824140 491207 1981794 1946095 31.45 75.08 67.84 9579.81 12674.33 16426.77
senrenbanka 2222 1918 54585 79446 20.03 13.42 1093530 617721 2672904 2618031 38.39 81.96 78.62 3517.94 5145.68 8316.44
senshinkan bansenjin 2644 2376 26142 42276 33.07 20.27 864568 516024 1994101 1977766 32.45 76.73 69.08 6114.07 8169.49 11596.12
senshinkan hachimyoujin 2858 2544 34771 56287 33.51 20.49 1165087 696088 2740617 2711958 43.93 78.27 69.08 6940.40 9087.28 12465.47
sharnoth fvr 2124 1877 20847 35054 24.15 13.12 503476 265581 1173739 1066449 16.44 73.29 69.65 6251.14 8480.38 12617.25
shirokuma 2432 2127 48077 70659 21.46 14.01 1031582 557907 2515346 2452640 34.61 80.86 76.11 8828.30 11332.39 16815.27
shugaten 1763 1521 24869 29261 15.57 12.91 387316 214006 965349 901986 13.13 83.74 78.53 6094.86 9041.55 15105.65
silverio vendetta 2758 2487 24342 39584 35.67 21.82 868301 510102 2158325 2150337 33.02 70.10 60.75 9706.37 12249.99 16189.47
simulacre 1771 1515 13577 19050 21.27 15.03 288819 178681 685150 674597 10.82 81.36 81.50 3603.92 5105.84 7299.98
snowwhite 1546 1240 5778 7959 30.93 22.14 178726 106545 417532 410758 6.49 78.65 77.01 3571.13 5302.80 9509.60
soramitsu 2125 1925 46347 58061 22.64 15.36 1049089 518230 2578691 2185261 32.49 79.44 77.30 4151.88 5747.67 8460.74
sourire 1894 1637 30168 44601 20.83 13.77 628424 362062 1555598 1511058 22.50 80.49 80.62 3171.15 4723.99 7800.82
subahibi 2238 1996 58018 74763 18.33 11.77 1063337 520905 2713808 2237407 32.17 78.01 75.51 4856.78 6875.80 10283.12
sukinara 2069 1835 60041 84942 20.91 14.09 1255586 682601 3147409 3007064 42.08 82.34 82.24 4569.64 6558.79 11070.15
tarareba 1797 1553 20992 32452 22.27 14.25 467570 262555 1119586 1119535 16.43 79.21 76.67 3982.63 6034.68 10968.45
trinoline 1954 1692 27628 34306 18.66 14.67 515408 286655 1259214 1226295 18.14 77.91 75.88 3576.05 5153.09 7904.57
tsujidou-san no jun'ai road 2269 2019 80118 102793 14.93 11.31 1196359 651727 2940726 2766732 40.48 84.30 75.59 5934.13 8209.79 11924.35
tsujidou-san no virgin road 2064 1802 43219 54886 15.43 11.86 666755 367278 1632300 1545307 22.70 83.32 75.29 5774.94 8147.38 11886.38
tsuriotsu 2390 2102 30932 60869 34.31 17.25 1061406 636679 2455467 2436023 38.67 79.87 74.90 5146.30 7470.17 11354.75
tsuushinbo 1866 1617 28505 43993 21.66 13.82 617432 343593 1503324 1477566 21.70 86.13 84.97 2809.85 3831.58 5607.05
twinklecrusaders 2586 2313 77293 115311 19.82 13.10 1531958 850300 3680074 3678307 52.76 80.37 73.18 6951.28 9686.95 15001.14
white_album 1831 1481 29108 31890 15.90 13.32 462896 251596 1123118 1014554 15.59 79.00 79.82 4442.40 6953.25 10456.58
yoakena 2134 1902 57455 60314 14.48 13.37 831742 467022 2074181 1942943 29.29 78.88 77.63 4006.85 5693.51 8727.19

The Hayashi metric is derived from: chars per sentence; commas per periods*; average consecutive length of each of kanji/hiragana/katakana/other

The custom metric is derived from: chars per sentence; commas per periods*; proportion of the script made up by each of kanji/hiragana/katakana/other; proportionally adjusted average consecutive length of each of kanji/hiragana/katakana/other

* sentence endings imply periods

Stats (last edited 2020-08-22 13:05:50 by weh)