Differences between revisions 65 and 67 (spanning 2 versions)
Revision 65 as of 2019-02-26 05:28:13
Size: 21610
Editor: weh
Comment:
Revision 67 as of 2019-06-15 16:29:13
Size: 15512
Editor: weh
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
These stats differ from the [[Old Stats]] because the new stats tools deal with several few edge cases differently. This is especially true of all the analysis-heavy stats, like the frequency list related stuff. Click on [[Old Stats]] if you want to see the old stats, like the Core 6k or Hayashi stats.
Line 3: Line 3:
'''The freqlistX% Target metrics changed recently'''. Read the freqlistX% Target paragraph if you're confused about the new numbers being lower.

If you got linked here for a statistic that isn't here ('''like the Core 6k stats'''), look at the [[Old Stats]] page instead.

For now, see the [[Old Stats]] page for more details.
All stats work on deduplicated copies of the script.
Line 13: Line 9:
You can get the new analysis tools [[https://mega.nz/#!wQ8TDZpK!SeWOQ9_G_vl74GzuNTEhojkHcjVMXbrfTvFuACwgFd4|here]] (you need [[https://mega.nz/#!RNcDHJzJ!ibbtJGteZpqdTA5QIZt88TnyirOB0Mkl4uktM4hKcsY|this]] too). They're easier to use than the previous ones, but they require python 3.6 or newer, and if you're not on Windows, you need to patch and recompile mecab yourself to fix a bug (instructions included) (you CANNOT use mecab as compiled by your distribution's maintainer). You can get the new analysis tools [[https://github.com/wareya/jpstats/|here]]. I hope you know how to use rust!
Line 15: Line 11:
Higher is easier: Hayashi; custom metric Higher is easier: metric a/b/c/d
Line 17: Line 13:
Lower is easier: kanji (unique); kanji(2+); chars/line; chars/sentence; freqlistX% Target Lower is easier: everything else
Line 19: Line 15:
The "Hayashi" metric are an estimate of structural complexity. The Hayashi metric is inherently flawed and should only be used as a general guideline. The "freqlistX% Target" metrics are an estimate of lexical complexity. High measurements mean that the script uses uncommon words more frequently, or common words less frequently. Commonness is based on every long-enough script combined, not on general purpose frequency lists or the frequency list of the single script in question. However, the most common uncovered 20 words in the script are ignored, because they're probably names or setting jargon, or even parsing errors. This entire process ignores grammatical words, proper nouns, and numbers.
Line 21: Line 17:
The "custom metric" is like "Hayashi", and uses similar data, but it's designed to correlate well with "freqlist92.5% target". This is another estimate of structural complexity, but because it estimates the "freqlist92.5% target" metric, it's arbitrary. The "metric a/b/c/d" lines are derived from linear regression targeting the "freqlist 92.5% Target" metric. An exact description of the processing for these metrics is [[https://pastebin.com/TwZYeSbb|here]]. The math is reverse polish notation.
Line 23: Line 19:
The "freqlistX% Target" metrics are an estimate of lexical complexity. High measurements mean that the script uses uncommon words more frequently, or common words less frequently. Commonness is based on every long-enough script combined, not on general purpose frequency lists or the frequency list of the single script in question. However, the most common uncovered 20 words in the script are ignored, because they're probably names or setting jargon, or even parsing errors. The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It assumes a reading speed of 475 characters per minute, in general. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. It is completely useless for VNs with nontrivial amounts of gameplay, or where rereading is expected, or where you're expected to miss a lot of content, or where you're only meant to read one or two out of several routes. Example of calibrating with only character count as a source variable: https://i.imgur.com/tqTGVlB.png
Line 25: Line 21:
The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It doesn't take any real complexity differences into account and it's '''based on VNDB's inaccurate length categories''', take it with a '''huge grain of salt'''; also, '''it assumes a ~475 characters/minute reading speed''', not like 300 or 200. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. Example of calibrating with only character count as a source variable: https://i.imgur.com/tqTGVlB.png

In particular, the hours estimate should be taken as '''complete guesswork''' for any game that has extended interactions outside of ADV or NVL sequences, like minigames or general gameplay, and it's also not going to take into account any differences in structure or readability caused by complex grammar or rare words.

You can compare the Hayashi, custom metric a, custom metric b, and freqlist 92.5% target stats with [[http://wareya.moe/extra/statsgraph.html|this interactive graph]].
To be replaced: [[http://wareya.moe/extra/statsgraph.html|this interactive graph]].
Line 32: Line 24:
script name; kanji\n(unique); kanji\n(2+); lines; sentences; chars\n/line; chars\n/sentence; characters; lexemes; sjis bytes; sjis (dedup); hours estimate; Hayashi; custom\nmetric a; custom\nmetric b; freqlist\n90% Target; freqlist\n92.5% Target; freqlist\n95% Target
aete mushisuru; 1987; 1723; 36629; 41691; 13.83; 11.68; 506616; 285261; 1287119; 1238044; 17.74; 80.76; 80.68; 80.60; 3965.45; 5469.01; 8065.10
amakoi; 2028; 1752; 28355; 54610; 27.53; 14.01; 780536; 442818; 1903429; 1889972; 27.61; 84.90; 89.19; 90.86; 2628.32; 3671.31; 5549.50
ao no kanata; 2129; 1846; 44234; 57107; 20.20; 15.24; 893350; 504764; 2125556; 2065379; 31.46; 79.14; 80.75; 79.60; 3325.75; 4592.20; 6721.65
astelight shuushuubako; 2982; 2595; 9461; 14515; 51.53; 33.45; 487535; 291731; 1166666; 1157863; 18.65; 62.44; 49.77; 65.19; 11819.42; 15079.26; 20053.07
axanael; 1861; 1585; 34375; 42538; 12.17; 9.18; 418504; 207002; 1139513; 1053681; 12.86; 81.09; 75.85; 76.06; 4758.78; 6574.29; 9418.04
biman1; 1750; 1394; 7641; 12526; 23.79; 14.05; 181779; 98089; 448539; 439945; 6.27; 78.72; 80.98; 81.09; 4370.57; 5819.83; 8296.35
buraban; 1800; 1570; 39133; 59513; 19.53; 12.42; 764174; 437576; 1940165; 1871589; 27.10; 78.45; 85.79; 84.96; 1952.53; 2736.14; 4164.42
chronobox trials; 1265; 914; 3160; 5460; 19.99; 11.29; 63177; 35006; 160474; 157777; 2.24; 81.82; 83.68; 83.61; 3334.27; 4486.58; 6841.90
chronobox; 1985; 1737; 23036; 41201; 21.60; 11.78; 497566; 274526; 1261732; 1236591; 17.54; 79.04; 83.13; 82.44; 4213.10; 5719.08; 8270.50
clacra; 2215; 1954; 41776; 59682; 19.64; 13.31; 820658; 447978; 2038082; 1975933; 28.51; 77.45; 82.44; 81.55; 3993.97; 5447.43; 7726.13
cloverpoint; 2258; 1995; 42677; 60322; 20.19; 13.68; 861662; 472360; 2146495; 2073383; 29.68; 78.74; 81.78; 80.96; 4813.62; 6488.23; 9531.30
daitoshokan fandisk; 2035; 1760; 28827; 34367; 16.22; 13.33; 467657; 267247; 1134885; 1113236; 16.96; 77.88; 80.71; 80.06; 4012.09; 5405.49; 7820.52
daitoshokan; 2312; 2055; 68258; 76633; 16.00; 13.86; 1092295; 625870; 2647706; 2562769; 39.49; 77.45; 79.77; 79.09; 4016.23; 5440.80; 7885.48
dies irae; 2790; 2554; 58314; 88559; 28.76; 18.16; 1677110; 952246; 4005512; 3830009; 60.02; 69.97; 75.71; 75.75; 6495.28; 8516.09; 11656.85
dracuriot; 2218; 1944; 51751; 84258; 23.36; 13.65; 1208987; 660083; 2956248; 2832280; 40.95; 80.31; 82.47; 82.53; 3144.45; 4318.75; 6415.11
eustia; 2454; 2210; 64697; 69324; 15.16; 13.65; 980871; 564560; 2397710; 2292286; 34.92; 78.84; 82.34; 81.84; 4400.90; 6176.01; 9044.77
fate stay night; 2556; 2320; 75159; 90847; 23.04; 17.88; 1731549; 965201; 4260695; 3870323; 59.09; 71.48; 77.01; 75.97; 4920.83; 6503.67; 9002.08
flowers1+2+3; 2412; 2178; 35460; 49370; 24.17; 17.34; 856990; 519241; 1979933; 1949229; 32.04; 72.20; 72.44; 71.96; 5822.40; 8157.88; 11619.69
flowers1; 1979; 1690; 13289; 18873; 23.85; 16.78; 316955; 191587; 737313; 726823; 11.81; 73.94; 75.86; 75.18; 4507.23; 6309.56; 9464.01
flowers2; 2032; 1731; 10695; 14634; 24.14; 17.65; 258169; 155373; 595039; 587710; 9.67; 70.74; 70.33; 70.05; 6296.80; 8673.89; 12538.49
flowers3; 2084; 1808; 11476; 16109; 24.56; 17.52; 281866; 172781; 647581; 639731; 10.59; 71.72; 70.49; 69.81; 6104.87; 8332.56; 11605.18
flyable heart; 1849; 1626; 44569; 56254; 18.36; 13.93; 818168; 458851; 1963723; 1872189; 28.58; 83.65; 86.95; 86.78; 2158.82; 2994.74; 4589.60
fortissimoexs; 2306; 2107; 45040; 66427; 27.76; 18.61; 1250088; 719523; 3151153; 3045669; 45.47; 71.79; 79.19; 79.04; 4012.49; 5389.27; 7443.32
fortunearterial; 2186; 1942; 65296; 66515; 13.52; 12.80; 882508; 503887; 2153109; 2036302; 31.55; 80.40; 82.99; 82.45; 3710.98; 5063.23; 7419.14
fureraba; 2083; 1853; 50051; 66377; 20.05; 14.57; 1003649; 556765; 2425789; 2352972; 34.79; 80.29; 80.22; 79.51; 3330.05; 4687.92; 7030.06
futsuu no fantasy; 2018; 1777; 39163; 48822; 19.05; 14.74; 745922; 422486; 1778854; 1719851; 26.29; 78.63; 83.66; 83.46; 3685.12; 4967.25; 6996.77
gensou no idea; 2481; 2225; 32461; 47681; 25.32; 17.16; 821785; 475016; 1958269; 1929489; 29.69; 78.89; 78.20; 78.10; 5636.40; 7491.10; 10116.40
grisaia; 2611; 2364; 62748; 96326; 27.18; 16.69; 1705580; 967235; 3971468; 3767371; 58.75; 77.79; 79.18; 78.81; 4551.50; 6364.96; 9473.62
hanachirasu; 2149; 1742; 5877; 7823; 23.91; 17.90; 140515; 87663; 349599; 345074; 5.50; 72.57; 60.20; 60.63; 9153.65; 11901.15; 16288.70
hanahira; 947; 654; 3571; 4263; 13.40; 10.88; 47866; 25278; 124311; 120902; 1.61; 87.59; 83.71; 87.23; 3037.82; 4056.89; 6249.55
harumade kururu; 1908; 1658; 39430; 47498; 14.64; 11.73; 577162; 328041; 1388399; 1348107; 19.97; 85.98; 85.74; 86.34; 2896.68; 4061.82; 6224.40
hatsukoi yohou; 1834; 1586; 30370; 48340; 20.26; 12.39; 615425; 351700; 1523937; 1483369; 21.96; 81.41; 84.56; 84.85; 2292.98; 3225.53; 4822.00
hatsuyuki sakura; 1980; 1705; 35304; 47188; 15.71; 11.32; 554715; 314108; 1411404; 1307815; 19.17; 82.56; 85.23; 85.16; 4109.77; 5673.30; 8378.67
henkoi; 1897; 1602; 21719; 48348; 25.13; 11.00; 545804; 294522; 1373860; 1361135; 18.42; 80.41; 78.54; 78.33; 3143.69; 4548.43; 6587.27
hoshimemo; 2080; 1864; 54205; 60836; 16.99; 14.68; 921017; 537002; 2073147; 1997427; 32.91; 82.82; 81.53; 81.09; 4296.95; 5739.74; 8141.13
iinchou shounin; 2051; 1789; 32743; 57165; 18.25; 10.10; 597436; 329258; 1508808; 1481290; 20.45; 81.00; 81.80; 82.34; 3299.92; 4539.42; 6796.08
imakoi; 1446; 1157; 5991; 9542; 24.60; 15.16; 147388; 81016; 342955; 341436; 5.10; 82.87; 78.56; 78.39; 3014.96; 3951.12; 5467.40
inganock; 2065; 1816; 17648; 32300; 23.39; 11.92; 412809; 228753; 968180; 896988; 14.13; 76.22; 73.45; 71.75; 5817.45; 7753.40; 10512.90
itsusora; 2465; 2182; 30247; 36196; 19.68; 16.10; 595181; 355594; 1433403; 1386755; 21.77; 82.58; 81.77; 79.75; 5079.18; 6917.42; 9812.31
kikaijikake no eve; 2566; 2361; 44740; 85707; 35.13; 17.96; 1571801; 896917; 3644082; 3582523; 56.50; 72.62; 69.76; 68.51; 6398.85; 8387.85; 11338.65
jingai makyou; 2495; 2208; 35361; 53182; 23.75; 13.92; 839691; 451756; 2055351; 1804776; 28.07; 74.33; 82.12; 80.54; 5363.05; 7204.80; 10039.25
kagerou; 2938; 2598; 21148; 27024; 37.73; 29.67; 797910; 488504; 1912123; 1897640; 30.67; 71.14; 64.00; 65.20; 8744.91; 11637.32; 16069.17
kajiri akebono; 2861; 2565; 32668; 52551; 32.12; 19.43; 1049349; 624008; 2515798; 2457232; 39.36; 80.75; 66.47; 64.64; 7461.88; 9795.79; 13333.38
kamikaze explorer; 2244; 1981; 45828; 76382; 23.82; 13.93; 1091420; 604293; 2668876; 2617771; 37.80; 77.41; 80.76; 78.47; 3594.97; 4877.01; 7217.38
kamimaho; 2159; 1945; 44145; 51492; 20.02; 16.94; 883782; 523540; 2152608; 2117316; 32.85; 78.50; 80.14; 79.25; 3560.80; 4779.86; 6901.15
kanojo no seiiki; 1294; 1056; 8188; 11395; 19.80; 13.92; 162124; 92009; 394844; 388839; 5.71; 83.47; 85.68; 86.16; 2401.80; 3276.30; 4745.88
katahane; 1865; 1659; 46768; 40574; 13.15; 14.30; 614909; 330445; 1481610; 1425979; 20.09; 82.46; 80.81; 81.10; 3563.09; 5073.10; 7591.65
kaziklu; 2068; 1726; 6099; 10068; 34.54; 20.67; 210682; 122656; 484567; 482447; 7.66; 67.93; 75.92; 76.91; 6100.35; 8174.90; 10894.10
kimikoe; 2222; 1981; 44891; 56879; 16.57; 12.70; 743935; 418580; 1819039; 1772716; 26.39; 81.05; 83.29; 83.41; 4204.69; 5801.23; 8398.00
kirakira; 2281; 1986; 35716; 50270; 30.25; 21.12; 1080238; 630810; 2557768; 2519197; 38.90; 74.75; 79.53; 80.45; 3786.04; 5191.65; 7707.99
koichoco; 1991; 1760; 41241; 56740; 18.93; 13.32; 780580; 434221; 1979633; 1881859; 27.31; 76.64; 82.10; 81.18; 4197.30; 5617.89; 8155.61
leyline1+2+3; 2019; 1795; 57821; 76028; 19.90; 14.70; 1150758; 667259; 2777676; 2694759; 41.09; 83.67; 85.31; 85.76; 2568.25; 3515.40; 5142.10
leyline1; 1596; 1323; 17968; 23564; 18.62; 13.73; 334620; 194618; 813931; 791074; 11.93; 86.85; 85.59; 86.12; 2234.13; 3014.79; 4420.00
leyline2; 1748; 1473; 21063; 27396; 20.49; 15.33; 431582; 251488; 1036671; 1009047; 15.44; 83.47; 84.77; 85.21; 2535.70; 3499.66; 5089.52
leyline3; 1661; 1441; 18790; 25796; 20.43; 14.60; 383865; 223425; 926788; 909650; 13.83; 82.01; 85.12; 85.49; 2784.50; 3679.69; 5383.30
magical charming; 2118; 1803; 37239; 55448; 17.75; 11.63; 661122; 365137; 1649810; 1611665; 22.92; 80.49; 83.72; 83.55; 3134.04; 4561.63; 6977.16
majokoi; 1970; 1709; 37288; 46138; 15.83; 11.85; 590196; 320054; 1490266; 1349107; 19.68; 84.50; 87.74; 87.89; 3099.37; 4462.50; 6560.90
mamiyakun-chi; 1945; 1723; 39099; 62619; 24.29; 14.86; 949907; 537997; 2293535; 2266268; 34.24; 77.16; 84.20; 82.84; 2946.68; 3915.98; 5609.65
monobeno; 2421; 2186; 96984; 154996; 21.83; 13.29; 2117635; 1112093; 5182146; 4968589; 72.02; 82.71; 89.16; 87.96; 4969.21; 6938.51; 9753.02
muramasa; 3070; 2793; 80564; 87653; 15.30; 13.75; 1232446; 733011; 3176908; 3019944; 46.79; 75.48; 62.33; 63.03; 9858.00; 12594.03; 17168.48
nanarin; 1851; 1589; 39789; 42928; 17.83; 10.27; 709247; 248506; 1830351; 1120735; 15.83; 79.26; 87.12; 86.23; 3029.97; 4131.86; 6081.50
nanatsuiro; 1543; 1312; 26930; 36064; 17.12; 12.61; 460913; 269083; 1122537; 1122517; 16.50; 83.64; 87.78; 88.03; 1868.07; 2534.14; 3893.45
natsukumo yururu; 2004; 1766; 51421; 60068; 15.03; 12.41; 772622; 440932; 1844431; 1780832; 26.64; 84.90; 84.37; 84.69; 3154.27; 4387.54; 6629.49
nine kokoiro; 1536; 1236; 8802; 12706; 16.55; 11.26; 145707; 82176; 369833; 358303; 5.18; 75.61; 81.19; 80.18; 3596.20; 4818.64; 6780.62
noratoto; 2050; 1783; 41303; 58114; 16.35; 11.27; 675396; 365327; 1692782; 1636726; 22.74; 84.67; 83.00; 85.56; 3672.93; 5182.29; 7838.15
nursery rhyme; 2046; 1779; 32500; 41516; 20.63; 15.78; 670321; 374822; 1616247; 1577109; 23.50; 81.65; 82.42; 82.14; 3339.56; 4614.22; 6736.79
oniikiss fd; 1449; 1176; 22708; 19526; 17.09; 12.53; 388161; 138850; 971198; 597288; 8.56; 84.41; 85.96; 89.85; 2397.74; 3348.44; 4814.41
oniikiss; 1951; 1681; 41966; 50792; 20.69; 12.36; 868147; 356678; 2214340; 1564783; 22.34; 81.36; 89.20; 91.83; 2584.69; 3566.59; 5124.78
oretsuba afterstory; 2131; 1827; 16417; 26109; 25.53; 15.72; 419120; 231391; 995689; 979710; 14.56; 81.45; 80.56; 80.54; 5519.00; 7516.80; 10880.67
oretsuba prelude; 2171; 1798; 8816; 15168; 31.09; 17.69; 274070; 150433; 634811; 625030; 9.41; 79.57; 72.34; 71.04; 8448.00; 11193.33; 15278.85
oretsuba; 2770; 2482; 56675; 89741; 30.23; 17.71; 1713369; 908305; 3978483; 3692838; 56.59; 80.60; 78.29; 78.38; 7111.22; 9544.05; 13414.11
ouka sabaki; 2145; 1914; 33862; 54858; 21.10; 12.31; 714638; 411104; 1801613; 1711326; 25.43; 87.26; 77.09; 75.66; 3745.00; 5270.84; 8086.93
parfait; 2113; 1834; 37003; 49015; 18.64; 11.60; 689863; 327039; 1730006; 1396010; 20.52; 73.68; 83.96; 82.56; 4173.50; 5676.54; 8223.50
prawfclwyd; 2018; 1766; 25602; 34977; 18.99; 13.57; 486264; 270053; 1217811; 1187626; 17.17; 74.35; 85.85; 85.44; 4275.90; 6020.20; 8778.46
princessfrontier; 2342; 2096; 48063; 61194; 16.86; 12.89; 810467; 449604; 1965704; 1927480; 27.99; 81.85; 81.21; 81.25; 5432.55; 7585.20; 10978.95
rabuobu; 2169; 1904; 34143; 53700; 19.47; 11.64; 664852; 356575; 1613985; 1530452; 22.10; 83.09; 80.85; 81.13; 5260.04; 7216.78; 10380.12
rewrite+; 2646; 2409; 97740; 116315; 16.49; 13.55; 1611349; 930361; 3861665; 3742400; 58.14; 78.10; 75.12; 74.59; 6775.81; 8829.12; 12063.07
rinshin; 2210; 1949; 28964; 46057; 26.02; 15.53; 753720; 414396; 1787780; 1707720; 25.88; 78.39; 80.73; 79.80; 5390.50; 7245.50; 10257.60
sansha mendan; 2042; 1841; 34816; 64406; 34.77; 18.37; 1210691; 621255; 2817128; 2785920; 41.26; 77.20; 72.07; 69.79; 4747.20; 6072.47; 8409.32
satsukoi; 1882; 1587; 23111; 23947; 12.80; 11.93; 295846; 169260; 743615; 710642; 10.52; 80.51; 83.70; 83.90; 3735.96; 5117.48; 7460.78
sengoku koihime x; 2915; 2667; 122581; 199749; 22.78; 13.60; 2792693; 1633397; 6883907; 6729611; 102.29; 84.48; 81.74; 81.26; 5145.21; 7220.25; 10842.54
senmomo; 2513; 2235; 48841; 54049; 16.87; 14.91; 824140; 491207; 1981794; 1946095; 31.45; 75.08; 68.15; 66.62; 5853.10; 7803.60; 10810.08
senrenbanka; 2222; 1918; 54585; 79446; 20.03; 13.42; 1093530; 617721; 2672904; 2618031; 38.39; 81.96; 85.54; 85.88; 2641.44; 3733.70; 5644.43
senshinkan bansenjin; 2644; 2376; 26142; 42276; 33.07; 20.27; 864568; 516024; 1994101; 1977766; 32.45; 76.73; 74.46; 75.33; 5577.21; 7377.67; 10448.60
senshinkan hachimyoujin; 2858; 2544; 34771; 56287; 33.51; 20.49; 1165087; 696088; 2740617; 2711958; 43.93; 78.27; 72.96; 74.40; 6537.13; 8617.47; 11727.45
sharnoth fvr; 2124; 1877; 20847; 35054; 24.15; 13.12; 503476; 265581; 1173739; 1066449; 16.44; 73.29; 77.03; 73.93; 5574.34; 7434.48; 10619.35
shin koihime eiyuutan 1; 1857; 1567; 14762; 28742; 26.90; 13.60; 397083; 227951; 968808; 962883; 14.50; 85.26; 86.60; 87.13; 2961.88; 4085.35; 6017.37
shin koihime eiyuutan 2; 1897; 1659; 19520; 37802; 23.20; 11.70; 452822; 264343; 1150691; 1132365; 16.47; 84.86; 85.72; 85.76; 3030.13; 4290.74; 6609.25
shin koihime eiyuutan 3; 1921; 1669; 19418; 32457; 22.21; 12.98; 431246; 246365; 1070164; 1056455; 15.55; 83.91; 86.43; 85.60; 3508.07; 4840.62; 7014.26
shin koihime eiyuutan plus; 1366; 1062; 4608; 7943; 23.20; 13.05; 106899; 59705; 263751; 261187; 3.75; 87.57; 88.23; 89.35; 3192.73; 4339.69; 6714.75
shin koihime musou kakumei 1; 2608; 2363; 76318; 132230; 22.76; 12.74; 1736755; 1002655; 4287602; 4207252; 62.59; 86.00; 85.27; 86.21; 4315.64; 6154.84; 9388.94
shirokuma; 2432; 2127; 48077; 70659; 21.46; 14.01; 1031582; 557907; 2515346; 2452640; 34.61; 80.86; 78.33; 77.98; 6256.96; 8232.90; 11571.90
shugaten; 1763; 1521; 24869; 29261; 15.57; 12.91; 387316; 214006; 965349; 901986; 13.13; 83.74; 79.46; 79.76; 4308.66; 6066.78; 8965.96
silverio vendetta; 2758; 2487; 24342; 39584; 35.67; 21.82; 868301; 510102; 2158325; 2150337; 33.02; 70.10; 65.03; 68.74; 8838.05; 10938.65; 14155.74
simulacre; 1771; 1515; 13577; 19050; 21.27; 15.03; 288819; 178681; 685150; 674597; 10.82; 81.36; 84.19; 82.15; 2756.59; 3766.76; 5629.40
snowwhite; 1546; 1240; 5778; 7959; 30.93; 22.14; 178726; 106545; 417532; 410758; 6.49; 78.65; 83.44; 85.65; 2614.20; 3677.08; 5458.60
soramitsu; 2125; 1925; 46347; 58061; 22.64; 15.36; 1049089; 518230; 2578691; 2185261; 32.49; 79.44; 85.08; 84.67; 3546.10; 4811.00; 6841.93
sourire; 1894; 1637; 30168; 44601; 20.83; 13.77; 628424; 362062; 1555598; 1511058; 22.50; 80.49; 87.63; 86.72; 2399.50; 3296.69; 4930.37
subahibi; 2238; 1996; 58018; 74763; 18.33; 11.77; 1063337; 520905; 2713808; 2237407; 32.17; 78.01; 81.39; 80.93; 3995.53; 5673.56; 8215.06
sukinara; 2069; 1835; 60041; 84942; 20.91; 14.09; 1255586; 682601; 3147409; 3007064; 42.08; 82.34; 85.24; 85.51; 3307.12; 4545.27; 6769.58
summer pockets; 2115; 1849; 62271; 64181; 12.00; 10.68; 747365; 407980; 1918668; 1709050; 24.50; 85.13; 86.13; 88.00; 3911.67; 5587.71; 8333.00
tarareba; 1797; 1553; 20992; 32452; 22.27; 14.25; 467570; 262555; 1119586; 1119535; 16.43; 79.21; 82.62; 82.60; 2744.40; 3778.26; 5521.26
trinoline; 1954; 1692; 27628; 34306; 18.66; 14.67; 515408; 286655; 1259214; 1226295; 18.14; 77.91; 85.36; 84.24; 2695.38; 3704.20; 5489.54
tsujidou-san no jun'ai road; 2269; 2019; 80118; 102793; 14.93; 11.31; 1196359; 651727; 2940726; 2766732; 40.48; 84.30; 76.93; 76.55; 5275.48; 7245.48; 10257.10
tsujidou-san no virgin road; 2064; 1802; 43219; 54886; 15.43; 11.86; 666755; 367278; 1632300; 1545307; 22.70; 83.32; 77.10; 76.34; 5031.55; 6927.87; 10090.91
tsuriotsu; 2390; 2102; 30932; 60869; 34.31; 17.25; 1061406; 636679; 2455467; 2436023; 38.67; 79.87; 80.69; 81.14; 3470.73; 4805.95; 7257.95
tsuushinbo; 1866; 1617; 28505; 43993; 21.66; 13.82; 617432; 343593; 1503324; 1477566; 21.70; 86.13; 88.81; 89.13; 2541.43; 3401.63; 5009.90
twinklecrusaders; 2586; 2313; 77293; 115311; 19.82; 13.10; 1531958; 850300; 3680074; 3678307; 52.76; 80.37; 77.34; 76.03; 5464.50; 7376.84; 10614.06
white_album; 1831; 1481; 29108; 31890; 15.90; 13.32; 462896; 251596; 1123118; 1014554; 15.59; 79.00; 84.06; 82.58; 2773.77; 3954.30; 6073.98
yoakena; 2134; 1902; 57455; 60314; 14.48; 13.37; 831742; 467022; 2074181; 1942943; 29.29; 78.88; 82.24; 81.54; 3533.71; 4849.82; 7160.95
script name; kanji\n(unique); kanji\n(2+); chars; lexemes; sentences; lines; chars\n/line; chars\n/sentence; hours estimate; sjis bytes; freqlist\n90% Target; freqlist\n92.5% Target; freqlist\n95% Target; metric a; metric b; metric c; metric d
aete mushisuru;1987;1723;487284;285571;41916;35166;13.86;11.49;17.75;1186788;3774.67;5249.05;7669.92;82.48;80.83;81.11;82.30
amakoi;2028;1752;780069;442826;54686;28028;27.83;13.96;27.61;1863787;2610.24;3623.40;5478.91;91.16;92.27;91.05;89.73
ao no kanata;2129;1846;873044;505670;56968;42554;20.52;15.15;31.46;2039182;3266.83;4551.23;6764.82;81.15;80.40;80.85;80.79
astelight shuushuubako;2982;2595;485559;293340;14344;9535;50.92;33.55;18.65;1062193;11822.55;14968.33;20006.85;47.63;65.90;62.84;58.27
axanael;1861;1585;378897;208590;43090;31457;12.04;8.66;12.86;1018620;4473.03;6185.94;8852.18;77.37;74.89;74.59;76.23
biman1;1750;1394;177219;98201;12451;7630;23.23;14.05;6.27;435951;4260.90;5683.87;8101.80;82.34;82.02;82.45;82.25
buraban;1800;1570;743503;437600;59511;39213;18.96;12.38;27.10;1843652;1935.97;2684.83;4162.70;85.14;85.33;85.87;86.25
chronobox;1985;1737;490390;275580;41199;22341;21.95;11.60;17.54;1215132;4078.96;5481.36;8027.40;82.76;82.92;83.29;83.25
chronobox trials;1265;914;62045;35103;5448;3102;20.00;11.14;2.24;153851;3214.80;4330.18;6543.58;83.20;84.36;84.40;84.74
clacra;2215;1954;798979;448038;58006;40785;19.59;13.48;28.51;1966623;3943.99;5445.39;7776.45;83.09;82.36;82.96;83.07
cloverpoint;2258;1995;826177;474200;60632;40705;20.30;13.47;29.68;2000171;4705.86;6448.75;9354.50;82.24;81.60;82.09;81.81
daitoshokan;2312;2055;1062593;627059;76469;65781;16.15;13.81;39.49;2517383;3876.12;5338.45;7770.46;80.41;79.49;79.48;79.83
daitoshokan fandisk;2035;1760;458971;267957;34261;28268;16.24;13.31;16.96;1090969;3826.30;5230.74;7475.65;81.36;80.52;80.74;81.00
dies irae;2790;2551;1614080;951741;89885;54695;29.51;17.69;59.89;3623949;6527.17;8713.60;11887.69;76.03;75.78;75.61;75.52
dracuriot;2218;1944;1154120;663550;84384;49856;23.15;13.54;40.95;2788115;3082.67;4276.20;6400.32;82.97;82.65;82.78;81.96
eustia;2454;2210;946912;565396;69146;61214;15.47;13.65;34.92;2233829;4351.62;6186.41;8976.12;83.30;82.24;82.97;83.32
fate stay night;2556;2320;1598035;958825;93064;67643;23.62;17.06;59.12;3670684;4877.72;6484.58;9027.63;76.00;76.68;77.29;76.63
flowers1;1979;1690;313427;191620;18334;12505;25.06;16.99;11.82;715696;4197.77;5878.24;8919.55;75.62;74.99;74.67;74.98
flowers2;2032;1731;255414;155134;14646;10300;24.80;17.34;9.66;577012;5762.85;8023.76;11401.67;70.19;70.60;69.98;70.18
flowers3;2084;1808;279235;172879;16034;11020;25.34;17.30;10.59;628936;5631.20;7768.65;10836.87;69.85;70.39;69.92;70.11
flyable heart;1849;1626;786204;460113;56446;42919;18.32;13.81;28.58;1856734;2106.53;2934.41;4518.75;87.52;87.67;87.60;87.75
fortissimoexs;2306;2107;1229133;719469;68827;42717;28.77;17.43;45.47;2898110;3990.75;5352.41;7473.89;78.73;79.38;79.03;77.15
fortunearterial;2186;1942;852111;505495;66355;62552;13.62;12.79;31.55;2020723;3594.68;4918.94;7294.45;83.30;82.78;83.01;83.87
fureraba;2083;1853;972057;557185;65668;49041;19.82;14.63;34.79;2326559;3279.63;4638.94;7076.20;80.80;80.20;80.70;80.44
futsuu no fantasy;2018;1777;719328;422455;48851;36967;19.46;14.67;26.28;1685892;3588.67;4914.03;7082.67;84.41;83.96;84.45;84.13
gensou no idea;2481;2225;809804;476863;48809;31707;25.54;16.27;29.69;1860870;5529.10;7439.72;10088.85;78.63;78.23;77.76;77.86
grisaia;2611;2364;1616264;967480;95866;58976;27.41;16.58;58.75;3722925;4443.94;6246.21;9307.31;78.97;79.27;79.69;78.92
hanachirasu;2149;1742;139219;88041;7848;5840;23.84;17.66;5.50;313174;9058.90;11780.35;16101.97;60.16;59.48;56.76;57.65
hanahira;947;654;46525;25363;4264;3487;13.34;10.77;1.61;118834;2857.60;3937.60;6067.40;84.48;86.52;83.93;83.87
harumade kururu;1908;1659;561302;329066;41978;24170;23.22;13.24;20.04;1331974;2799.83;3958.99;6162.05;86.82;87.21;86.65;86.93
hatsukoi yohou;1834;1586;596846;352632;47730;28876;20.67;12.46;21.96;1462836;2200.27;3082.53;4713.60;85.37;85.26;85.32;85.63
hatsuyuki sakura;1980;1705;535514;314103;47091;34890;15.35;11.29;19.17;1321507;3958.88;5473.78;8251.62;85.27;86.28;86.06;87.52
henkoi;1897;1602;529937;296027;46944;21506;24.64;11.19;18.42;1341639;2985.29;4302.73;6377.17;78.51;76.89;77.50;77.06
hoshimemo;2080;1864;893158;538675;60811;53037;16.84;14.64;32.92;1967904;4196.60;5635.32;8078.25;82.43;81.49;81.42;82.49
iinchou shounin;2051;1789;575115;330257;57137;31613;18.19;9.97;20.45;1452024;3199.60;4475.97;6707.17;82.96;82.16;82.57;83.38
imakoi;1446;1157;143689;81099;9229;5826;24.66;15.52;5.10;335623;3009.20;3901.80;5475.37;78.02;78.38;78.93;78.58
inganock;2065;1816;384975;229312;32103;16295;23.63;11.60;14.13;882985;5273.00;7044.01;9899.50;76.03;72.60;72.05;74.26
itsusora;2465;2182;583122;356470;35948;29092;20.04;15.86;21.78;1329820;4974.40;6841.88;9834.75;80.70;79.49;80.38;80.57
jingai makyou;2495;2207;752909;450310;52865;30595;24.61;13.86;27.93;1742586;5294.96;7068.57;9943.40;81.42;79.71;80.53;81.48
kagerou;2938;2598;792047;489011;26550;19906;39.79;29.79;30.67;1761494;8426.90;11310.26;15944.21;65.88;62.74;66.29;63.38
kajiri 18;2798;2488;846474;512648;45515;27063;31.28;18.29;32.35;1899540;7673.58;10054.90;13970.30;66.50;65.65;67.00;67.06
kajiri akebono;2861;2565;1027163;624653;53302;31694;32.41;19.00;39.37;2293097;7411.94;9880.73;13790.73;66.44;65.44;66.72;66.65
kamikaze explorer;2244;1981;1066809;604325;76446;44103;24.19;13.72;37.80;2571862;3510.22;4821.47;7104.64;80.18;79.40;80.38;79.76
kamimaho;2159;1945;870689;524213;52471;42813;20.34;16.53;32.85;2014648;3422.40;4648.41;6708.72;80.53;78.84;79.12;79.61
kanojo no seiiki;1294;1056;158859;92009;11349;7970;19.93;13.92;5.71;381072;2392.23;3243.93;4745.27;86.97;86.94;86.44;86.78
katahane;1865;1659;569480;332630;40062;28103;20.26;14.19;20.09;1385255;3440.08;4887.07;7330.26;80.62;80.60;80.60;79.68
kaziklu;2068;1726;209725;122771;10189;6061;34.60;20.33;7.66;462813;6177.00;8206.88;11068.17;75.91;77.35;77.70;77.04
kikaijikake no eve;2566;2361;1531763;898559;85737;43525;35.19;17.68;56.49;3541220;6339.68;8320.25;11444.91;67.22;69.84;70.46;69.19
kimikoe;2222;1981;722740;420545;57012;43427;16.64;12.55;26.39;1739034;4131.44;5669.68;8411.55;84.25;83.75;83.85;84.12
kirakira;2281;1986;1064565;631370;50511;34586;30.78;20.98;38.92;2380568;3663.04;5063.24;7536.61;80.83;80.99;81.26;79.59
koichoco;1991;1760;756457;434318;56921;39071;19.36;13.19;27.31;1855570;4004.70;5567.27;8166.71;82.20;81.76;82.29;81.64
leyline1;1596;1323;324310;194743;23200;17452;18.58;13.87;11.93;778333;2083.73;2816.15;4084.04;86.83;87.62;87.37;87.05
leyline2;1748;1473;421338;252367;27251;20727;20.33;15.34;15.44;996191;2363.62;3276.50;4715.89;86.16;85.79;85.60;84.95
leyline3;1661;1441;376493;224473;25497;18358;20.51;14.66;13.83;893636;2616.58;3454.97;5012.77;86.09;85.89;85.81;85.12
magical charming;2118;1803;645324;365851;55385;36516;17.67;11.54;22.92;1589846;3076.84;4501.36;6923.74;84.29;84.67;84.61;85.40
majokoi;1970;1709;547341;320953;45995;35060;15.61;11.84;19.68;1347720;3043.70;4387.83;6548.27;87.35;89.20;88.66;89.51
mamiyakun-chi;1945;1723;945532;538033;62698;38082;24.83;14.82;34.24;2231160;2953.46;3886.52;5594.03;84.09;83.36;83.96;83.43
monobeno;2421;2186;2011868;1112344;172390;90236;22.30;11.55;72.02;4887951;4894.33;6677.16;9740.10;87.07;89.26;88.84;89.46
muramasa;3070;2793;1189809;734933;89355;78135;15.23;13.24;46.82;2790559;9833.49;12580.78;17094.95;64.35;63.13;59.23;61.61
nanarin;1851;1589;447450;249239;42533;26282;17.02;10.22;15.83;1122490;2916.19;4005.63;5825.71;84.20;86.65;87.23;87.86
nanatsuiro;1543;1312;453855;269699;36028;26947;16.84;12.51;16.50;1095590;1715.74;2385.16;3644.99;87.99;88.77;88.64;88.99
natsukumo yururu;2004;1768;750409;442961;53449;31376;23.92;13.93;26.78;1766298;3131.58;4401.96;6645.56;85.64;85.55;85.09;85.42
nine kokoiro;1536;1236;142515;82198;12729;9035;15.77;11.15;5.18;355520;3443.96;4611.48;6541.80;81.85;81.12;81.94;82.92
noratoto;2050;1783;651917;367290;57781;40372;16.15;11.17;22.74;1611264;3688.68;5132.89;7918.85;85.23;85.60;84.05;84.52
nursery rhyme;2046;1779;655804;377828;41431;31423;20.87;15.72;23.50;1529245;3184.56;4458.73;6532.36;83.14;82.82;82.88;82.34
oniikiss;1951;1681;627490;356693;50762;29170;21.51;12.26;22.34;1549471;2526.20;3511.09;5133.98;90.56;92.46;90.95;89.74
oniikiss fd;1449;1176;245920;138855;19471;14206;17.31;12.48;8.56;597564;2374.13;3258.86;4802.32;89.08;91.20;87.84;86.94
oretsuba;2770;2482;1596292;911520;89710;52522;30.39;17.58;56.59;3616658;6943.48;9352.95;13162.66;76.97;78.28;78.75;77.33
oretsuba afterstory;2131;1827;412904;232540;26122;16054;25.72;15.58;14.56;955772;5372.25;7310.58;10417.12;80.14;79.98;80.17;78.79
oretsuba prelude;2171;1798;269924;150890;15150;8671;31.13;17.53;9.41;611915;8083.95;10729.74;14619.72;67.82;69.89;71.43;70.02
ouka sabaki;2145;1914;674913;411106;54008;31873;21.18;12.42;25.43;1680317;3606.50;5181.50;7849.50;76.08;78.64;79.34;80.26
parfait;2113;1834;567028;327105;48972;33091;17.14;11.49;20.52;1402932;3982.45;5486.98;8108.40;82.91;83.17;83.99;84.11
prawfclwyd;2018;1766;474599;271160;34908;24396;19.45;13.52;17.17;1171815;4112.70;5710.21;8452.89;85.59;85.87;86.50;84.88
primary by skyfish;2024;1778;831422;474158;67737;35497;23.42;12.05;29.24;2076479;2977.73;4221.52;6725.20;81.44;80.66;81.34;81.62
princessfrontier;2342;2096;789097;453081;61397;46855;16.84;12.72;27.99;1887534;5257.59;7384.78;10864.27;82.21;81.02;81.61;81.58
rabuobu;2169;1904;625204;357904;53398;33008;18.94;11.57;22.10;1503986;5157.83;7143.38;10470.75;82.66;81.38;81.50;82.71
rewrite+;2646;2409;1575954;930667;114939;98133;16.06;13.61;58.14;3708167;6692.84;8758.10;12088.27;76.98;75.19;75.00;76.20
rinshin;2210;1950;715377;415286;45936;27074;26.42;15.48;25.88;1679160;5301.70;7280.01;10192.35;80.99;80.44;80.94;79.87
satsukoi;1882;1587;285162;169911;24064;22372;12.75;11.77;10.52;700304;3582.75;4947.58;7063.62;85.16;84.05;84.35;85.42
senmomo;2513;2235;806430;492352;53978;47589;16.95;14.88;31.45;1894262;5555.97;7714.71;11041.24;66.78;65.83;64.96;65.85
senrenbanka;2222;1918;1068052;619622;79277;53777;19.86;13.36;38.39;2577729;2605.11;3671.96;5604.45;86.44;86.52;86.32;86.11
sensinkan bansenzin;2644;2376;856646;516408;42693;25801;33.20;19.96;32.45;1905606;5452.83;7328.02;10434.75;76.54;75.07;74.63;73.84
sensinkan hatimyouzin;2858;2544;1152108;696234;56847;34121;33.77;20.14;43.91;2549881;6582.40;8786.74;11906.92;75.48;74.21;73.52;72.79
sharnoth fvr;2124;1877;460329;265506;34861;18887;24.37;12.66;16.44;1049854;5277.79;6955.84;9930.99;77.79;75.08;76.20;77.76
shin koihime eiyuutan 1;1857;1567;392490;227928;28739;14550;26.98;13.55;14.50;948719;2909.49;4008.64;5981.68;87.38;88.67;88.69;88.02
shin koihime eiyuutan 2;1897;1659;444312;264335;37757;18946;23.45;11.68;16.47;1113805;2887.67;4128.79;6436.02;84.64;86.96;87.48;87.70
shin koihime eiyuutan 3;1921;1669;423461;246360;32296;18923;22.38;12.95;15.55;1039439;3271.65;4605.40;6788.45;85.59;86.63;87.19;87.33
shin koihime eiyuutan plus;1366;1062;104297;59698;7885;4544;22.95;13.06;3.75;256889;3086.05;4245.83;6565.55;89.28;90.94;90.16;89.89
shirokuma;2432;2127;1010345;559611;70374;46484;21.74;13.94;34.61;2409592;6018.56;8054.15;11507.63;78.83;78.38;78.82;78.10
shugaten;1763;1521;376878;215826;29312;24543;15.36;12.77;13.16;898595;4032.46;5755.26;8319.24;80.34;79.56;79.21;79.93
silverio vendetta;2758;2486;863983;510541;39798;24114;35.83;21.47;33.01;1898888;8915.47;11116.60;14519.37;66.00;68.75;66.32;65.19
simulacre;1771;1515;285163;178791;19263;13170;21.65;14.75;10.82;662112;2600.33;3563.06;5332.25;82.50;81.08;82.36;83.18
snowwhite;1546;1240;176057;107042;8085;5681;30.99;21.70;6.49;394306;2482.20;3471.80;5195.20;85.04;85.51;85.73;83.97
soramitsu;2125;1925;902605;519719;57642;39593;22.80;15.32;32.49;2147612;3477.89;4745.20;6785.37;85.57;85.13;85.39;84.66
sourire;1894;1637;618316;363343;44900;28629;21.60;13.59;22.50;1489796;2338.36;3207.45;4799.17;87.14;87.17;87.60;87.63
subahibi;2238;1996;883648;523303;74527;47508;18.60;11.64;32.17;2157907;3912.49;5536.02;8182.82;82.27;81.41;81.50;82.83
sukinara;2069;1835;1238443;685809;85195;56305;22.00;13.92;42.10;2930318;3228.64;4474.42;6723.62;86.46;87.01;85.83;85.17
summer pockets;2115;1848;686283;407996;63937;57625;11.91;10.64;24.50;1711511;3754.20;5511.91;8257.20;87.65;88.89;87.97;89.68
tarareba;1797;1553;462740;263306;32798;20984;22.05;13.94;16.43;1098004;2701.67;3666.95;5445.55;83.49;83.27;83.61;83.09
trinoline;1954;1692;495438;287809;34375;26522;18.68;14.31;18.14;1195563;2642.96;3609.71;5361.45;85.21;84.57;84.91;84.94
tsujidou-san no jun'ai road;2269;2019;1159724;656009;102403;78598;14.76;11.18;40.49;2783014;5193.59;7142.62;10308.76;78.61;75.67;76.25;77.90
tsujidou-san no virgin road;2064;1802;649154;369377;54690;42858;15.15;11.72;22.70;1553124;4985.60;6880.93;10150.30;78.43;76.00;76.64;78.00
tsuriotsu;2390;2102;1053271;637552;60946;30444;34.60;17.19;38.67;2388922;3250.97;4594.48;7043.25;81.78;81.36;81.40;81.33
tsuushinbo;1866;1617;612627;344763;44156;27811;22.03;13.66;21.70;1453184;2516.61;3367.62;5022.18;89.68;90.99;89.87;89.16
twinklecrusaders;2586;2313;1504925;856148;116844;77205;19.49;12.71;52.75;3600579;5358.97;7354.73;10578.42;77.97;76.20;77.11;77.50
tyrhhia;2604;2206;295145;179000;18314;11773;25.07;15.71;11.36;661103;10734.75;13882.75;18986.50;63.85;62.59;61.57;62.62
white_album;1831;1481;425614;251896;31841;26146;16.28;13.31;15.59;1008614;2603.59;3770.21;5720.65;83.62;82.99;83.49;84.71
yoakena;2134;1902;802113;467812;60023;59051;13.58;13.31;29.25;1945323;3488.03;4780.68;7093.70;83.38;82.21;83.15;83.60
Line 144: Line 134:

The Hayashi metric is derived from: chars per sentence; commas per periods*; average consecutive length of each of kanji/hiragana/katakana/other

* sentence endings imply periods

The custom metrics are derived from:

{{{#!python
runlen_han = counts[0]/runs[0]
runlen_hira = counts[1]/runs[1]
runlen_kata = counts[2]/runs[2]

avg_counts = sum(counts[:3])/3
prop_han = counts[0]/avg_counts
prop_hira = counts[1]/avg_counts
prop_kata = counts[2]/avg_counts

avg_runs = sum(runs[:3])/3
prop_runs_han = runs[0]/avg_runs
prop_runs_hira = runs[1]/avg_runs
prop_runs_kata = runs[2]/avg_runs

norm_han = runlen_han *prop_han
norm_hira = runlen_hira*prop_hira
norm_kata = runlen_kata*prop_kata

sentence_han = counts[0]/sentences
sentence_hira = counts[1]/sentences
sentence_kata = counts[2]/sentences

runs_sentence = sum(runs[:3])/sentences
sentencelen = sentencechars/sentences

# ....

properties_a = [
    math.log(prop_han),
    math.log(prop_hira),
    math.log(prop_kata),
    
    math.log(prop_runs_han),
    math.log(prop_runs_hira),
    math.log(prop_runs_kata),
    
    norm_han,
    norm_hira,
    norm_kata,
    
    sentence_han,
    sentence_hira,
    sentence_kata,
    
    1/runs_sentence,
    math.log(sentencelen)
]
weights_a = [
-3.4920757 ,
-0.6549337 ,
-0.17232664,
 1.0730087 ,
-1.1602864 ,
 0.02242127,
 1.764859 ,
-0.10058399,
 0.23199975,
 0.0919582 ,
 0.01803382,
 0.04476589,
-1.3525765 ,
-0.76003593,
 0.20918524
]
properties_b = [
    runlen_han,
    runlen_hira,
    runlen_kata,
    
    math.log(prop_han),
    math.log(prop_hira),
    math.log(prop_kata),
    
    math.log(prop_runs_han),
    math.log(prop_runs_hira),
    math.log(prop_runs_kata),
]
weights_b = [
 1.253433 ,
-0.14630389,
 0.00329586,
-2.4908898 ,
-5.5842404 ,
-0.14600338,
 1.5507061 ,
 0.13142511,
-0.10953176,
 1.4638389
]

nothayashi_a = weights_a[-1] + sum(properties_a[i]*weights_a[i] for i in range(len(properties_a)))
nothayashi_a = (1-nothayashi_a)*50+50
nothayashi_b = weights_b[-1] + sum(properties_b[i]*weights_b[i] for i in range(len(properties_b)))
nothayashi_b = (1-nothayashi_b)*50+50
}}}

where "counts" stores the number of times a writing system occurs, and "runs" stores the number of runs there are of that writing system. The weights were derived from multiple regression with keras.

Click on Old Stats if you want to see the old stats, like the Core 6k or Hayashi stats.

All stats work on deduplicated copies of the script.

If you want to add a script, post it to the Requests page.

See also Changes.

You can get the new analysis tools here. I hope you know how to use rust!

Higher is easier: metric a/b/c/d

Lower is easier: everything else

The "freqlistX% Target" metrics are an estimate of lexical complexity. High measurements mean that the script uses uncommon words more frequently, or common words less frequently. Commonness is based on every long-enough script combined, not on general purpose frequency lists or the frequency list of the single script in question. However, the most common uncovered 20 words in the script are ignored, because they're probably names or setting jargon, or even parsing errors. This entire process ignores grammatical words, proper nouns, and numbers.

The "metric a/b/c/d" lines are derived from linear regression targeting the "freqlist 92.5% Target" metric. An exact description of the processing for these metrics is here. The math is reverse polish notation.

The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It assumes a reading speed of 475 characters per minute, in general. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. It is completely useless for VNs with nontrivial amounts of gameplay, or where rereading is expected, or where you're expected to miss a lot of content, or where you're only meant to read one or two out of several routes. Example of calibrating with only character count as a source variable: https://i.imgur.com/tqTGVlB.png

To be replaced: this interactive graph.

script name kanji (unique) kanji (2+) chars lexemes sentences lines chars /line chars /sentence hours estimate sjis bytes freqlist 90% Target freqlist 92.5% Target freqlist 95% Target metric a metric b metric c metric d
aete mushisuru19871723487284285571419163516613.8611.4917.7511867883774.675249.057669.9282.4880.8381.1182.30
amakoi20281752780069442826546862802827.8313.9627.6118637872610.243623.405478.9191.1692.2791.0589.73
ao no kanata21291846873044505670569684255420.5215.1531.4620391823266.834551.236764.8281.1580.4080.8580.79
astelight shuushuubako2982259548555929334014344953550.9233.5518.65106219311822.5514968.3320006.8547.6365.9062.8458.27
axanael18611585378897208590430903145712.048.6612.8610186204473.036185.948852.1877.3774.8974.5976.23
biman1175013941772199820112451763023.2314.056.274359514260.905683.878101.8082.3482.0282.4582.25
buraban18001570743503437600595113921318.9612.3827.1018436521935.972684.834162.7085.1485.3385.8786.25
chronobox19851737490390275580411992234121.9511.6017.5412151324078.965481.368027.4082.7682.9283.2983.25
chronobox trials126591462045351035448310220.0011.142.241538513214.804330.186543.5883.2084.3684.4084.74
clacra22151954798979448038580064078519.5913.4828.5119666233943.995445.397776.4583.0982.3682.9683.07
cloverpoint22581995826177474200606324070520.3013.4729.6820001714705.866448.759354.5082.2481.6082.0981.81
daitoshokan231220551062593627059764696578116.1513.8139.4925173833876.125338.457770.4680.4179.4979.4879.83
daitoshokan fandisk20351760458971267957342612826816.2413.3116.9610909693826.305230.747475.6581.3680.5280.7481.00
dies irae279025511614080951741898855469529.5117.6959.8936239496527.178713.6011887.6976.0375.7875.6175.52
dracuriot221819441154120663550843844985623.1513.5440.9527881153082.674276.206400.3282.9782.6582.7881.96
eustia24542210946912565396691466121415.4713.6534.9222338294351.626186.418976.1283.3082.2482.9783.32
fate stay night255623201598035958825930646764323.6217.0659.1236706844877.726484.589027.6376.0076.6877.2976.63
flowers119791690313427191620183341250525.0616.9911.827156964197.775878.248919.5575.6274.9974.6774.98
flowers220321731255414155134146461030024.8017.349.665770125762.858023.7611401.6770.1970.6069.9870.18
flowers320841808279235172879160341102025.3417.3010.596289365631.207768.6510836.8769.8570.3969.9270.11
flyable heart18491626786204460113564464291918.3213.8128.5818567342106.532934.414518.7587.5287.6787.6087.75
fortissimoexs230621071229133719469688274271728.7717.4345.4728981103990.755352.417473.8978.7379.3879.0377.15
fortunearterial21861942852111505495663556255213.6212.7931.5520207233594.684918.947294.4583.3082.7883.0183.87
fureraba20831853972057557185656684904119.8214.6334.7923265593279.634638.947076.2080.8080.2080.7080.44
futsuu no fantasy20181777719328422455488513696719.4614.6726.2816858923588.674914.037082.6784.4183.9684.4584.13
gensou no idea24812225809804476863488093170725.5416.2729.6918608705529.107439.7210088.8578.6378.2377.7677.86
grisaia261123641616264967480958665897627.4116.5858.7537229254443.946246.219307.3178.9779.2779.6978.92
hanachirasu21491742139219880417848584023.8417.665.503131749058.9011780.3516101.9760.1659.4856.7657.65
hanahira94765446525253634264348713.3410.771.611188342857.603937.606067.4084.4886.5283.9383.87
harumade kururu19081659561302329066419782417023.2213.2420.0413319742799.833958.996162.0586.8287.2186.6586.93
hatsukoi yohou18341586596846352632477302887620.6712.4621.9614628362200.273082.534713.6085.3785.2685.3285.63
hatsuyuki sakura19801705535514314103470913489015.3511.2919.1713215073958.885473.788251.6285.2786.2886.0687.52
henkoi18971602529937296027469442150624.6411.1918.4213416392985.294302.736377.1778.5176.8977.5077.06
hoshimemo20801864893158538675608115303716.8414.6432.9219679044196.605635.328078.2582.4381.4981.4282.49
iinchou shounin20511789575115330257571373161318.199.9720.4514520243199.604475.976707.1782.9682.1682.5783.38
imakoi14461157143689810999229582624.6615.525.103356233009.203901.805475.3778.0278.3878.9378.58
inganock20651816384975229312321031629523.6311.6014.138829855273.007044.019899.5076.0372.6072.0574.26
itsusora24652182583122356470359482909220.0415.8621.7813298204974.406841.889834.7580.7079.4980.3880.57
jingai makyou24952207752909450310528653059524.6113.8627.9317425865294.967068.579943.4081.4279.7180.5381.48
kagerou29382598792047489011265501990639.7929.7930.6717614948426.9011310.2615944.2165.8862.7466.2963.38
kajiri 1827982488846474512648455152706331.2818.2932.3518995407673.5810054.9013970.3066.5065.6567.0067.06
kajiri akebono286125651027163624653533023169432.4119.0039.3722930977411.949880.7313790.7366.4465.4466.7266.65
kamikaze explorer224419811066809604325764464410324.1913.7237.8025718623510.224821.477104.6480.1879.4080.3879.76
kamimaho21591945870689524213524714281320.3416.5332.8520146483422.404648.416708.7280.5378.8479.1279.61
kanojo no seiiki129410561588599200911349797019.9313.925.713810722392.233243.934745.2786.9786.9486.4486.78
katahane18651659569480332630400622810320.2614.1920.0913852553440.084887.077330.2680.6280.6080.6079.68
kaziklu2068172620972512277110189606134.6020.337.664628136177.008206.8811068.1775.9177.3577.7077.04
kikaijikake no eve256623611531763898559857374352535.1917.6856.4935412206339.688320.2511444.9167.2269.8470.4669.19
kimikoe22221981722740420545570124342716.6412.5526.3917390344131.445669.688411.5584.2583.7583.8584.12
kirakira228119861064565631370505113458630.7820.9838.9223805683663.045063.247536.6180.8380.9981.2679.59
koichoco19911760756457434318569213907119.3613.1927.3118555704004.705567.278166.7182.2081.7682.2981.64
leyline115961323324310194743232001745218.5813.8711.937783332083.732816.154084.0486.8387.6287.3787.05
leyline217481473421338252367272512072720.3315.3415.449961912363.623276.504715.8986.1685.7985.6084.95
leyline316611441376493224473254971835820.5114.6613.838936362616.583454.975012.7786.0985.8985.8185.12
magical charming21181803645324365851553853651617.6711.5422.9215898463076.844501.366923.7484.2984.6784.6185.40
majokoi19701709547341320953459953506015.6111.8419.6813477203043.704387.836548.2787.3589.2088.6689.51
mamiyakun-chi19451723945532538033626983808224.8314.8234.2422311602953.463886.525594.0384.0983.3683.9683.43
monobeno24212186201186811123441723909023622.3011.5572.0248879514894.336677.169740.1087.0789.2688.8489.46
muramasa307027931189809734933893557813515.2313.2446.8227905599833.4912580.7817094.9564.3563.1359.2361.61
nanarin18511589447450249239425332628217.0210.2215.8311224902916.194005.635825.7184.2086.6587.2387.86
nanatsuiro15431312453855269699360282694716.8412.5116.5010955901715.742385.163644.9987.9988.7788.6488.99
natsukumo yururu20041768750409442961534493137623.9213.9326.7817662983131.584401.966645.5685.6485.5585.0985.42
nine kokoiro153612361425158219812729903515.7711.155.183555203443.964611.486541.8081.8581.1281.9482.92
noratoto20501783651917367290577814037216.1511.1722.7416112643688.685132.897918.8585.2385.6084.0584.52
nursery rhyme20461779655804377828414313142320.8715.7223.5015292453184.564458.736532.3683.1482.8282.8882.34
oniikiss19511681627490356693507622917021.5112.2622.3415494712526.203511.095133.9890.5692.4690.9589.74
oniikiss fd14491176245920138855194711420617.3112.488.565975642374.133258.864802.3289.0891.2087.8486.94
oretsuba277024821596292911520897105252230.3917.5856.5936166586943.489352.9513162.6676.9778.2878.7577.33
oretsuba afterstory21311827412904232540261221605425.7215.5814.569557725372.257310.5810417.1280.1479.9880.1778.79
oretsuba prelude2171179826992415089015150867131.1317.539.416119158083.9510729.7414619.7267.8269.8971.4370.02
ouka sabaki21451914674913411106540083187321.1812.4225.4316803173606.505181.507849.5076.0878.6479.3480.26
parfait21131834567028327105489723309117.1411.4920.5214029323982.455486.988108.4082.9183.1783.9984.11
prawfclwyd20181766474599271160349082439619.4513.5217.1711718154112.705710.218452.8985.5985.8786.5084.88
primary by skyfish20241778831422474158677373549723.4212.0529.2420764792977.734221.526725.2081.4480.6681.3481.62
princessfrontier23422096789097453081613974685516.8412.7227.9918875345257.597384.7810864.2782.2181.0281.6181.58
rabuobu21691904625204357904533983300818.9411.5722.1015039865157.837143.3810470.7582.6681.3881.5082.71
rewrite+2646240915759549306671149399813316.0613.6158.1437081676692.848758.1012088.2776.9875.1975.0076.20
rinshin22101950715377415286459362707426.4215.4825.8816791605301.707280.0110192.3580.9980.4480.9479.87
satsukoi18821587285162169911240642237212.7511.7710.527003043582.754947.587063.6285.1684.0584.3585.42
senmomo25132235806430492352539784758916.9514.8831.4518942625555.977714.7111041.2466.7865.8364.9665.85
senrenbanka222219181068052619622792775377719.8613.3638.3925777292605.113671.965604.4586.4486.5286.3286.11
sensinkan bansenzin26442376856646516408426932580133.2019.9632.4519056065452.837328.0210434.7576.5475.0774.6373.84
sensinkan hatimyouzin285825441152108696234568473412133.7720.1443.9125498816582.408786.7411906.9275.4874.2173.5272.79
sharnoth fvr21241877460329265506348611888724.3712.6616.4410498545277.796955.849930.9977.7975.0876.2077.76
shin koihime eiyuutan 118571567392490227928287391455026.9813.5514.509487192909.494008.645981.6887.3888.6788.6988.02
shin koihime eiyuutan 218971659444312264335377571894623.4511.6816.4711138052887.674128.796436.0284.6486.9687.4887.70
shin koihime eiyuutan 319211669423461246360322961892322.3812.9515.5510394393271.654605.406788.4585.5986.6387.1987.33
shin koihime eiyuutan plus13661062104297596987885454422.9513.063.752568893086.054245.836565.5589.2890.9490.1689.89
shirokuma243221271010345559611703744648421.7413.9434.6124095926018.568054.1511507.6378.8378.3878.8278.10
shugaten17631521376878215826293122454315.3612.7713.168985954032.465755.268319.2480.3479.5679.2179.93
silverio vendetta27582486863983510541397982411435.8321.4733.0118988888915.4711116.6014519.3766.0068.7566.3265.19
simulacre17711515285163178791192631317021.6514.7510.826621122600.333563.065332.2582.5081.0882.3683.18
snowwhite154612401760571070428085568130.9921.706.493943062482.203471.805195.2085.0485.5185.7383.97
soramitsu21251925902605519719576423959322.8015.3232.4921476123477.894745.206785.3785.5785.1385.3984.66
sourire18941637618316363343449002862921.6013.5922.5014897962338.363207.454799.1787.1487.1787.6087.63
subahibi22381996883648523303745274750818.6011.6432.1721579073912.495536.028182.8282.2781.4181.5082.83
sukinara206918351238443685809851955630522.0013.9242.1029303183228.644474.426723.6286.4687.0185.8385.17
summer pockets21151848686283407996639375762511.9110.6424.5017115113754.205511.918257.2087.6588.8987.9789.68
tarareba17971553462740263306327982098422.0513.9416.4310980042701.673666.955445.5583.4983.2783.6183.09
trinoline19541692495438287809343752652218.6814.3118.1411955632642.963609.715361.4585.2184.5784.9184.94
tsujidou-san no jun'ai road2269201911597246560091024037859814.7611.1840.4927830145193.597142.6210308.7678.6175.6776.2577.90
tsujidou-san no virgin road20641802649154369377546904285815.1511.7222.7015531244985.606880.9310150.3078.4376.0076.6478.00
tsuriotsu239021021053271637552609463044434.6017.1938.6723889223250.974594.487043.2581.7881.3681.4081.33
tsuushinbo18661617612627344763441562781122.0313.6621.7014531842516.613367.625022.1889.6890.9989.8789.16
twinklecrusaders2586231315049258561481168447720519.4912.7152.7536005795358.977354.7310578.4277.9776.2077.1177.50
tyrhhia26042206295145179000183141177325.0715.7111.3666110310734.7513882.7518986.5063.8562.5961.5762.62
white_album18311481425614251896318412614616.2813.3115.5910086142603.593770.215720.6583.6282.9983.4984.71
yoakena21341902802113467812600235905113.5813.3129.2519453233488.034780.687093.7083.3882.2183.1583.60

Stats (last edited 2020-08-22 13:05:50 by weh)