Differences between revisions 61 and 63 (spanning 2 versions)
Revision 61 as of 2018-07-19 12:37:51
Size: 21697
Editor: weh
Comment:
Revision 63 as of 2018-09-18 09:37:42
Size: 269
Editor: KimberHeim
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
I just rewrote the stats tools. These are the stats output by the new tools. They differ slightly from the old stats because the rewrite deals with a few edge cases differently. The differences are within a margin of error, or when the difference is big, the old stats tools are probably doing something wrong.

If you got linked here for a statistic that isn't here ('''like the Core 6k stats'''), look at the [[Old Stats]] page instead.

For now, see the [[Old Stats]] page for more details.

If you want to add a script, post it to the [[Requests]] page.

See also [[Changes]].

You can get the new analysis tools [[https://mega.nz/#!wQ8TDZpK!SeWOQ9_G_vl74GzuNTEhojkHcjVMXbrfTvFuACwgFd4|here]] (you need [[https://mega.nz/#!RNcDHJzJ!ibbtJGteZpqdTA5QIZt88TnyirOB0Mkl4uktM4hKcsY|this]] too). They're easier to use than the previous ones, but they require python 3.6 or newer, and if you're not on Windows, you need to patch and recompile mecab yourself to fix a bug (instructions included) (you CANNOT use mecab as compiled by your distribution's maintainer).

Higher is easier: Hayashi; custom metric

Lower is easier: kanji (unique); kanji(2+); chars/line; chars/sentence; freqlistX% Target

The "Hayashi" metric are an estimate of structural complexity. The Hayashi metric is inherently flawed and should only be used as a general guideline.

The "custom metric" is like "Hayashi", and uses similar data, but it's designed to correlate well with "freqlist92.5% target". This is another estimate of structural complexity, but because it estimates the "freqlist92.5% target" metric, it's arbitrary.

The "freqlistX% Target" metrics are an estimate of lexical complexity. High measurements mean that the script uses uncommon words more frequently, or common words less frequently. Commonness is based on every long-enough script combined, not on general purpose frequency lists or the frequency list of the single script in question. However, the most common uncovered 20 words in the script are ignored, because they're probably names or setting jargon, or even parsing errors.

'''The freqlistX% Target metrics changed recently'''. Read the above paragraph if you're confused about the new numbers being lower.

The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It doesn't take any real complexity differences into account and it's '''based on VNDB's inaccurate length categories''', take it with a '''huge grain of salt'''; also, '''it assumes a ~475 characters/minute reading speed''', not like 300 or 200. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. Example of calibrating with only character count as a source variable: https://i.imgur.com/tqTGVlB.png

In particular, the hours estimate should be taken as '''complete guesswork''' for any game that has extended interactions outside of ADV or NVL sequences, like minigames or general gameplay, and it's also not going to take into account any differences in structure or readability caused by complex grammar or rare words.

You can compare the Hayashi, custom metric a, custom metric b, and freqlist 92.5% target stats with [[http://wareya.moe/extra/statsgraph.html|this interactive graph]].

{{{#!nutable
script name; kanji\n(unique); kanji\n(2+); lines; sentences; chars\n/line; chars\n/sentence; characters; lexemes; sjis bytes; sjis (dedup); hours estimate; Hayashi; custom\nmetric a; custom\nmetric b; freqlist\n90% Target; freqlist\n92.5% Target; freqlist\n95% Target
aete mushisuru; 1987; 1723; 36629; 41691; 13.83; 11.68; 506616; 285261; 1287119; 1238044; 17.74; 80.76; 80.68; 80.60; 3965.45; 5469.01; 8065.10
amakoi; 2028; 1752; 28355; 54610; 27.53; 14.01; 780536; 442818; 1903429; 1889972; 27.61; 84.90; 89.19; 90.86; 2628.32; 3671.31; 5549.50
ao no kanata; 2129; 1846; 44234; 57107; 20.20; 15.24; 893350; 504764; 2125556; 2065379; 31.46; 79.14; 80.75; 79.60; 3325.75; 4592.20; 6721.65
astelight shuushuubako; 2982; 2595; 9461; 14515; 51.53; 33.45; 487535; 291731; 1166666; 1157863; 18.65; 62.44; 49.77; 65.19; 11819.42; 15079.26; 20053.07
axanael; 1861; 1585; 34375; 42538; 12.17; 9.18; 418504; 207002; 1139513; 1053681; 12.86; 81.09; 75.85; 76.06; 4758.78; 6574.29; 9418.04
biman1; 1750; 1394; 7641; 12526; 23.79; 14.05; 181779; 98089; 448539; 439945; 6.27; 78.72; 80.98; 81.09; 4370.57; 5819.83; 8296.35
buraban; 1800; 1570; 39133; 59513; 19.53; 12.42; 764174; 437576; 1940165; 1871589; 27.10; 78.45; 85.79; 84.96; 1952.53; 2736.14; 4164.42
chronobox trials; 1265; 914; 3160; 5460; 19.99; 11.29; 63177; 35006; 160474; 157777; 2.24; 81.82; 83.68; 83.61; 3334.27; 4486.58; 6841.90
chronobox; 1985; 1737; 23036; 41201; 21.60; 11.78; 497566; 274526; 1261732; 1236591; 17.54; 79.04; 83.13; 82.44; 4213.10; 5719.08; 8270.50
clacra; 2215; 1954; 41776; 59682; 19.64; 13.31; 820658; 447978; 2038082; 1975933; 28.51; 77.45; 82.44; 81.55; 3993.97; 5447.43; 7726.13
cloverpoint; 2258; 1995; 42677; 60322; 20.19; 13.68; 861662; 472360; 2146495; 2073383; 29.68; 78.74; 81.78; 80.96; 4813.62; 6488.23; 9531.30
daitoshokan fandisk; 2035; 1760; 28827; 34367; 16.22; 13.33; 467657; 267247; 1134885; 1113236; 16.96; 77.88; 80.71; 80.06; 4012.09; 5405.49; 7820.52
daitoshokan; 2312; 2055; 68258; 76633; 16.00; 13.86; 1092295; 625870; 2647706; 2562769; 39.49; 77.45; 79.77; 79.09; 4016.23; 5440.80; 7885.48
dies irae; 2790; 2554; 58314; 88559; 28.76; 18.16; 1677110; 952246; 4005512; 3830009; 60.02; 69.97; 75.71; 75.75; 6495.28; 8516.09; 11656.85
dracuriot; 2218; 1944; 51751; 84258; 23.36; 13.65; 1208987; 660083; 2956248; 2832280; 40.95; 80.31; 82.47; 82.53; 3144.45; 4318.75; 6415.11
eustia; 2454; 2210; 64697; 69324; 15.16; 13.65; 980871; 564560; 2397710; 2292286; 34.92; 78.84; 82.34; 81.84; 4400.90; 6176.01; 9044.77
fate stay night; 2556; 2320; 75159; 90847; 23.04; 17.88; 1731549; 965201; 4260695; 3870323; 59.09; 71.48; 77.01; 75.97; 4920.83; 6503.67; 9002.08
flowers1+2+3; 2412; 2178; 35460; 49370; 24.17; 17.34; 856990; 519241; 1979933; 1949229; 32.04; 72.20; 72.44; 71.96; 5822.40; 8157.88; 11619.69
flowers1; 1979; 1690; 13289; 18873; 23.85; 16.78; 316955; 191587; 737313; 726823; 11.81; 73.94; 75.86; 75.18; 4507.23; 6309.56; 9464.01
flowers2; 2032; 1731; 10695; 14634; 24.14; 17.65; 258169; 155373; 595039; 587710; 9.67; 70.74; 70.33; 70.05; 6296.80; 8673.89; 12538.49
flowers3; 2084; 1808; 11476; 16109; 24.56; 17.52; 281866; 172781; 647581; 639731; 10.59; 71.72; 70.49; 69.81; 6104.87; 8332.56; 11605.18
flyable heart; 1849; 1626; 44569; 56254; 18.36; 13.93; 818168; 458851; 1963723; 1872189; 28.58; 83.65; 86.95; 86.78; 2158.82; 2994.74; 4589.60
fortissimoexs; 2306; 2107; 45040; 66427; 27.76; 18.61; 1250088; 719523; 3151153; 3045669; 45.47; 71.79; 79.19; 79.04; 4012.49; 5389.27; 7443.32
fortunearterial; 2186; 1942; 65296; 66515; 13.52; 12.80; 882508; 503887; 2153109; 2036302; 31.55; 80.40; 82.99; 82.45; 3710.98; 5063.23; 7419.14
fureraba; 2083; 1853; 50051; 66377; 20.05; 14.57; 1003649; 556765; 2425789; 2352972; 34.79; 80.29; 80.22; 79.51; 3330.05; 4687.92; 7030.06
futsuu no fantasy; 2018; 1777; 39163; 48822; 19.05; 14.74; 745922; 422486; 1778854; 1719851; 26.29; 78.63; 83.66; 83.46; 3685.12; 4967.25; 6996.77
gensou no idea; 2481; 2225; 32461; 47681; 25.32; 17.16; 821785; 475016; 1958269; 1929489; 29.69; 78.89; 78.20; 78.10; 5636.40; 7491.10; 10116.40
grisaia; 2611; 2364; 62748; 96326; 27.18; 16.69; 1705580; 967235; 3971468; 3767371; 58.75; 77.79; 79.18; 78.81; 4551.50; 6364.96; 9473.62
hanachirasu; 2149; 1742; 5877; 7823; 23.91; 17.90; 140515; 87663; 349599; 345074; 5.50; 72.57; 60.20; 60.63; 9153.65; 11901.15; 16288.70
hanahira; 947; 654; 3571; 4263; 13.40; 10.88; 47866; 25278; 124311; 120902; 1.61; 87.59; 83.71; 87.23; 3037.82; 4056.89; 6249.55
harumade kururu; 1908; 1658; 39430; 47498; 14.64; 11.73; 577162; 328041; 1388399; 1348107; 19.97; 85.98; 85.74; 86.34; 2896.68; 4061.82; 6224.40
hatsukoi yohou; 1834; 1586; 30370; 48340; 20.26; 12.39; 615425; 351700; 1523937; 1483369; 21.96; 81.41; 84.56; 84.85; 2292.98; 3225.53; 4822.00
hatsuyuki sakura; 1980; 1705; 35304; 47188; 15.71; 11.32; 554715; 314108; 1411404; 1307815; 19.17; 82.56; 85.23; 85.16; 4109.77; 5673.30; 8378.67
henkoi; 1897; 1602; 21719; 48348; 25.13; 11.00; 545804; 294522; 1373860; 1361135; 18.42; 80.41; 78.54; 78.33; 3143.69; 4548.43; 6587.27
hoshimemo; 2080; 1864; 54205; 60836; 16.99; 14.68; 921017; 537002; 2073147; 1997427; 32.91; 82.82; 81.53; 81.09; 4296.95; 5739.74; 8141.13
iinchou shounin; 2051; 1789; 32743; 57165; 18.25; 10.10; 597436; 329258; 1508808; 1481290; 20.45; 81.00; 81.80; 82.34; 3299.92; 4539.42; 6796.08
imakoi; 1446; 1157; 5991; 9542; 24.60; 15.16; 147388; 81016; 342955; 341436; 5.10; 82.87; 78.56; 78.39; 3014.96; 3951.12; 5467.40
inganock; 2065; 1816; 17648; 32300; 23.39; 11.92; 412809; 228753; 968180; 896988; 14.13; 76.22; 73.45; 71.75; 5817.45; 7753.40; 10512.90
itsusora; 2465; 2182; 30247; 36196; 19.68; 16.10; 595181; 355594; 1433403; 1386755; 21.77; 82.58; 81.77; 79.75; 5079.18; 6917.42; 9812.31
jikaijikake no eve; 2566; 2361; 44740; 85707; 35.13; 17.96; 1571801; 896917; 3644082; 3582523; 56.50; 72.62; 69.76; 68.51; 6398.85; 8387.85; 11338.65
jingai makyou; 2495; 2208; 35361; 53182; 23.75; 13.92; 839691; 451756; 2055351; 1804776; 28.07; 74.33; 82.12; 80.54; 5363.05; 7204.80; 10039.25
kagerou; 2938; 2598; 21148; 27024; 37.73; 29.67; 797910; 488504; 1912123; 1897640; 30.67; 71.14; 64.00; 65.20; 8744.91; 11637.32; 16069.17
kajiri akebono; 2861; 2565; 32668; 52551; 32.12; 19.43; 1049349; 624008; 2515798; 2457232; 39.36; 80.75; 66.47; 64.64; 7461.88; 9795.79; 13333.38
kamikaze explorer; 2244; 1981; 45828; 76382; 23.82; 13.93; 1091420; 604293; 2668876; 2617771; 37.80; 77.41; 80.76; 78.47; 3594.97; 4877.01; 7217.38
kamimaho; 2159; 1945; 44145; 51492; 20.02; 16.94; 883782; 523540; 2152608; 2117316; 32.85; 78.50; 80.14; 79.25; 3560.80; 4779.86; 6901.15
kanojo no seiiki; 1294; 1056; 8188; 11395; 19.80; 13.92; 162124; 92009; 394844; 388839; 5.71; 83.47; 85.68; 86.16; 2401.80; 3276.30; 4745.88
katahane; 1865; 1659; 46768; 40574; 13.15; 14.30; 614909; 330445; 1481610; 1425979; 20.09; 82.46; 80.81; 81.10; 3563.09; 5073.10; 7591.65
kaziklu; 2068; 1726; 6099; 10068; 34.54; 20.67; 210682; 122656; 484567; 482447; 7.66; 67.93; 75.92; 76.91; 6100.35; 8174.90; 10894.10
kimikoe; 2222; 1981; 44891; 56879; 16.57; 12.70; 743935; 418580; 1819039; 1772716; 26.39; 81.05; 83.29; 83.41; 4204.69; 5801.23; 8398.00
kirakira; 2281; 1986; 35716; 50270; 30.25; 21.12; 1080238; 630810; 2557768; 2519197; 38.90; 74.75; 79.53; 80.45; 3786.04; 5191.65; 7707.99
koichoco; 1991; 1760; 41241; 56740; 18.93; 13.32; 780580; 434221; 1979633; 1881859; 27.31; 76.64; 82.10; 81.18; 4197.30; 5617.89; 8155.61
leyline1+2+3; 2019; 1795; 57821; 76028; 19.90; 14.70; 1150758; 667259; 2777676; 2694759; 41.09; 83.67; 85.31; 85.76; 2568.25; 3515.40; 5142.10
leyline1; 1596; 1323; 17968; 23564; 18.62; 13.73; 334620; 194618; 813931; 791074; 11.93; 86.85; 85.59; 86.12; 2234.13; 3014.79; 4420.00
leyline2; 1748; 1473; 21063; 27396; 20.49; 15.33; 431582; 251488; 1036671; 1009047; 15.44; 83.47; 84.77; 85.21; 2535.70; 3499.66; 5089.52
leyline3; 1661; 1441; 18790; 25796; 20.43; 14.60; 383865; 223425; 926788; 909650; 13.83; 82.01; 85.12; 85.49; 2784.50; 3679.69; 5383.30
magical charming; 2118; 1803; 37239; 55448; 17.75; 11.63; 661122; 365137; 1649810; 1611665; 22.92; 80.49; 83.72; 83.55; 3134.04; 4561.63; 6977.16
majokoi; 1970; 1709; 37288; 46138; 15.83; 11.85; 590196; 320054; 1490266; 1349107; 19.68; 84.50; 87.74; 87.89; 3099.37; 4462.50; 6560.90
mamiyakun-chi; 1945; 1723; 39099; 62619; 24.29; 14.86; 949907; 537997; 2293535; 2266268; 34.24; 77.16; 84.20; 82.84; 2946.68; 3915.98; 5609.65
monobeno; 2421; 2186; 96984; 154996; 21.83; 13.29; 2117635; 1112093; 5182146; 4968589; 72.02; 82.71; 89.16; 87.96; 4969.21; 6938.51; 9753.02
muramasa; 3070; 2793; 80564; 87653; 15.30; 13.75; 1232446; 733011; 3176908; 3019944; 46.79; 75.48; 62.33; 63.03; 9858.00; 12594.03; 17168.48
nanarin; 1851; 1589; 39789; 42928; 17.83; 10.27; 709247; 248506; 1830351; 1120735; 15.83; 79.26; 87.12; 86.23; 3029.97; 4131.86; 6081.50
nanatsuiro; 1543; 1312; 26930; 36064; 17.12; 12.61; 460913; 269083; 1122537; 1122517; 16.50; 83.64; 87.78; 88.03; 1868.07; 2534.14; 3893.45
natsukumo yururu; 2004; 1766; 51421; 60068; 15.03; 12.41; 772622; 440932; 1844431; 1780832; 26.64; 84.90; 84.37; 84.69; 3154.27; 4387.54; 6629.49
nine kokoiro; 1536; 1236; 8802; 12706; 16.55; 11.26; 145707; 82176; 369833; 358303; 5.18; 75.61; 81.19; 80.18; 3596.20; 4818.64; 6780.62
noratoto; 2050; 1783; 41303; 58114; 16.35; 11.27; 675396; 365327; 1692782; 1636726; 22.74; 84.67; 83.00; 85.56; 3672.93; 5182.29; 7838.15
nursery rhyme; 2046; 1779; 32500; 41516; 20.63; 15.78; 670321; 374822; 1616247; 1577109; 23.50; 81.65; 82.42; 82.14; 3339.56; 4614.22; 6736.79
oniikiss fd; 1449; 1176; 22708; 19526; 17.09; 12.53; 388161; 138850; 971198; 597288; 8.56; 84.41; 85.96; 89.85; 2397.74; 3348.44; 4814.41
oniikiss; 1951; 1681; 41966; 50792; 20.69; 12.36; 868147; 356678; 2214340; 1564783; 22.34; 81.36; 89.20; 91.83; 2584.69; 3566.59; 5124.78
oretsuba afterstory; 2131; 1827; 16417; 26109; 25.53; 15.72; 419120; 231391; 995689; 979710; 14.56; 81.45; 80.56; 80.54; 5519.00; 7516.80; 10880.67
oretsuba prelude; 2171; 1798; 8816; 15168; 31.09; 17.69; 274070; 150433; 634811; 625030; 9.41; 79.57; 72.34; 71.04; 8448.00; 11193.33; 15278.85
oretsuba; 2770; 2482; 56675; 89741; 30.23; 17.71; 1713369; 908305; 3978483; 3692838; 56.59; 80.60; 78.29; 78.38; 7111.22; 9544.05; 13414.11
ouka sabaki; 2145; 1914; 33862; 54858; 21.10; 12.31; 714638; 411104; 1801613; 1711326; 25.43; 87.26; 77.09; 75.66; 3745.00; 5270.84; 8086.93
parfait; 2113; 1834; 37003; 49015; 18.64; 11.60; 689863; 327039; 1730006; 1396010; 20.52; 73.68; 83.96; 82.56; 4173.50; 5676.54; 8223.50
prawfclwyd; 2018; 1766; 25602; 34977; 18.99; 13.57; 486264; 270053; 1217811; 1187626; 17.17; 74.35; 85.85; 85.44; 4275.90; 6020.20; 8778.46
princessfrontier; 2342; 2096; 48063; 61194; 16.86; 12.89; 810467; 449604; 1965704; 1927480; 27.99; 81.85; 81.21; 81.25; 5432.55; 7585.20; 10978.95
rabuobu; 2169; 1904; 34143; 53700; 19.47; 11.64; 664852; 356575; 1613985; 1530452; 22.10; 83.09; 80.85; 81.13; 5260.04; 7216.78; 10380.12
rewrite+; 2646; 2409; 97740; 116315; 16.49; 13.55; 1611349; 930361; 3861665; 3742400; 58.14; 78.10; 75.12; 74.59; 6775.81; 8829.12; 12063.07
rinshin; 2210; 1949; 28964; 46057; 26.02; 15.53; 753720; 414396; 1787780; 1707720; 25.88; 78.39; 80.73; 79.80; 5390.50; 7245.50; 10257.60
sansha mendan; 2042; 1841; 34816; 64406; 34.77; 18.37; 1210691; 621255; 2817128; 2785920; 41.26; 77.20; 72.07; 69.79; 4747.20; 6072.47; 8409.32
satsukoi; 1882; 1587; 23111; 23947; 12.80; 11.93; 295846; 169260; 743615; 710642; 10.52; 80.51; 83.70; 83.90; 3735.96; 5117.48; 7460.78
sengoku koihime x; 2915; 2667; 122581; 199749; 22.78; 13.60; 2792693; 1633397; 6883907; 6729611; 102.29; 84.48; 81.74; 81.26; 5145.21; 7220.25; 10842.54
senmomo; 2513; 2235; 48841; 54049; 16.87; 14.91; 824140; 491207; 1981794; 1946095; 31.45; 75.08; 68.15; 66.62; 5853.10; 7803.60; 10810.08
senrenbanka; 2222; 1918; 54585; 79446; 20.03; 13.42; 1093530; 617721; 2672904; 2618031; 38.39; 81.96; 85.54; 85.88; 2641.44; 3733.70; 5644.43
senshinkan bansenjin; 2644; 2376; 26142; 42276; 33.07; 20.27; 864568; 516024; 1994101; 1977766; 32.45; 76.73; 74.46; 75.33; 5577.21; 7377.67; 10448.60
senshinkan hachimyoujin; 2858; 2544; 34771; 56287; 33.51; 20.49; 1165087; 696088; 2740617; 2711958; 43.93; 78.27; 72.96; 74.40; 6537.13; 8617.47; 11727.45
sharnoth fvr; 2124; 1877; 20847; 35054; 24.15; 13.12; 503476; 265581; 1173739; 1066449; 16.44; 73.29; 77.03; 73.93; 5574.34; 7434.48; 10619.35
shin koihime eiyuutan 1; 1857; 1567; 14762; 28742; 26.90; 13.60; 397083; 227951; 968808; 962883; 14.50; 85.26; 86.60; 87.13; 2961.88; 4085.35; 6017.37
shin koihime eiyuutan 2; 1897; 1659; 19520; 37802; 23.20; 11.70; 452822; 264343; 1150691; 1132365; 16.47; 84.86; 85.72; 85.76; 3030.13; 4290.74; 6609.25
shin koihime eiyuutan 3; 1921; 1669; 19418; 32457; 22.21; 12.98; 431246; 246365; 1070164; 1056455; 15.55; 83.91; 86.43; 85.60; 3508.07; 4840.62; 7014.26
shin koihime eiyuutan plus; 1366; 1062; 4608; 7943; 23.20; 13.05; 106899; 59705; 263751; 261187; 3.75; 87.57; 88.23; 89.35; 3192.73; 4339.69; 6714.75
shin koihime musou kakumei 1; 2608; 2363; 76318; 132230; 22.76; 12.74; 1736755; 1002655; 4287602; 4207252; 62.59; 86.00; 85.27; 86.21; 4315.64; 6154.84; 9388.94
shirokuma; 2432; 2127; 48077; 70659; 21.46; 14.01; 1031582; 557907; 2515346; 2452640; 34.61; 80.86; 78.33; 77.98; 6256.96; 8232.90; 11571.90
shugaten; 1763; 1521; 24869; 29261; 15.57; 12.91; 387316; 214006; 965349; 901986; 13.13; 83.74; 79.46; 79.76; 4308.66; 6066.78; 8965.96
silverio vendetta; 2758; 2487; 24342; 39584; 35.67; 21.82; 868301; 510102; 2158325; 2150337; 33.02; 70.10; 65.03; 68.74; 8838.05; 10938.65; 14155.74
simulacre; 1771; 1515; 13577; 19050; 21.27; 15.03; 288819; 178681; 685150; 674597; 10.82; 81.36; 84.19; 82.15; 2756.59; 3766.76; 5629.40
snowwhite; 1546; 1240; 5778; 7959; 30.93; 22.14; 178726; 106545; 417532; 410758; 6.49; 78.65; 83.44; 85.65; 2614.20; 3677.08; 5458.60
soramitsu; 2125; 1925; 46347; 58061; 22.64; 15.36; 1049089; 518230; 2578691; 2185261; 32.49; 79.44; 85.08; 84.67; 3546.10; 4811.00; 6841.93
sourire; 1894; 1637; 30168; 44601; 20.83; 13.77; 628424; 362062; 1555598; 1511058; 22.50; 80.49; 87.63; 86.72; 2399.50; 3296.69; 4930.37
subahibi; 2238; 1996; 58018; 74763; 18.33; 11.77; 1063337; 520905; 2713808; 2237407; 32.17; 78.01; 81.39; 80.93; 3995.53; 5673.56; 8215.06
sukinara; 2069; 1835; 60041; 84942; 20.91; 14.09; 1255586; 682601; 3147409; 3007064; 42.08; 82.34; 85.24; 85.51; 3307.12; 4545.27; 6769.58
summer pockets; 2115; 1849; 62271; 64181; 12.00; 10.68; 747365; 407980; 1918668; 1709050; 24.50; 85.13; 86.13; 88.00; 3911.67; 5587.71; 8333.00
tarareba; 1797; 1553; 20992; 32452; 22.27; 14.25; 467570; 262555; 1119586; 1119535; 16.43; 79.21; 82.62; 82.60; 2744.40; 3778.26; 5521.26
trinoline; 1954; 1692; 27628; 34306; 18.66; 14.67; 515408; 286655; 1259214; 1226295; 18.14; 77.91; 85.36; 84.24; 2695.38; 3704.20; 5489.54
tsujidou-san no jun'ai road; 2269; 2019; 80118; 102793; 14.93; 11.31; 1196359; 651727; 2940726; 2766732; 40.48; 84.30; 76.93; 76.55; 5275.48; 7245.48; 10257.10
tsujidou-san no virgin road; 2064; 1802; 43219; 54886; 15.43; 11.86; 666755; 367278; 1632300; 1545307; 22.70; 83.32; 77.10; 76.34; 5031.55; 6927.87; 10090.91
tsuriotsu; 2390; 2102; 30932; 60869; 34.31; 17.25; 1061406; 636679; 2455467; 2436023; 38.67; 79.87; 80.69; 81.14; 3470.73; 4805.95; 7257.95
tsuushinbo; 1866; 1617; 28505; 43993; 21.66; 13.82; 617432; 343593; 1503324; 1477566; 21.70; 86.13; 88.81; 89.13; 2541.43; 3401.63; 5009.90
twinklecrusaders; 2586; 2313; 77293; 115311; 19.82; 13.10; 1531958; 850300; 3680074; 3678307; 52.76; 80.37; 77.34; 76.03; 5464.50; 7376.84; 10614.06
white_album; 1831; 1481; 29108; 31890; 15.90; 13.32; 462896; 251596; 1123118; 1014554; 15.59; 79.00; 84.06; 82.58; 2773.77; 3954.30; 6073.98
yoakena; 2134; 1902; 57455; 60314; 14.48; 13.37; 831742; 467022; 2074181; 1942943; 29.29; 78.88; 82.24; 81.54; 3533.71; 4849.82; 7160.95
}}}

The Hayashi metric is derived from: chars per sentence; commas per periods*; average consecutive length of each of kanji/hiragana/katakana/other

* sentence endings imply periods

The custom metrics are derived from:

{{{#!python
runlen_han = counts[0]/runs[0]
runlen_hira = counts[1]/runs[1]
runlen_kata = counts[2]/runs[2]

avg_counts = sum(counts[:3])/3
prop_han = counts[0]/avg_counts
prop_hira = counts[1]/avg_counts
prop_kata = counts[2]/avg_counts

avg_runs = sum(runs[:3])/3
prop_runs_han = runs[0]/avg_runs
prop_runs_hira = runs[1]/avg_runs
prop_runs_kata = runs[2]/avg_runs

norm_han = runlen_han *prop_han
norm_hira = runlen_hira*prop_hira
norm_kata = runlen_kata*prop_kata

sentence_han = counts[0]/sentences
sentence_hira = counts[1]/sentences
sentence_kata = counts[2]/sentences

runs_sentence = sum(runs[:3])/sentences
sentencelen = sentencechars/sentences

# ....

properties_a = [
    math.log(prop_han),
    math.log(prop_hira),
    math.log(prop_kata),
    
    math.log(prop_runs_han),
    math.log(prop_runs_hira),
    math.log(prop_runs_kata),
    
    norm_han,
    norm_hira,
    norm_kata,
    
    sentence_han,
    sentence_hira,
    sentence_kata,
    
    1/runs_sentence,
    math.log(sentencelen)
]
weights_a = [
-3.4920757 ,
-0.6549337 ,
-0.17232664,
 1.0730087 ,
-1.1602864 ,
 0.02242127,
 1.764859 ,
-0.10058399,
 0.23199975,
 0.0919582 ,
 0.01803382,
 0.04476589,
-1.3525765 ,
-0.76003593,
 0.20918524
]
properties_b = [
    runlen_han,
    runlen_hira,
    runlen_kata,
    
    math.log(prop_han),
    math.log(prop_hira),
    math.log(prop_kata),
    
    math.log(prop_runs_han),
    math.log(prop_runs_hira),
    math.log(prop_runs_kata),
]
weights_b = [
 1.253433 ,
-0.14630389,
 0.00329586,
-2.4908898 ,
-5.5842404 ,
-0.14600338,
 1.5507061 ,
 0.13142511,
-0.10953176,
 1.4638389
]

nothayashi_a = weights_a[-1] + sum(properties_a[i]*weights_a[i] for i in range(len(properties_a)))
nothayashi_a = (1-nothayashi_a)*50+50
nothayashi_b = weights_b[-1] + sum(properties_b[i]*weights_b[i] for i in range(len(properties_b)))
nothayashi_b = (1-nothayashi_b)*50+50
}}}

where "counts" stores the number of times a writing system occurs, and "runs" stores the number of runs there are of that writing system. The weights were derived from multiple regression with keras.
Vivify Health & Chiropractic<<<BR>>
><<<BR>>
>
2/590 Hay St,<<<BR>>
><<<BR>>
>
Subiaco WA 6008<<<BR>>
><<<BR>>
>
(08) 9381 3150<<<BR>>
><<<BR>>
>
<<<BR>>
><<<BR>>
>
my webpage :: [[https://www.healthdirect.gov.au/chiropractors|www.healthdirect.gov.au]]

Vivify Health & Chiropractic<
><
> 2/590 Hay St,<
><
> Subiaco WA 6008<
><
> (08) 9381 3150<
><
> <
><
> my webpage :: www.healthdirect.gov.au

Stats (last edited 2020-08-22 13:05:50 by weh)