Differences between revisions 49 and 63 (spanning 14 versions)
⇤ ← Revision 49 as of 2018-05-31 01:14:37 →
Size: 15929
Editor: weh
Comment:
← Revision 63 as of 2018-09-18 09:37:42 → ⇥
Size: 269
Editor: KimberHeim
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
I just rewrote the stats tools. These are the stats output by the new tools. They differ slightly from the old stats because the rewrite deals with a few edge cases differently. The differences are within a margin of error, or when the difference is big, the old stats tools are probably doing something wrong.

If you got linked here for a statistic that isn't here ('''like the Core 6k stats'''), look at the [[Old Stats]] page instead.

For now, see the [[Old Stats]] page for more details.

If you want to add a script, post it to the [[Requests]] page.

See also [[Changes]].

You can get the new analysis tools [[https://mega.nz/#!sRllVYJC!2Nswe47RpXzaEka3W3dIHTq6PNsNEqzSC903dllfzgw|here]] (you need [[https://mega.nz/#!RNcDHJzJ!ibbtJGteZpqdTA5QIZt88TnyirOB0Mkl4uktM4hKcsY|this]] too). They're easier to use than the previous ones, but they require python 3.6 or newer, and if you're not on Windows, you need to patch and recompile mecab yourself to fix a bug (instructions included) (you CANNOT use mecab as compiled by your distribution's maintainer).

Higher is easier: Hayashi; custom metric

Lower is easier: kanji (unique); kanji(2+); chars/line; chars/sentence; freqlistX% Target

The "Hayashi" metric are an estimate of structural complexity. The Hayashi metric is inherently flawed and should only be used as a general guideline.

The "custom metric" is like "Hayashi", and uses similar data, but it's designed to correlate well with "freqlist92.5% target". This is another estimate of structural complexity, but because it estimates the "freqlist92.5% target" metric, it's arbitrary.

The "freqlistX% Target" metrics are an estimate of lexical complexity. High measurements mean that the script uses uncommon words more frequently, or common words less frequently. Commonness is based on every long-enough script combined, not on general purpose frequency lists or the frequency list of the single script in question.

The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It doesn't take any real complexity differences into account and it's '''based on VNDB's inaccurate length categories''', take it with a '''huge grain of salt'''; also, '''it assumes a ~475 characters/minute reading speed''', not like 300 or 200. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. Example of calibrating with only character count as a source variable: https://i.imgur.com/tqTGVlB.png

{{{#!nutable
script name; kanji\n(unique); kanji\n(2+); lines; sentences; chars\n/line; chars\n/sentence; characters; lexemes; sjis bytes; sjis (dedup); hours estimate; Hayashi; custom\nmetric; freqlist\n90% Target; freqlist\n92.5% Target; freqlist\n95% Target
aete mushisuru; 1987; 1723; 36629; 41691; 13.83; 11.68; 506616; 285261; 1287119; 1238044; 17.74; 80.76; 74.10; 5549.42; 7917.14; 12072.85
amakoi; 2028; 1752; 28355; 54610; 27.53; 14.01; 780536; 442818; 1903429; 1889972; 27.61; 84.90; 83.14; 3619.23; 5321.96; 8247.40
ao no kanata; 2129; 1846; 44234; 57107; 20.20; 15.24; 893350; 504764; 2125556; 2065379; 31.46; 79.14; 74.59; 4066.00; 5569.97; 8326.00
astelight shuushuubako; 2982; 2595; 9461; 14515; 51.53; 33.45; 487535; 291731; 1166666; 1157863; 18.65; 62.44; 48.15; 13909.70; 17859.47; 23136.10
axanael; 1861; 1585; 34375; 42538; 12.17; 9.18; 418504; 207002; 1139513; 1053681; 12.86; 81.09; 73.51; 6542.51; 8662.42; 12917.40
biman1; 1750; 1394; 7641; 12526; 23.79; 14.05; 181779; 98089; 448539; 439945; 6.27; 78.72; 75.45; 7456.10; 11079.87; 19099.55
chronobox trials; 1265; 914; 3160; 5460; 19.99; 11.29; 63177; 35006; 160474; 157777; 2.24; 81.82; 76.67; 4493.75; 6658.62; 8846.75
chronobox; 1985; 1737; 23036; 41201; 21.60; 11.78; 497566; 274526; 1261732; 1236591; 17.54; 79.04; 74.39; 5687.60; 8152.47; 11899.18
clacra; 2215; 1954; 41776; 59682; 19.64; 13.31; 820658; 447978; 2038082; 1975933; 28.51; 77.45; 74.50; 4423.00; 5962.16; 8680.94
cloverpoint; 2258; 1995; 42677; 60322; 20.19; 13.68; 861662; 472360; 2146495; 2073383; 29.68; 78.74; 73.73; 5899.98; 8351.23; 11982.47
daitoshokan fandisk; 2035; 1760; 28827; 34367; 16.22; 13.33; 467657; 267247; 1134885; 1113236; 16.96; 77.88; 73.88; 5339.80; 7775.75; 12206.00
daitoshokan; 2312; 2055; 68258; 76633; 16.00; 13.86; 1092295; 625870; 2647706; 2562769; 39.49; 77.45; 72.58; 4920.95; 6977.63; 11046.48
dies irae; 2790; 2554; 58314; 88559; 28.76; 18.16; 1677110; 952246; 4005512; 3830009; 60.02; 69.97; 68.66; 7061.05; 9351.44; 13035.50
dracuriot; 2218; 1944; 51751; 84258; 23.36; 13.65; 1208987; 660083; 2956248; 2832280; 40.95; 80.31; 74.84; 4074.94; 5774.46; 8361.76
eustia; 2454; 2210; 64697; 69324; 15.16; 13.65; 980871; 564560; 2397710; 2292286; 34.92; 78.84; 76.83; 6607.98; 9974.70; 14365.97
fate stay night; 2556; 2320; 75159; 90847; 23.04; 17.88; 1731549; 965201; 4260695; 3870323; 59.09; 71.48; 67.03; 6957.77; 8915.45; 13932.17
flowers1+2+3; 2412; 2178; 35460; 49370; 24.17; 17.34; 856990; 519241; 1979933; 1949229; 32.04; 72.20; 66.75; 7311.04; 10230.25; 15179.00
flowers1; 1979; 1690; 13289; 18873; 23.85; 16.78; 316955; 191587; 737313; 726823; 11.81; 73.94; 69.35; 5596.33; 8363.00; 12525.71
flowers2; 2032; 1731; 10695; 14634; 24.14; 17.65; 258169; 155373; 595039; 587710; 9.67; 70.74; 65.04; 8488.06; 12215.23; 16675.70
flowers3; 2084; 1808; 11476; 16109; 24.56; 17.52; 281866; 172781; 647581; 639731; 10.59; 71.72; 65.49; 7787.57; 10670.04; 15558.80
flyable heart; 1849; 1626; 44569; 56254; 18.36; 13.93; 818168; 458851; 1963723; 1872189; 28.58; 83.65; 82.02; 2579.14; 3723.87; 5597.72
fortissimoexs; 2306; 2107; 45040; 66427; 27.76; 18.61; 1250088; 719523; 3151153; 3045669; 45.47; 71.79; 62.91; 4982.63; 6804.16; 9454.71
fortunearterial; 2186; 1942; 65296; 66515; 13.52; 12.80; 882508; 503887; 2153109; 2036302; 31.55; 80.40; 77.97; 4618.67; 6596.25; 8670.00
fureraba; 2083; 1853; 50051; 66377; 20.05; 14.57; 1003649; 556765; 2425789; 2352972; 34.79; 80.29; 75.22; 3887.75; 5607.66; 8665.47
futsuu no fantasy; 2018; 1777; 39163; 48822; 19.05; 14.74; 745922; 422486; 1778854; 1719851; 26.29; 78.63; 77.38; 4927.65; 6574.11; 8587.70
gensou no idea; 2481; 2225; 32461; 47681; 25.32; 17.16; 821785; 475016; 1958269; 1929489; 29.69; 78.89; 68.32; 6548.54; 8824.64; 11693.42
grisaia; 2611; 2364; 62748; 96326; 27.18; 16.69; 1705580; 967235; 3971468; 3767371; 58.75; 77.79; 70.34; 5014.33; 7127.50; 10790.78
hanachirasu; 2149; 1742; 5877; 7823; 23.91; 17.90; 140515; 87663; 349599; 345074; 5.50; 72.57; 62.20; 10497.30; 14153.49; 19708.65
hanahira; 947; 654; 3571; 4263; 13.40; 10.88; 47866; 25278; 124311; 120902; 1.61; 87.59; 83.63; 4038.90; 5777.85; 9737.90
hatsukoi yohou; 1834; 1586; 30370; 48340; 20.26; 12.39; 615425; 351700; 1523937; 1483369; 21.96; 81.41; 77.15; 3165.21; 4357.74; 6115.92
henkoi; 1897; 1602; 21719; 48348; 25.13; 11.00; 545804; 294522; 1373860; 1361135; 18.42; 80.41; 72.35; 5400.42; 8168.91; 13360.40
hoshimemo; 2080; 1864; 54205; 60836; 16.99; 14.68; 921017; 537002; 2073147; 1997427; 32.91; 82.82; 76.60; 6311.17; 8912.16; 10990.45
iinchou shounin; 2051; 1789; 32743; 57165; 18.25; 10.10; 597436; 329258; 1508808; 1481290; 20.45; 81.00; 76.65; 4726.10; 7152.61; 11184.10
imakoi; 1446; 1157; 5991; 9542; 24.60; 15.16; 147388; 81016; 342955; 341436; 5.10; 82.87; 75.70; 3787.20; 4698.08; 6671.69
inganock; 2065; 1816; 17648; 32300; 23.39; 11.92; 412809; 228753; 968180; 896988; 14.13; 76.22; 67.21; 8512.20; 11569.18; 15684.87
itsusora; 2465; 2182; 30247; 36196; 19.68; 16.10; 595181; 355594; 1433403; 1386755; 21.77; 82.58; 77.66; 5738.10; 7782.91; 11197.75
jingai makyou; 2495; 2208; 35361; 53182; 23.75; 13.92; 839691; 451756; 2055351; 1804776; 28.07; 74.33; 75.60; 6595.94; 9016.92; 13549.30
kagerou; 2938; 2598; 21148; 27024; 37.73; 29.67; 797910; 488504; 1912123; 1897640; 30.67; 71.14; 63.19; 13159.22; 16824.98; 21739.36
kajiri akebono; 2861; 2565; 32668; 52551; 32.12; 19.43; 1049349; 624008; 2515798; 2457232; 39.36; 80.75; 70.97; 8876.20; 12092.00; 16399.33
kamikaze explorer; 2244; 1981; 45828; 76382; 23.82; 13.93; 1091420; 604293; 2668876; 2617771; 37.80; 77.41; 72.15; 4793.47; 6815.39; 10057.07
kamimaho; 2159; 1945; 44145; 51492; 20.02; 16.94; 883782; 523540; 2152608; 2117316; 32.85; 78.50; 72.80; 4681.57; 6748.60; 9410.84
kanojo no seiiki; 1294; 1056; 8188; 11395; 19.80; 13.92; 162124; 92009; 394844; 388839; 5.71; 83.47; 80.08; 2772.04; 3854.92; 5510.42
katahane; 1865; 1659; 46768; 40574; 13.15; 14.30; 614909; 330445; 1481610; 1425979; 20.09; 82.46; 76.26; 4968.90; 7181.14; 9868.97
kaziklu; 2068; 1726; 6099; 10068; 34.54; 20.67; 210682; 122656; 484567; 482447; 7.66; 67.93; 72.08; 6839.38; 8982.66; 12179.98
kimikoe; 2222; 1981; 44891; 56879; 16.57; 12.70; 743935; 418580; 1819039; 1772716; 26.39; 81.05; 75.79; 5399.30; 6526.63; 9513.30
kirakira; 2281; 1986; 35716; 50270; 30.25; 21.12; 1080238; 630810; 2557768; 2519197; 38.90; 74.75; 71.38; 4751.39; 6989.51; 9477.52
koichoco; 1991; 1760; 41241; 56740; 18.93; 13.32; 780580; 434221; 1979633; 1881859; 27.31; 76.64; 70.87; 5191.32; 7057.85; 10407.05
leyline1+2+3; 2019; 1795; 57821; 76028; 19.90; 14.70; 1150758; 667259; 2777676; 2694759; 41.09; 83.67; 78.43; 3417.87; 5034.21; 8158.85
leyline1; 1596; 1323; 17968; 23564; 18.62; 13.73; 334620; 194618; 813931; 791074; 11.93; 86.85; 80.70; 3242.73; 4821.30; 8506.29
leyline2; 1748; 1473; 21063; 27396; 20.49; 15.33; 431582; 251488; 1036671; 1009047; 15.44; 83.47; 78.12; 3313.33; 4820.41; 7849.15
leyline3; 1661; 1441; 18790; 25796; 20.43; 14.60; 383865; 223425; 926788; 909650; 13.83; 82.01; 77.16; 3678.28; 5307.08; 8368.73
magical charming; 2118; 1803; 37239; 55448; 17.75; 11.63; 661122; 365137; 1649810; 1611665; 22.92; 80.49; 80.38; 3887.11; 5835.05; 8904.23
majokoi; 1970; 1709; 37288; 46138; 15.83; 11.85; 590196; 320054; 1490266; 1349107; 19.68; 84.50; 85.56; 3842.07; 5312.36; 7625.74
mamiyakun-chi; 1945; 1723; 39099; 62619; 24.29; 14.86; 949907; 537997; 2293535; 2266268; 34.24; 77.16; 75.92; 3744.03; 5133.64; 7970.46
muramasa; 3070; 2793; 80564; 87653; 15.30; 13.75; 1232446; 733011; 3176908; 3019944; 46.79; 75.48; 62.77; 10867.40; 14238.10; 19393.10
nanarin; 1851; 1589; 39789; 42928; 17.83; 10.27; 709247; 248506; 1830351; 1120735; 15.83; 79.26; 82.89; 3836.19; 5502.67; 8337.86
nanatsuiro; 1543; 1312; 26930; 36064; 17.12; 12.61; 460913; 269083; 1122537; 1122517; 16.50; 83.64; 82.48; 2922.02; 4205.97; 7979.36
nine kokoiro; 1536; 1236; 8802; 12706; 16.55; 11.26; 145707; 82176; 369833; 358303; 5.18; 75.61; 76.53; 4769.63; 6646.21; 9387.37
noratoto; 2050; 1783; 41303; 58114; 16.35; 11.27; 675396; 365327; 1692782; 1636726; 22.74; 84.67; 80.82; 4208.71; 6091.07; 9478.32
nursery rhyme; 2046; 1779; 32500; 41516; 20.63; 15.78; 670321; 374822; 1616247; 1577109; 23.50; 81.65; 76.18; 4138.09; 5895.93; 8968.30
oretsuba afterstory; 2131; 1827; 16417; 26109; 25.53; 15.72; 419120; 231391; 995689; 979710; 14.56; 81.45; 72.59; 6226.47; 8674.15; 12361.20
oretsuba prelude; 2171; 1798; 8816; 15168; 31.09; 17.69; 274070; 150433; 634811; 625030; 9.41; 79.57; 66.71; 9069.30; 12066.90; 16435.43
oretsuba; 2770; 2482; 56675; 89741; 30.23; 17.71; 1713369; 908305; 3978483; 3692838; 56.59; 80.60; 71.64; 7905.71; 10526.48; 15007.49
parfait; 2113; 1834; 37003; 49015; 18.64; 11.60; 689863; 327039; 1730006; 1396010; 20.52; 73.68; 75.26; 5467.50; 7822.56; 10498.74
prawfclwyd; 2018; 1766; 25602; 34977; 18.99; 13.57; 486264; 270053; 1217811; 1187626; 17.17; 74.35; 75.16; 5949.85; 8665.39; 13859.77
princessfrontier; 2342; 2096; 48063; 61194; 16.86; 12.89; 810467; 449604; 1965704; 1927480; 27.99; 81.85; 75.86; 7316.16; 10521.14; 15428.02
rabuobu; 2169; 1904; 34143; 53700; 19.47; 11.64; 664852; 356575; 1613985; 1530452; 22.10; 83.09; 77.88; 6388.33; 8909.25; 13544.33
rinshin; 2210; 1949; 28964; 46057; 26.02; 15.53; 753720; 414396; 1787780; 1707720; 25.88; 78.39; 71.66; 6847.03; 8630.08; 12589.05
sansha mendan; 2042; 1841; 34816; 64406; 34.77; 18.37; 1210691; 621255; 2817128; 2785920; 41.26; 77.20; 61.68; 5693.79; 7728.06; 10608.81
satsukoi; 1882; 1587; 23111; 23947; 12.80; 11.93; 295846; 169260; 743615; 710642; 10.52; 80.51; 76.62; 4864.67; 6233.99; 9179.67
sengoku koihime x; 2915; 2667; 122581; 199749; 22.78; 13.60; 2792693; 1633397; 6883907; 6729611; 102.29; 84.48; 78.48; 6804.32; 10045.58; 14141.11
senmomo; 2513; 2235; 48841; 54049; 16.87; 14.91; 824140; 491207; 1981794; 1946095; 31.45; 75.08; 67.84; 8980.55; 11788.99; 16795.84
senrenbanka; 2222; 1918; 54585; 79446; 20.03; 13.42; 1093530; 617721; 2672904; 2618031; 38.39; 81.96; 78.62; 3505.19; 5079.70; 8395.25
senshinkan bansenjin; 2644; 2376; 26142; 42276; 33.07; 20.27; 864568; 516024; 1994101; 1977766; 32.45; 76.73; 69.08; 6231.70; 8282.96; 11734.25
senshinkan hachimyoujin; 2858; 2544; 34771; 56287; 33.51; 20.49; 1165087; 696088; 2740617; 2711958; 43.93; 78.27; 69.08; 7039.87; 9272.70; 12612.60
sharnoth fvr; 2124; 1877; 20847; 35054; 24.15; 13.12; 503476; 265581; 1173739; 1066449; 16.44; 73.29; 69.65; 6304.47; 8596.15; 12790.45
shirokuma; 2432; 2127; 48077; 70659; 21.46; 14.01; 1031582; 557907; 2515346; 2452640; 34.61; 80.86; 76.11; 8819.74; 11487.41; 17013.08
shugaten; 1763; 1521; 24869; 29261; 15.57; 12.91; 387316; 214006; 965349; 901986; 13.13; 83.74; 78.53; 6116.61; 8970.45; 15042.15
silverio vendetta; 2758; 2487; 24342; 39584; 35.67; 21.82; 868301; 510102; 2158325; 2150337; 33.02; 70.10; 60.75; 9901.80; 12445.46; 16409.66
simulacre; 1771; 1515; 13577; 19050; 21.27; 15.03; 288819; 178681; 685150; 674597; 10.82; 81.36; 81.50; 3613.47; 5136.38; 7761.52
snowwhite; 1546; 1240; 5778; 7959; 30.93; 22.14; 178726; 106545; 417532; 410758; 6.49; 78.65; 77.01; 3594.20; 5329.90; 9526.10
soramitsu; 2125; 1925; 46347; 58061; 22.64; 15.36; 1049089; 518230; 2578691; 2185261; 32.49; 79.44; 77.30; 4185.43; 5738.73; 8503.74
sourire; 1894; 1637; 30168; 44601; 20.83; 13.77; 628424; 362062; 1555598; 1511058; 22.50; 80.49; 80.62; 3140.10; 4691.99; 7714.73
subahibi; 2238; 1996; 58018; 74763; 18.33; 11.77; 1063337; 520905; 2713808; 2237407; 32.17; 78.01; 75.51; 4886.40; 6935.05; 10332.63
sukinara; 2069; 1835; 60041; 84942; 20.91; 14.09; 1255586; 682601; 3147409; 3007064; 42.08; 82.34; 82.24; 4476.26; 6524.96; 10936.33
tarareba; 1797; 1553; 20992; 32452; 22.27; 14.25; 467570; 262555; 1119586; 1119535; 16.43; 79.21; 76.67; 3924.06; 5940.67; 10672.82
trinoline; 1954; 1692; 27628; 34306; 18.66; 14.67; 515408; 286655; 1259214; 1226295; 18.14; 77.91; 75.88; 3418.70; 4991.71; 7730.85
tsujidou-san no jun'ai road; 2269; 2019; 80118; 102793; 14.93; 11.31; 1196359; 651727; 2940726; 2766732; 40.48; 84.30; 75.59; 5885.24; 8126.17; 11882.75
tsujidou-san no virgin road; 2064; 1802; 43219; 54886; 15.43; 11.86; 666755; 367278; 1632300; 1545307; 22.70; 83.32; 75.29; 5736.25; 8067.12; 11923.18
tsuriotsu; 2390; 2102; 30932; 60869; 34.31; 17.25; 1061406; 636679; 2455467; 2436023; 38.67; 79.87; 74.90; 4917.50; 7485.27; 11333.75
tsuushinbo; 1866; 1617; 28505; 43993; 21.66; 13.82; 617432; 343593; 1503324; 1477566; 21.70; 86.13; 84.97; 2745.28; 3752.92; 5477.96
twinklecrusaders; 2586; 2313; 77293; 115311; 19.82; 13.10; 1531958; 850300; 3680074; 3678307; 52.76; 80.37; 73.18; 6910.42; 9631.57; 14919.55
white_album; 1831; 1481; 29108; 31890; 15.90; 13.32; 462896; 251596; 1123118; 1014554; 15.59; 79.00; 79.82; 4461.64; 6961.53; 10498.58
yoakena; 2134; 1902; 57455; 60314; 14.48; 13.37; 831742; 467022; 2074181; 1942943; 29.29; 78.88; 77.63; 3982.08; 5666.26; 8626.35
}}}

The Hayashi metric is derived from: chars per sentence; commas per periods*; average consecutive length of each of kanji/hiragana/katakana/other

The custom metric is derived from: chars per sentence; commas per periods*; proportion of the script made up by each of kanji/hiragana/katakana/other; proportionally adjusted average consecutive length of each of kanji/hiragana/katakana/other

* sentence endings imply periods		 Vivify Health & Chiropractic<<<BR>>
><<<BR>>
>
2/590 Hay St,<<<BR>>
><<<BR>>
>
Subiaco WA 6008<<<BR>>
><<<BR>>
>
(08) 9381 3150<<<BR>>
><<<BR>>
>
<<<BR>>
><<<BR>>
>
my webpage :: [[https://www.healthdirect.gov.au/chiropractors|www.healthdirect.gov.au]]

Vivify Health & Chiropractic<
><
> 2/590 Hay St,<
><
> Subiaco WA 6008<
><
> (08) 9381 3150<
><
> <
><
> my webpage :: www.healthdirect.gov.au

Stats (last edited 2020-08-22 13:05:50 by weh)