Differences between revisions 38 and 63 (spanning 25 versions)
⇤ ← Revision 38 as of 2018-04-18 13:22:00 →
Size: 14771
Editor: weh
Comment:
← Revision 63 as of 2018-09-18 09:37:42 → ⇥
Size: 269
Editor: KimberHeim
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
I just rewrote the stats tools. These are the stats output by the new tools. They differ slightly from the old stats because the rewrite deals with a few edge cases differently. The differences are within a margin of error, or when the difference is big, the old stats tools are probably doing something wrong.

If you got linked here for a statistic that isn't here ('''like the Core 6k stats'''), look at the [[Old Stats]] page instead.

For now, see the [[Old Stats]] page for more details. If you want to add a script, post it to the [[Requests]] page.

See also [[Changes]].

You can get the new analysis tools [[https://mega.nz/#!UVczXRwS!cnGBAJR3t9zOjjUecbl8Nl4M3nBw5ms-s7xR-2mCZtA|here]] (you need [[https://mega.nz/#!RNcDHJzJ!ibbtJGteZpqdTA5QIZt88TnyirOB0Mkl4uktM4hKcsY|this]] too). They're easier to use than the previous ones, but they require python 3.6 or newer, and if you're not on Windows, you need to patch and recompile mecab yourself to fix a bug (instructions included) (you CANNOT use mecab as compiled by your distribution's maintainer).

Higher is easier: Hayashi; custom metric

Lower is easier: kanji (unique); kanji(2+); chars/line; chars/sentence; freqlistX% Target

The "Hayashi" metric are an estimate of structural complexity. The Hayashi metric is inherently flawed and should only be used as a general guideline.

The "custom metric" is like "Hayashi", and uses similar data, but it's designed to correlate well with "freqlist92.5% target". This is another estimate of structural complexity, but because it estimates the "freqlist92.5% target" metric, it's arbitrary.

The "freqlistX% Target" metrics are an estimate of lexical complexity. High measurements mean that the script uses uncommon words more frequently, or common words less frequently. Commonness is based on every long-enough script combined, not on general purpose frequency lists or the frequency list of the single script in question.

The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It doesn't take any real complexity differences into account, take it with a huge grain of salt; also, '''it assumes as ~475 characters/minute reading speed''', not like 300 or 200. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. Example of calibrating with only character count as a source variable: https://i.imgur.com/xCWwrs9.png

{{{#!nutable
script name; kanji\n(unique); kanji\n(2+); lines; sentences; chars\n/line; chars\n/sentence; characters; lexemes; sjis bytes; sjis (dedup); hours estimate; Hayashi; custom\nmetric; freqlist\n90% Target; freqlist\n92.5% Target; freqlist\n95% Target
aete mushisuru; 1987; 1723; 36629; 41691; 13.83; 11.68; 506616; 285261; 1287119; 1238044; 17.74; 80.76; 74.10; 5582.78; 8074.27; 12366.33
amakoi; 2028; 1751; 47590; 67368; 16.41; 11.34; 781112; 442307; 1923290; 1904813; 27.58; 86.37; 86.09; 3762.61; 5508.27; 8393.89
ao no kanata; 2129; 1846; 44234; 57107; 20.20; 15.24; 893350; 504764; 2125556; 2065379; 31.46; 79.14; 74.59; 4205.83; 5571.08; 8468.75
astelight shuushuubako; 2982; 2595; 9461; 14515; 51.53; 33.45; 487535; 291731; 1166666; 1157863; 18.65; 62.44; 48.15; 13872.10; 17769.80; 23464.20
axanael; 1861; 1585; 34375; 42538; 12.17; 9.18; 418504; 207002; 1139513; 1053681; 12.86; 81.09; 73.51; 6560.93; 8594.95; 13269.47
biman1; 1750; 1394; 7641; 12526; 23.79; 14.05; 181779; 98089; 448539; 439945; 6.27; 78.72; 75.45; 7622.10; 11473.33; 19556.70
chronobox trials; 1265; 914; 3160; 5460; 19.99; 11.29; 63177; 35006; 160474; 157777; 2.24; 81.82; 76.67; 4888.75; 6788.62; 8715.47
chronobox; 1985; 1737; 23036; 41201; 21.60; 11.78; 497566; 274526; 1261732; 1236591; 17.54; 79.04; 74.39; 5966.37; 8174.83; 11991.53
cloverpoint; 2258; 1995; 42677; 60322; 20.19; 13.68; 861662; 472360; 2146495; 2073383; 29.68; 78.74; 73.73; 5873.09; 8325.98; 12040.95
daitoshokan fandisk; 2035; 1760; 28827; 34367; 16.22; 13.33; 467657; 267247; 1134885; 1113236; 16.96; 77.88; 73.88; 5367.50; 7766.52; 12316.00
daitoshokan; 2312; 2055; 68258; 76633; 16.00; 13.86; 1092295; 625870; 2647706; 2562769; 39.49; 77.45; 72.58; 5019.16; 7032.07; 11087.38
dies irae; 2790; 2554; 58314; 88559; 28.76; 18.16; 1677110; 952246; 4005512; 3830009; 60.02; 69.97; 68.66; 6970.28; 9274.94; 12865.00
dracuriot; 2218; 1944; 51751; 84258; 23.36; 13.65; 1208987; 660083; 2956248; 2832280; 40.95; 80.31; 74.84; 4214.40; 5653.33; 8502.57
eustia; 2454; 2210; 64697; 69324; 15.16; 13.65; 980871; 564560; 2397710; 2292286; 34.92; 78.84; 76.83; 6605.90; 9895.03; 14487.60
fate stay night; 2556; 2320; 75159; 90847; 23.04; 17.88; 1731549; 965201; 4260695; 3870323; 59.09; 71.48; 67.03; 6845.09; 8844.27; 13718.15
flowers1+2+3; 2412; 2178; 35460; 49370; 24.17; 17.34; 856990; 519241; 1979933; 1949229; 32.04; 72.20; 66.75; 7336.67; 10494.88; 15546.76
flowers1; 1979; 1690; 13289; 18873; 23.85; 16.78; 316955; 191587; 737313; 726823; 11.81; 73.94; 69.35; 5638.72; 8267.88; 12483.33
flowers2; 2032; 1731; 10695; 14634; 24.14; 17.65; 258169; 155373; 595039; 587710; 9.67; 70.74; 65.04; 8974.77; 12965.08; 17902.15
flowers3; 2084; 1808; 11476; 16109; 24.56; 17.52; 281866; 172781; 647581; 639731; 10.59; 71.72; 65.49; 7906.20; 10900.40; 16048.47
flyable heart; 1849; 1626; 44569; 56254; 18.36; 13.93; 818168; 458851; 1963723; 1872189; 28.58; 83.65; 82.02; 2570.20; 3721.48; 5705.28
fortissimoexs; 2306; 2107; 45040; 66462; 28.59; 19.15; 1287702; 725062; 3138289; 3033401; 46.03; 70.06; 60.51; 5222.82; 6957.43; 9771.27
fortunearterial; 2186; 1942; 65296; 66515; 13.52; 12.80; 882508; 503887; 2153109; 2036302; 31.55; 80.40; 77.97; 4668.15; 6619.00; 9450.60
fureraba; 2083; 1853; 50051; 66377; 20.05; 14.57; 1003649; 556765; 2425789; 2352972; 34.79; 80.29; 75.22; 3916.97; 5690.77; 8732.11
futsuu no fantasy; 2018; 1777; 53492; 59776; 13.98; 12.03; 747795; 421718; 1793697; 1730775; 26.26; 79.61; 79.52; 4858.70; 6595.89; 8317.53
gensou no idea; 2481; 2225; 32461; 47681; 25.32; 17.16; 821785; 475016; 1958269; 1929489; 29.69; 78.89; 68.32; 6563.85; 8796.28; 11788.92
hanachirasu; 2149; 1742; 5877; 7823; 23.91; 17.90; 140515; 87663; 349599; 345074; 5.50; 72.57; 62.20; 10397.30; 13918.23; 19805.09
hanahira; 947; 654; 3571; 4263; 13.40; 10.88; 47866; 25278; 124311; 120902; 1.61; 87.59; 83.63; 4105.80; 5861.85; 9879.90
hatsukoi yohou; 1834; 1586; 30370; 48340; 20.26; 12.39; 615425; 351700; 1523937; 1483369; 21.96; 81.41; 77.15; 3222.04; 4377.61; 6070.15
henkoi; 1897; 1602; 21719; 48348; 25.13; 11.00; 545804; 294522; 1373860; 1361135; 18.42; 80.41; 72.35; 5635.18; 8376.66; 13420.40
hoshimemo; 2080; 1864; 54205; 60836; 16.99; 14.68; 921017; 537002; 2073147; 1997427; 32.91; 82.82; 76.60; 6325.40; 8747.55; 12291.18
iinchou shounin; 2051; 1789; 32743; 57165; 18.25; 10.10; 597436; 329258; 1508808; 1481290; 20.45; 81.00; 76.65; 4831.85; 7109.66; 11162.59
imakoi; 1446; 1157; 5991; 9542; 24.60; 15.16; 147388; 81016; 342955; 341436; 5.10; 82.87; 75.70; 3878.70; 5133.15; 6788.74
inganock; 2065; 1816; 17648; 32300; 23.39; 11.92; 412809; 228753; 968180; 896988; 14.13; 76.22; 67.21; 8465.80; 11504.05; 15692.75
itsusora; 2465; 2182; 30247; 36196; 19.68; 16.10; 595181; 355594; 1433403; 1386755; 21.77; 82.58; 77.66; 5648.62; 7676.54; 11078.67
jingai makyou; 2495; 2208; 35361; 53182; 23.75; 13.92; 839691; 451756; 2055351; 1804776; 28.07; 74.33; 75.60; 6528.60; 8926.20; 13503.60
kagerou; 2938; 2598; 21148; 27024; 37.73; 29.67; 797910; 488504; 1912123; 1897640; 30.67; 71.14; 63.19; 13070.22; 16690.16; 20903.47
kajiri akebono; 2861; 2565; 32668; 52551; 32.12; 19.43; 1049349; 624008; 2515798; 2457232; 39.36; 80.75; 70.97; 8787.96; 11928.48; 15986.95
kamimaho; 2159; 1945; 44145; 51492; 20.02; 16.94; 883782; 523540; 2152608; 2117316; 32.85; 78.50; 72.80; 4707.35; 6716.28; 9198.87
katahane; 1865; 1659; 46768; 40574; 13.15; 14.30; 614909; 330445; 1481610; 1425979; 20.09; 82.46; 76.26; 4914.66; 6960.41; 9894.95
kaziklu; 2068; 1726; 6099; 10068; 34.54; 20.67; 210682; 122656; 484567; 482447; 7.66; 67.93; 72.08; 6741.57; 8911.93; 12013.32
kimikoe; 2222; 1981; 44891; 56879; 16.57; 12.70; 743935; 418580; 1819039; 1772716; 26.39; 81.05; 75.79; 5418.78; 6526.85; 9774.50
kirakira; 2281; 1986; 35716; 50270; 30.25; 21.12; 1080238; 630810; 2557768; 2519197; 38.90; 74.75; 71.38; 4838.34; 7020.59; 9696.42
leyline1+2+3; 2019; 1795; 57821; 76028; 19.90; 14.70; 1150758; 667259; 2777676; 2694759; 41.09; 83.67; 78.43; 3391.71; 4994.99; 8201.76
leyline1; 1596; 1323; 17968; 23564; 18.62; 13.73; 334620; 194618; 813931; 791074; 11.93; 86.85; 80.70; 3219.80; 4833.30; 8377.10
leyline2; 1748; 1473; 21063; 27396; 20.49; 15.33; 431582; 251488; 1036671; 1009047; 15.44; 83.47; 78.12; 3312.46; 4819.04; 7918.57
leyline3; 1661; 1441; 18790; 25796; 20.43; 14.60; 383865; 223425; 926788; 909650; 13.83; 82.01; 77.16; 3687.37; 5312.35; 8330.05
magical charming; 2118; 1803; 37239; 55448; 17.75; 11.63; 661122; 365137; 1649810; 1611665; 22.92; 80.49; 80.38; 3904.70; 5842.78; 8953.96
majokoi; 1970; 1709; 37288; 46138; 15.83; 11.85; 590196; 320054; 1490266; 1349107; 19.68; 84.50; 85.56; 3848.78; 5308.08; 7511.12
muramasa; 3070; 2793; 80564; 87653; 15.30; 13.75; 1232446; 733011; 3176908; 3019944; 46.79; 75.48; 62.77; 10877.48; 14171.07; 19109.10
nanarin; 1851; 1589; 39789; 42928; 17.83; 10.27; 709247; 248506; 1830351; 1120735; 15.83; 79.26; 82.89; 3897.17; 5373.23; 8278.72
nanatsuiro; 1543; 1312; 26930; 36064; 17.12; 12.61; 460913; 269083; 1122537; 1122517; 16.50; 83.64; 82.48; 2945.40; 4207.70; 7901.90
noratoto; 2050; 1783; 41303; 58114; 16.35; 11.27; 675396; 365327; 1692782; 1636726; 22.74; 84.67; 80.82; 4266.76; 6135.90; 9457.22
nursery rhyme; 2046; 1779; 32500; 41516; 20.63; 15.78; 670321; 374822; 1616247; 1577109; 23.50; 81.65; 76.18; 4133.40; 5919.28; 9095.35
oretsuba afterstory; 2131; 1827; 16417; 26109; 25.53; 15.72; 419120; 231391; 995689; 979710; 14.56; 81.45; 72.59; 6307.20; 8622.08; 12491.60
oretsuba prelude; 2171; 1798; 8816; 15168; 31.09; 17.69; 274070; 150433; 634811; 625030; 9.41; 79.57; 66.71; 9026.10; 12083.76; 16381.80
oretsuba; 2770; 2482; 56675; 89741; 30.23; 17.71; 1713369; 908305; 3978483; 3692838; 56.59; 80.60; 71.64; 7901.68; 10517.19; 15080.42
parfait; 2134; 1859; 36576; 50540; 19.56; 11.77; 715599; 340032; 1786866; 1463197; 21.43; 73.26; 74.39; 5739.88; 8252.25; 10621.82
prawfclwyd; 2018; 1766; 25602; 34977; 18.99; 13.57; 486264; 270053; 1217811; 1187626; 17.17; 74.35; 75.16; 6010.10; 8708.33; 13923.85
princessfrontier; 2342; 2096; 48063; 61194; 16.86; 12.89; 810467; 449604; 1965704; 1927480; 27.99; 81.85; 75.86; 7272.53; 10581.86; 15178.05
rabuobu; 2169; 1904; 34143; 53700; 19.47; 11.64; 664852; 356575; 1613985; 1530452; 22.10; 83.09; 77.88; 6464.31; 8939.47; 13509.50
rinshin; 2210; 1949; 28964; 46057; 26.02; 15.53; 753720; 414396; 1787780; 1707720; 25.88; 78.39; 71.66; 6832.42; 8583.59; 12627.05
sansha mendan; 2042; 1841; 34816; 64406; 34.77; 18.37; 1210691; 621255; 2817128; 2785920; 41.26; 77.20; 61.68; 6207.55; 7932.98; 11412.06
satsukoi; 1882; 1587; 23111; 23947; 12.80; 11.93; 295846; 169260; 743615; 710642; 10.52; 80.51; 76.62; 4836.57; 6266.03; 9774.26
senmomo; 2513; 2235; 48841; 54049; 16.87; 14.91; 824140; 491207; 1981794; 1946095; 31.45; 75.08; 67.84; 9600.36; 12741.25; 16388.52
senrenbanka; 2222; 1918; 54585; 79446; 20.03; 13.42; 1093530; 617721; 2672904; 2618031; 38.39; 81.96; 78.62; 3509.90; 5120.18; 8319.59
senshinkan bansenjin; 2644; 2376; 26142; 42276; 33.07; 20.27; 864568; 516024; 1994101; 1977766; 32.45; 76.73; 69.08; 6140.93; 8197.88; 11625.81
senshinkan hachimyoujin; 2858; 2544; 34771; 56287; 33.51; 20.49; 1165087; 696088; 2740617; 2711958; 43.93; 78.27; 69.08; 6968.15; 9151.66; 12468.80
sharnoth fvr; 2124; 1877; 20847; 35054; 24.15; 13.12; 503476; 265581; 1173739; 1066449; 16.44; 73.29; 69.65; 6278.50; 8540.64; 12659.25
shirokuma; 2432; 2127; 48077; 70659; 21.46; 14.01; 1031582; 557907; 2515346; 2452640; 34.61; 80.86; 76.11; 8817.20; 11250.94; 16796.82
shugaten; 1763; 1521; 24869; 29261; 15.57; 12.91; 387316; 214006; 965349; 901986; 13.13; 83.74; 78.53; 6112.77; 9018.82; 15156.30
silverio vendetta; 2758; 2487; 24342; 39584; 35.67; 21.82; 868301; 510102; 2158325; 2150337; 33.02; 70.10; 60.75; 9732.02; 12260.32; 16247.90
simulacre; 1771; 1515; 13577; 19050; 21.27; 15.03; 288819; 178681; 685150; 674597; 10.82; 81.36; 81.50; 3626.42; 5048.93; 7374.91
snowwhite; 1546; 1240; 5778; 7959; 30.93; 22.14; 178726; 106545; 417532; 410758; 6.49; 78.65; 77.01; 3582.35; 5305.90; 9484.20
soramitsu; 2125; 1925; 46347; 58061; 22.64; 15.36; 1049089; 518230; 2578691; 2185261; 32.49; 79.44; 77.30; 4163.04; 5741.53; 8438.57
sourire; 1894; 1637; 30168; 44601; 20.83; 13.77; 628424; 362062; 1555598; 1511058; 22.50; 80.49; 80.62; 3163.06; 4697.66; 7754.82
subahibi; 2238; 1996; 58018; 74763; 18.33; 11.77; 1063337; 520905; 2713808; 2237407; 32.17; 78.01; 75.51; 4864.20; 6898.10; 10295.80
sukinara; 2069; 1835; 60041; 84942; 20.91; 14.09; 1255586; 682601; 3147409; 3007064; 42.08; 82.34; 82.24; 4561.97; 6567.55; 11020.26
tarareba; 1797; 1553; 20992; 32452; 22.27; 14.25; 467570; 262555; 1119586; 1119535; 16.43; 79.21; 76.67; 3957.97; 5999.89; 10865.72
trinoline; 1954; 1692; 27628; 34306; 18.66; 14.67; 515408; 286655; 1259214; 1226295; 18.14; 77.91; 75.88; 3564.13; 5091.36; 7807.35
tsujidou-san no jun'ai road; 2269; 2019; 80118; 102793; 14.93; 11.31; 1196359; 651727; 2940726; 2766732; 40.48; 84.30; 75.59; 5912.11; 8204.53; 11913.45
tsujidou-san no virgin road; 2064; 1802; 43219; 54886; 15.43; 11.86; 666755; 367278; 1632300; 1545307; 22.70; 83.32; 75.29; 5766.35; 8131.56; 11874.95
tsuriotsu; 2390; 2102; 30932; 60869; 34.31; 17.25; 1061406; 636679; 2455467; 2436023; 38.67; 79.87; 74.90; 5141.25; 7480.22; 11338.05
tsuushinbo; 1866; 1617; 28505; 43993; 21.66; 13.82; 617432; 343593; 1503324; 1477566; 21.70; 86.13; 84.97; 2748.90; 3851.62; 5522.81
twinklecrusaders; 2586; 2313; 77293; 115311; 19.82; 13.10; 1531958; 850300; 3680074; 3678307; 52.76; 80.37; 73.18; 6935.70; 9717.79; 14968.75
white_album; 1831; 1481; 29108; 31890; 15.90; 13.32; 462896; 251596; 1123118; 1014554; 15.59; 79.00; 79.82; 4457.18; 6990.43; 10552.56
yoakena; 2134; 1902; 57455; 60314; 14.48; 13.37; 831742; 467022; 2074181; 1942943; 29.29; 78.88; 77.63; 3987.87; 5676.53; 8680.35
}}}

The Hayashi metric is derived from: chars per sentence; commas per periods*; average consecutive length of each of kanji/hiragana/katakana/other

The custom metric is derived from: chars per sentence; commas per periods*; proportion of the script made up by each of kanji/hiragana/katakana/other; proportionally adjusted average consecutive length of each of kanji/hiragana/katakana/other

* sentence endings imply periods		 Vivify Health & Chiropractic<<<BR>>
><<<BR>>
>
2/590 Hay St,<<<BR>>
><<<BR>>
>
Subiaco WA 6008<<<BR>>
><<<BR>>
>
(08) 9381 3150<<<BR>>
><<<BR>>
>
<<<BR>>
><<<BR>>
>
my webpage :: [[https://www.healthdirect.gov.au/chiropractors|www.healthdirect.gov.au]]

Vivify Health & Chiropractic<
><
> 2/590 Hay St,<
><
> Subiaco WA 6008<
><
> (08) 9381 3150<
><
> <
><
> my webpage :: www.healthdirect.gov.au

Stats (last edited 2020-08-22 13:05:50 by weh)