|
Size: 21163
Comment:
|
Size: 269
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| I just rewrote the stats tools. These are the stats output by the new tools. They differ slightly from the old stats because the rewrite deals with a few edge cases differently. The differences are within a margin of error, or when the difference is big, the old stats tools are probably doing something wrong. If you got linked here for a statistic that isn't here ('''like the Core 6k stats'''), look at the [[Old Stats]] page instead. For now, see the [[Old Stats]] page for more details. If you want to add a script, post it to the [[Requests]] page. See also [[Changes]]. You can get the new analysis tools [[https://mega.nz/#!1cMTEbCY!YyOScinptlw2_oPDk4J4gssUxmDmSg_uR2IH8WyrFgM|here]] (you need [[https://mega.nz/#!RNcDHJzJ!ibbtJGteZpqdTA5QIZt88TnyirOB0Mkl4uktM4hKcsY|this]] too). They're easier to use than the previous ones, but they require python 3.6 or newer, and if you're not on Windows, you need to patch and recompile mecab yourself to fix a bug (instructions included) (you CANNOT use mecab as compiled by your distribution's maintainer). Higher is easier: Hayashi; custom metric Lower is easier: kanji (unique); kanji(2+); chars/line; chars/sentence; freqlistX% Target The "Hayashi" metric are an estimate of structural complexity. The Hayashi metric is inherently flawed and should only be used as a general guideline. The "custom metric" is like "Hayashi", and uses similar data, but it's designed to correlate well with "freqlist92.5% target". This is another estimate of structural complexity, but because it estimates the "freqlist92.5% target" metric, it's arbitrary. The "freqlistX% Target" metrics are an estimate of lexical complexity. High measurements mean that the script uses uncommon words more frequently, or common words less frequently. Commonness is based on every long-enough script combined, not on general purpose frequency lists or the frequency list of the single script in question. The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It doesn't take any real complexity differences into account and it's '''based on VNDB's inaccurate length categories''', take it with a '''huge grain of salt'''; also, '''it assumes a ~475 characters/minute reading speed''', not like 300 or 200. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. Example of calibrating with only character count as a source variable: https://i.imgur.com/tqTGVlB.png You can compare the Hayashi, custom metric a, custom metric b, and freqlist 92.5% target stats with [[http://wareya.moe/extra/statsgraph.html|this interactive graph]]. {{{#!nutable script name; kanji\n(unique); kanji\n(2+); lines; sentences; chars\n/line; chars\n/sentence; characters; lexemes; sjis bytes; sjis (dedup); hours estimate; Hayashi; custom\nmetric a; custom\nmetric b; freqlist\n90% Target; freqlist\n92.5% Target; freqlist\n95% Target aete mushisuru; 1987; 1723; 36629; 41691; 13.83; 11.68; 506616; 285261; 1287119; 1238044; 17.74; 80.76; 78.70; 79.28; 5477.95; 7826.64; 11910.43 amakoi; 2028; 1752; 28355; 54610; 27.53; 14.01; 780536; 442818; 1903429; 1889972; 27.61; 84.90; 86.98; 88.03; 3550.28; 5260.80; 8256.80 ao no kanata; 2129; 1846; 44234; 57107; 20.20; 15.24; 893350; 504764; 2125556; 2065379; 31.46; 79.14; 79.71; 79.03; 4040.50; 5564.03; 8420.60 astelight shuushuubako; 2982; 2595; 9461; 14515; 51.53; 33.45; 487535; 291731; 1166666; 1157863; 18.65; 62.44; 50.88; 64.52; 13811.70; 17546.80; 23177.96 axanael; 1861; 1585; 34375; 42538; 12.17; 9.18; 418504; 207002; 1139513; 1053681; 12.86; 81.09; 73.26; 73.38; 6283.80; 8518.60; 12840.40 biman1; 1750; 1394; 7641; 12526; 23.79; 14.05; 181779; 98089; 448539; 439945; 6.27; 78.72; 78.52; 79.35; 7291.70; 10970.16; 19011.55 buraban; 1800; 1570; 39133; 59513; 19.53; 12.42; 764174; 437576; 1940165; 1871589; 27.10; 78.45; 83.23; 82.56; 2299.49; 3253.31; 5017.39 chronobox trials; 1265; 914; 3160; 5460; 19.99; 11.29; 63177; 35006; 160474; 157777; 2.24; 81.82; 81.73; 81.76; 4477.07; 6681.62; 8928.75 chronobox; 1985; 1737; 23036; 41201; 21.60; 11.78; 497566; 274526; 1261732; 1236591; 17.54; 79.04; 80.91; 80.59; 5688.77; 8102.91; 11245.83 clacra; 2215; 1954; 41776; 59682; 19.64; 13.31; 820658; 447978; 2038082; 1975933; 28.51; 77.45; 80.03; 79.82; 4394.11; 5918.38; 8554.68 cloverpoint; 2258; 1995; 42677; 60322; 20.19; 13.68; 861662; 472360; 2146495; 2073383; 29.68; 78.74; 79.90; 79.63; 5905.30; 8325.46; 12373.49 daitoshokan fandisk; 2035; 1760; 28827; 34367; 16.22; 13.33; 467657; 267247; 1134885; 1113236; 16.96; 77.88; 78.83; 78.72; 5326.62; 7691.17; 12235.71 daitoshokan; 2312; 2055; 68258; 76633; 16.00; 13.86; 1092295; 625870; 2647706; 2562769; 39.49; 77.45; 78.32; 78.02; 4971.76; 7005.35; 11048.98 dies irae; 2790; 2554; 58314; 88559; 28.76; 18.16; 1677110; 952246; 4005512; 3830009; 60.02; 69.97; 75.05; 74.85; 7194.22; 9567.03; 13233.14 dracuriot; 2218; 1944; 51751; 84258; 23.36; 13.65; 1208987; 660083; 2956248; 2832280; 40.95; 80.31; 80.60; 80.82; 4050.77; 5704.10; 8309.71 eustia; 2454; 2210; 64697; 69324; 15.16; 13.65; 980871; 564560; 2397710; 2292286; 34.92; 78.84; 79.89; 80.04; 6589.80; 9919.35; 14151.28 fate stay night; 2556; 2320; 75159; 90847; 23.04; 17.88; 1731549; 965201; 4260695; 3870323; 59.09; 71.48; 76.23; 74.90; 6976.78; 8986.69; 13963.05 flowers1+2+3; 2412; 2178; 35460; 49370; 24.17; 17.34; 856990; 519241; 1979933; 1949229; 32.04; 72.20; 71.77; 70.83; 7298.19; 10343.75; 15166.50 flowers1; 1979; 1690; 13289; 18873; 23.85; 16.78; 316955; 191587; 737313; 726823; 11.81; 73.94; 75.21; 74.09; 5728.67; 8305.25; 12655.00 flowers2; 2032; 1731; 10695; 14634; 24.14; 17.65; 258169; 155373; 595039; 587710; 9.67; 70.74; 69.60; 68.94; 8492.30; 12156.01; 16293.57 flowers3; 2084; 1808; 11476; 16109; 24.56; 17.52; 281866; 172781; 647581; 639731; 10.59; 71.72; 69.79; 68.54; 7976.20; 10833.07; 15316.17 flyable heart; 1849; 1626; 44569; 56254; 18.36; 13.93; 818168; 458851; 1963723; 1872189; 28.58; 83.65; 85.51; 85.24; 2554.00; 3705.42; 5644.50 fortissimoexs; 2306; 2107; 45040; 66427; 27.76; 18.61; 1250088; 719523; 3151153; 3045669; 45.47; 71.79; 78.13; 77.04; 5045.52; 6831.66; 9418.42 fortunearterial; 2186; 1942; 65296; 66515; 13.52; 12.80; 882508; 503887; 2153109; 2036302; 31.55; 80.40; 81.33; 81.10; 4685.91; 6649.50; 9161.35 fureraba; 2083; 1853; 50051; 66377; 20.05; 14.57; 1003649; 556765; 2425789; 2352972; 34.79; 80.29; 78.77; 78.67; 3869.31; 5610.31; 8684.88 futsuu no fantasy; 2018; 1777; 39163; 48822; 19.05; 14.74; 745922; 422486; 1778854; 1719851; 26.29; 78.63; 81.50; 81.66; 5142.62; 6433.00; 9458.36 gensou no idea; 2481; 2225; 32461; 47681; 25.32; 17.16; 821785; 475016; 1958269; 1929489; 29.69; 78.89; 78.70; 77.94; 6596.25; 8610.28; 11074.73 grisaia; 2611; 2364; 62748; 96326; 27.18; 16.69; 1705580; 967235; 3971468; 3767371; 58.75; 77.79; 78.36; 77.90; 5006.25; 7063.89; 10667.34 hanachirasu; 2149; 1742; 5877; 7823; 23.91; 17.90; 140515; 87663; 349599; 345074; 5.50; 72.57; 60.01; 58.97; 10545.77; 13871.97; 19760.88 hanahira; 947; 654; 3571; 4263; 13.40; 10.88; 47866; 25278; 124311; 120902; 1.61; 87.59; 82.38; 84.12; 3982.80; 5906.43; 9704.95 harumade kururu; 1908; 1658; 39430; 47498; 14.64; 11.73; 577162; 328041; 1388399; 1348107; 19.97; 85.98; 84.70; 84.94; 4018.53; 6167.32; 11057.15 hatsukoi yohou; 1834; 1586; 30370; 48340; 20.26; 12.39; 615425; 351700; 1523937; 1483369; 21.96; 81.41; 82.51; 83.05; 3220.65; 4372.40; 6054.57 hatsuyuki sakura; 1980; 1705; 35304; 47188; 15.71; 11.32; 554715; 314108; 1411404; 1307815; 19.17; 82.56; 83.71; 83.45; 5041.32; 7406.57; 10903.76 henkoi; 1897; 1602; 21719; 48348; 25.13; 11.00; 545804; 294522; 1373860; 1361135; 18.42; 80.41; 75.82; 76.06; 5265.42; 8226.96; 13439.37 hoshimemo; 2080; 1864; 54205; 60836; 16.99; 14.68; 921017; 537002; 2073147; 1997427; 32.91; 82.82; 81.37; 81.18; 6236.70; 8920.52; 11352.76 iinchou shounin; 2051; 1789; 32743; 57165; 18.25; 10.10; 597436; 329258; 1508808; 1481290; 20.45; 81.00; 78.88; 80.05; 4702.07; 6983.32; 11205.10 imakoi; 1446; 1157; 5991; 9542; 24.60; 15.16; 147388; 81016; 342955; 341436; 5.10; 82.87; 77.59; 77.34; 3807.05; 4660.15; 6647.47 inganock; 2065; 1816; 17648; 32300; 23.39; 11.92; 412809; 228753; 968180; 896988; 14.13; 76.22; 72.06; 70.82; 8425.76; 11310.68; 15866.51 itsusora; 2465; 2182; 30247; 36196; 19.68; 16.10; 595181; 355594; 1433403; 1386755; 21.77; 82.58; 79.81; 77.63; 5723.25; 7899.81; 11323.26 jikaijikake no eve; 2566; 2361; 44740; 85707; 35.13; 17.96; 1571801; 896917; 3644082; 3582523; 56.50; 72.62; 69.43; 67.77; 7847.86; 10264.50; 14273.00 jingai makyou; 2495; 2208; 35361; 53182; 23.75; 13.92; 839691; 451756; 2055351; 1804776; 28.07; 74.33; 79.62; 77.90; 6544.51; 9039.10; 13482.90 kagerou; 2938; 2598; 21148; 27024; 37.73; 29.67; 797910; 488504; 1912123; 1897640; 30.67; 71.14; 58.86; 62.01; 13252.30; 16471.70; 23150.17 kajiri akebono; 2861; 2565; 32668; 52551; 32.12; 19.43; 1049349; 624008; 2515798; 2457232; 39.36; 80.75; 63.03; 62.15; 8930.87; 12275.14; 16572.68 kamikaze explorer; 2244; 1981; 45828; 76382; 23.82; 13.93; 1091420; 604293; 2668876; 2617771; 37.80; 77.41; 78.98; 77.41; 4645.57; 6801.62; 9647.38 kamimaho; 2159; 1945; 44145; 51492; 20.02; 16.94; 883782; 523540; 2152608; 2117316; 32.85; 78.50; 79.16; 78.33; 4708.75; 6778.87; 9454.85 kanojo no seiiki; 1294; 1056; 8188; 11395; 19.80; 13.92; 162124; 92009; 394844; 388839; 5.71; 83.47; 84.70; 84.99; 2716.56; 3819.56; 5550.18 katahane; 1865; 1659; 46768; 40574; 13.15; 14.30; 614909; 330445; 1481610; 1425979; 20.09; 82.46; 79.30; 78.99; 4996.72; 7162.89; 10044.97 kaziklu; 2068; 1726; 6099; 10068; 34.54; 20.67; 210682; 122656; 484567; 482447; 7.66; 67.93; 74.79; 75.82; 6913.45; 9080.93; 12287.49 kimikoe; 2222; 1981; 44891; 56879; 16.57; 12.70; 743935; 418580; 1819039; 1772716; 26.39; 81.05; 81.37; 81.79; 5405.31; 6544.93; 9604.80 kirakira; 2281; 1986; 35716; 50270; 30.25; 21.12; 1080238; 630810; 2557768; 2519197; 38.90; 74.75; 78.98; 79.97; 4861.66; 7017.94; 9367.37 koichoco; 1991; 1760; 41241; 56740; 18.93; 13.32; 780580; 434221; 1979633; 1881859; 27.31; 76.64; 80.16; 79.81; 5227.15; 7051.51; 10356.30 leyline1+2+3; 2019; 1795; 57821; 76028; 19.90; 14.70; 1150758; 667259; 2777676; 2694759; 41.09; 83.67; 83.81; 84.24; 3442.87; 4973.97; 7925.41 leyline1; 1596; 1323; 17968; 23564; 18.62; 13.73; 334620; 194618; 813931; 791074; 11.93; 86.85; 83.57; 84.17; 3262.52; 4831.89; 7925.84 leyline2; 1748; 1473; 21063; 27396; 20.49; 15.33; 431582; 251488; 1036671; 1009047; 15.44; 83.47; 83.49; 83.95; 3390.65; 4800.23; 7698.31 leyline3; 1661; 1441; 18790; 25796; 20.43; 14.60; 383865; 223425; 926788; 909650; 13.83; 82.01; 83.46; 83.78; 3659.03; 5272.04; 7925.87 magical charming; 2118; 1803; 37239; 55448; 17.75; 11.63; 661122; 365137; 1649810; 1611665; 22.92; 80.49; 81.56; 81.62; 3893.70; 5853.70; 8941.10 majokoi; 1970; 1709; 37288; 46138; 15.83; 11.85; 590196; 320054; 1490266; 1349107; 19.68; 84.50; 86.25; 85.74; 3880.70; 5295.11; 7853.51 mamiyakun-chi; 1945; 1723; 39099; 62619; 24.29; 14.86; 949907; 537997; 2293535; 2266268; 34.24; 77.16; 82.25; 81.14; 3717.34; 5145.82; 7920.88 monobeno; 2417; 2176; 93847; 150141; 21.83; 13.27; 2048550; 1074262; 5015085; 4807585; 69.60; 82.80; 88.01; 85.76; 6894.79; 8362.40; 11954.43 muramasa; 3070; 2793; 80564; 87653; 15.30; 13.75; 1232446; 733011; 3176908; 3019944; 46.79; 75.48; 62.48; 61.97; 10930.16; 14260.65; 19370.55 nanarin; 1851; 1589; 39789; 42928; 17.83; 10.27; 709247; 248506; 1830351; 1120735; 15.83; 79.26; 84.22; 82.80; 3795.90; 5294.42; 8300.07 nanatsuiro; 1543; 1312; 26930; 36064; 17.12; 12.61; 460913; 269083; 1122537; 1122517; 16.50; 83.64; 85.88; 85.92; 2872.12; 4205.96; 7822.93 natsukumo yururu; 2004; 1766; 51421; 60068; 15.03; 12.41; 772622; 440932; 1844431; 1780832; 26.64; 84.90; 83.46; 83.67; 3689.43; 4995.33; 7845.05 nine kokoiro; 1536; 1236; 8802; 12706; 16.55; 11.26; 145707; 82176; 369833; 358303; 5.18; 75.61; 77.73; 77.92; 4776.97; 6644.71; 9184.95 noratoto; 2050; 1783; 41303; 58114; 16.35; 11.27; 675396; 365327; 1692782; 1636726; 22.74; 84.67; 81.10; 83.12; 4222.42; 6082.15; 9473.30 nursery rhyme; 2046; 1779; 32500; 41516; 20.63; 15.78; 670321; 374822; 1616247; 1577109; 23.50; 81.65; 81.60; 81.39; 4165.60; 5881.54; 9126.62 oniikiss fd; 1449; 1176; 22708; 19526; 17.09; 12.53; 388161; 138850; 971198; 597288; 8.56; 84.41; 84.01; 86.50; 3562.62; 4602.26; 6476.52 oniikiss; 1951; 1681; 41966; 50792; 20.69; 12.36; 868147; 356678; 2214340; 1564783; 22.34; 81.36; 86.15; 88.05; 3685.47; 4767.97; 6686.60 oretsuba afterstory; 2131; 1827; 16417; 26109; 25.53; 15.72; 419120; 231391; 995689; 979710; 14.56; 81.45; 79.81; 79.49; 6278.20; 8643.76; 12501.60 oretsuba prelude; 2171; 1798; 8816; 15168; 31.09; 17.69; 274070; 150433; 634811; 625030; 9.41; 79.57; 72.64; 70.66; 9104.52; 12000.90; 16420.60 oretsuba; 2770; 2482; 56675; 89741; 30.23; 17.71; 1713369; 908305; 3978483; 3692838; 56.59; 80.60; 78.17; 77.77; 7919.79; 10490.75; 14988.43 ouka sabaki; 2145; 1914; 33862; 54858; 21.10; 12.31; 714638; 411104; 1801613; 1711326; 25.43; 87.26; 73.84; 72.93; 5106.17; 7664.68; 11386.00 parfait; 2113; 1834; 37003; 49015; 18.64; 11.60; 689863; 327039; 1730006; 1396010; 20.52; 73.68; 80.49; 79.57; 5517.25; 7854.43; 11242.26 prawfclwyd; 2018; 1766; 25602; 34977; 18.99; 13.57; 486264; 270053; 1217811; 1187626; 17.17; 74.35; 81.84; 81.88; 5903.10; 8685.16; 12883.71 princessfrontier; 2342; 2096; 48063; 61194; 16.86; 12.89; 810467; 449604; 1965704; 1927480; 27.99; 81.85; 78.85; 79.21; 7316.10; 10451.29; 15470.05 rabuobu; 2169; 1904; 34143; 53700; 19.47; 11.64; 664852; 356575; 1613985; 1530452; 22.10; 83.09; 79.06; 79.91; 6397.05; 8840.00; 13351.33 rewrite+; 2646; 2409; 97740; 116315; 16.49; 13.55; 1611349; 930361; 3861665; 3742400; 58.14; 78.10; 74.38; 74.66; 7200.14; 9400.41; 12995.39 rinshin; 2210; 1949; 28964; 46057; 26.02; 15.53; 753720; 414396; 1787780; 1707720; 25.88; 78.39; 79.48; 79.02; 6720.52; 8634.04; 12717.26 sansha mendan; 2042; 1841; 34816; 64406; 34.77; 18.37; 1210691; 621255; 2817128; 2785920; 41.26; 77.20; 72.33; 68.66; 5633.58; 7604.30; 10510.46 satsukoi; 1882; 1587; 23111; 23947; 12.80; 11.93; 295846; 169260; 743615; 710642; 10.52; 80.51; 81.35; 81.97; 4824.70; 6270.90; 9182.26 sengoku koihime x; 2915; 2667; 122581; 199749; 22.78; 13.60; 2792693; 1633397; 6883907; 6729611; 102.29; 84.48; 79.44; 79.28; 6662.81; 9851.98; 14236.97 senmomo; 2513; 2235; 48841; 54049; 16.87; 14.91; 824140; 491207; 1981794; 1946095; 31.45; 75.08; 66.37; 64.29; 9148.02; 11920.33; 17997.11 senrenbanka; 2222; 1918; 54585; 79446; 20.03; 13.42; 1093530; 617721; 2672904; 2618031; 38.39; 81.96; 83.88; 84.19; 3498.22; 5063.29; 8400.15 senshinkan bansenjin; 2644; 2376; 26142; 42276; 33.07; 20.27; 864568; 516024; 1994101; 1977766; 32.45; 76.73; 73.84; 74.91; 6281.42; 8564.88; 11892.25 senshinkan hachimyoujin; 2858; 2544; 34771; 56287; 33.51; 20.49; 1165087; 696088; 2740617; 2711958; 43.93; 78.27; 72.21; 73.86; 7133.66; 9310.09; 12741.40 sharnoth fvr; 2124; 1877; 20847; 35054; 24.15; 13.12; 503476; 265581; 1173739; 1066449; 16.44; 73.29; 74.11; 72.15; 6328.26; 8548.38; 12643.62 shin koihime eiyuutan 1; 1857; 1567; 14762; 28742; 26.90; 13.60; 397083; 227951; 968808; 962883; 14.50; 85.26; 83.57; 84.23; 3743.59; 5181.33; 7940.54 shin koihime eiyuutan 2; 1897; 1659; 19520; 37802; 23.20; 11.70; 452822; 264343; 1150691; 1132365; 16.47; 84.86; 82.38; 82.63; 4386.15; 6647.93; 11675.47 shin koihime eiyuutan 3; 1921; 1669; 19418; 32457; 22.21; 12.98; 431246; 246365; 1070164; 1056455; 15.55; 83.91; 83.92; 83.16; 5572.05; 7784.60; 13767.80 shin koihime eiyuutan plus; 1366; 1062; 4608; 7943; 23.20; 13.05; 106899; 59705; 263751; 261187; 3.75; 87.57; 86.38; 87.00; 4485.40; 6826.80; 10365.20 shin koihime musou kakumei 1; 2608; 2363; 76318; 132230; 22.76; 12.74; 1736755; 1002655; 4287602; 4207252; 62.59; 86.00; 83.09; 84.10; 5493.68; 8167.26; 12755.57 shirokuma; 2432; 2127; 48077; 70659; 21.46; 14.01; 1031582; 557907; 2515346; 2452640; 34.61; 80.86; 76.12; 76.33; 8227.87; 11494.83; 16665.10 shugaten; 1763; 1521; 24869; 29261; 15.57; 12.91; 387316; 214006; 965349; 901986; 13.13; 83.74; 78.16; 78.63; 6180.86; 9017.45; 15050.35 silverio vendetta; 2758; 2487; 24342; 39584; 35.67; 21.82; 868301; 510102; 2158325; 2150337; 33.02; 70.10; 65.77; 68.18; 9983.71; 12632.42; 16502.10 simulacre; 1771; 1515; 13577; 19050; 21.27; 15.03; 288819; 178681; 685150; 674597; 10.82; 81.36; 81.90; 79.73; 3641.34; 5165.28; 8078.22 snowwhite; 1546; 1240; 5778; 7959; 30.93; 22.14; 178726; 106545; 417532; 410758; 6.49; 78.65; 82.82; 84.46; 3615.40; 5360.80; 9497.44 soramitsu; 2125; 1925; 46347; 58061; 22.64; 15.36; 1049089; 518230; 2578691; 2185261; 32.49; 79.44; 83.39; 82.96; 4154.61; 5771.29; 8446.15 sourire; 1894; 1637; 30168; 44601; 20.83; 13.77; 628424; 362062; 1555598; 1511058; 22.50; 80.49; 85.47; 84.44; 3154.86; 4678.22; 7748.55 subahibi; 2238; 1996; 58018; 74763; 18.33; 11.77; 1063337; 520905; 2713808; 2237407; 32.17; 78.01; 79.81; 79.81; 4825.66; 6909.74; 10062.64 sukinara; 2069; 1835; 60041; 84942; 20.91; 14.09; 1255586; 682601; 3147409; 3007064; 42.08; 82.34; 83.78; 83.42; 4477.61; 6491.11; 11292.90 summer pockets; 2115; 1849; 62271; 64181; 12.00; 10.68; 747365; 407980; 1918668; 1709050; 24.50; 85.13; 84.47; 86.07; 5061.88; 7091.88; 10342.21 tarareba; 1797; 1553; 20992; 32452; 22.27; 14.25; 467570; 262555; 1119586; 1119535; 16.43; 79.21; 80.32; 80.62; 3887.90; 5951.68; 10452.40 trinoline; 1954; 1692; 27628; 34306; 18.66; 14.67; 515408; 286655; 1259214; 1226295; 18.14; 77.91; 83.80; 82.53; 3439.20; 4965.28; 7728.70 tsujidou-san no jun'ai road; 2269; 2019; 80118; 102793; 14.93; 11.31; 1196359; 651727; 2940726; 2766732; 40.48; 84.30; 75.37; 75.66; 5857.12; 8084.10; 11523.11 tsujidou-san no virgin road; 2064; 1802; 43219; 54886; 15.43; 11.86; 666755; 367278; 1632300; 1545307; 22.70; 83.32; 75.62; 75.63; 5770.07; 8017.06; 11441.75 tsuriotsu; 2390; 2102; 30932; 60869; 34.31; 17.25; 1061406; 636679; 2455467; 2436023; 38.67; 79.87; 80.38; 80.86; 5001.50; 7499.22; 11306.33 tsuushinbo; 1866; 1617; 28505; 43993; 21.66; 13.82; 617432; 343593; 1503324; 1477566; 21.70; 86.13; 87.15; 86.61; 2719.51; 3718.79; 5418.05 twinklecrusaders; 2586; 2313; 77293; 115311; 19.82; 13.10; 1531958; 850300; 3680074; 3678307; 52.76; 80.37; 75.53; 75.07; 6899.02; 9649.79; 14603.22 white_album; 1831; 1481; 29108; 31890; 15.90; 13.32; 462896; 251596; 1123118; 1014554; 15.59; 79.00; 82.58; 81.16; 4479.56; 6961.43; 11242.37 yoakena; 2134; 1902; 57455; 60314; 14.48; 13.37; 831742; 467022; 2074181; 1942943; 29.29; 78.88; 79.52; 79.69; 3952.48; 5659.84; 8638.70 }}} The Hayashi metric is derived from: chars per sentence; commas per periods*; average consecutive length of each of kanji/hiragana/katakana/other * sentence endings imply periods The custom metrics are derived from: {{{#!python runlen_han = counts[0]/runs[0] runlen_hira = counts[1]/runs[1] runlen_kata = counts[2]/runs[2] avg_counts = sum(counts[:3])/3 prop_han = counts[0]/avg_counts prop_hira = counts[1]/avg_counts prop_kata = counts[2]/avg_counts avg_runs = sum(runs[:3])/3 prop_runs_han = runs[0]/avg_runs prop_runs_hira = runs[1]/avg_runs prop_runs_kata = runs[2]/avg_runs norm_han = runlen_han *prop_han norm_hira = runlen_hira*prop_hira norm_kata = runlen_kata*prop_kata sentence_han = counts[0]/sentences sentence_hira = counts[1]/sentences sentence_kata = counts[2]/sentences runs_sentence = sum(runs[:3])/sentences sentencelen = sentencechars/sentences # .... properties_a = [ math.log(prop_han), math.log(prop_hira), math.log(prop_kata), math.log(prop_runs_han), math.log(prop_runs_hira), math.log(prop_runs_kata), norm_han, norm_hira, norm_kata, sentence_han, sentence_hira, sentence_kata, 1/runs_sentence, math.log(sentencelen) ] weights_a = [ -2.6283512 , -0.8434388 , -0.2378658 , 0.37981617 , -0.855799 , 0.0530583 , 1.442638 , -0.05952703 , 0.45643884 , 0.09780279 , 0.0371693 , -0.03599532 , -2.5243423 , -1.1433551 , 1.6064633 ] properties_b = [ runlen_han, runlen_hira, runlen_kata, math.log(prop_han), math.log(prop_hira), math.log(prop_kata), math.log(prop_runs_han), math.log(prop_runs_hira), math.log(prop_runs_kata), ] weights_b = [ 0.62152517 , 0.0021763 , 0.06648773 , -1.611983 , -5.896055 , -0.32356036 , 0.37851688 , 0.63546646 , 0.04297037 , 2.2276359 ] nothayashi_a = weights_a[-1] + sum(properties_a[i]*weights_a[i] for i in range(len(properties_a))) nothayashi_a = (1-nothayashi_a)*50+50 nothayashi_b = weights_b[-1] + sum(properties_b[i]*weights_b[i] for i in range(len(properties_b))) nothayashi_b = (1-nothayashi_b)*50+50 }}} where "counts" stores the number of times a writing system occurs, and "runs" stores the number of runs there are of that writing system. The weights were derived from multiple regression with keras. |
Vivify Health & Chiropractic<<<BR>> ><<<BR>> > 2/590 Hay St,<<<BR>> ><<<BR>> > Subiaco WA 6008<<<BR>> ><<<BR>> > (08) 9381 3150<<<BR>> ><<<BR>> > <<<BR>> ><<<BR>> > my webpage :: [[https://www.healthdirect.gov.au/chiropractors|www.healthdirect.gov.au]] |
Vivify Health & Chiropractic<
><
> 2/590 Hay St,<
><
> Subiaco WA 6008<
><
> (08) 9381 3150<
><
> <
><
> my webpage :: www.healthdirect.gov.au