|
Size: 19362
Comment:
|
Size: 269
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| I just rewrote the stats tools. These are the stats output by the new tools. They differ slightly from the old stats because the rewrite deals with a few edge cases differently. The differences are within a margin of error, or when the difference is big, the old stats tools are probably doing something wrong. If you got linked here for a statistic that isn't here ('''like the Core 6k stats'''), look at the [[Old Stats]] page instead. For now, see the [[Old Stats]] page for more details. If you want to add a script, post it to the [[Requests]] page. See also [[Changes]]. You can get the new analysis tools [[https://mega.nz/#!1cMTEbCY!YyOScinptlw2_oPDk4J4gssUxmDmSg_uR2IH8WyrFgM|here]] (you need [[https://mega.nz/#!RNcDHJzJ!ibbtJGteZpqdTA5QIZt88TnyirOB0Mkl4uktM4hKcsY|this]] too). They're easier to use than the previous ones, but they require python 3.6 or newer, and if you're not on Windows, you need to patch and recompile mecab yourself to fix a bug (instructions included) (you CANNOT use mecab as compiled by your distribution's maintainer). Higher is easier: Hayashi; custom metric Lower is easier: kanji (unique); kanji(2+); chars/line; chars/sentence; freqlistX% Target The "Hayashi" metric are an estimate of structural complexity. The Hayashi metric is inherently flawed and should only be used as a general guideline. The "custom metric" is like "Hayashi", and uses similar data, but it's designed to correlate well with "freqlist92.5% target". This is another estimate of structural complexity, but because it estimates the "freqlist92.5% target" metric, it's arbitrary. The "freqlistX% Target" metrics are an estimate of lexical complexity. High measurements mean that the script uses uncommon words more frequently, or common words less frequently. Commonness is based on every long-enough script combined, not on general purpose frequency lists or the frequency list of the single script in question. The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It doesn't take any real complexity differences into account and it's '''based on VNDB's inaccurate length categories''', take it with a '''huge grain of salt'''; also, '''it assumes a ~475 characters/minute reading speed''', not like 300 or 200. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. Example of calibrating with only character count as a source variable: https://i.imgur.com/tqTGVlB.png You can compare the Hayashi, custom metric a, custom metric b, and freqlist 92.5% target stats with [[http://wareya.moe/extra/statsgraph.html|this interactive graph]]. {{{#!nutable script name; kanji\n(unique); kanji\n(2+); lines; sentences; chars\n/line; chars\n/sentence; characters; lexemes; sjis bytes; sjis (dedup); hours estimate; Hayashi; custom\nmetric a; custom\nmetric b; freqlist\n90% Target; freqlist\n92.5% Target; freqlist\n95% Target aete mushisuru; 1987; 1723; 36629; 41691; 13.83; 11.68; 506616; 285261; 1287119; 1238044; 17.74; 80.76; 78.63; 79.18; 5541.70; 7909.32; 12031.95 amakoi; 2028; 1752; 28355; 54610; 27.53; 14.01; 780536; 442818; 1903429; 1889972; 27.61; 84.90; 87.25; 88.24; 3528.09; 5230.80; 8207.10 ao no kanata; 2129; 1846; 44234; 57107; 20.20; 15.24; 893350; 504764; 2125556; 2065379; 31.46; 79.14; 79.67; 79.20; 4076.80; 5567.42; 8330.67 astelight shuushuubako; 2982; 2595; 9461; 14515; 51.53; 33.45; 487535; 291731; 1166666; 1157863; 18.65; 62.44; 50.24; 63.23; 13843.83; 17876.80; 23147.07 axanael; 1861; 1585; 34375; 42538; 12.17; 9.18; 418504; 207002; 1139513; 1053681; 12.86; 81.09; 73.93; 73.15; 6532.20; 8502.60; 13039.40 biman1; 1750; 1394; 7641; 12526; 23.79; 14.05; 181779; 98089; 448539; 439945; 6.27; 78.72; 78.27; 79.37; 7351.27; 11016.66; 19136.69 chronobox trials; 1265; 914; 3160; 5460; 19.99; 11.29; 63177; 35006; 160474; 157777; 2.24; 81.82; 81.44; 81.32; 4493.25; 6631.31; 8851.19 chronobox; 1985; 1737; 23036; 41201; 21.60; 11.78; 497566; 274526; 1261732; 1236591; 17.54; 79.04; 80.49; 80.26; 5688.42; 8104.91; 11359.52 clacra; 2215; 1954; 41776; 59682; 19.64; 13.31; 820658; 447978; 2038082; 1975933; 28.51; 77.45; 79.89; 79.77; 4360.24; 5916.34; 8531.17 cloverpoint; 2258; 1995; 42677; 60322; 20.19; 13.68; 861662; 472360; 2146495; 2073383; 29.68; 78.74; 79.62; 79.55; 5840.95; 8327.82; 11979.99 daitoshokan fandisk; 2035; 1760; 28827; 34367; 16.22; 13.33; 467657; 267247; 1134885; 1113236; 16.96; 77.88; 78.53; 78.58; 5288.83; 7697.25; 12086.11 daitoshokan; 2312; 2055; 68258; 76633; 16.00; 13.86; 1092295; 625870; 2647706; 2562769; 39.49; 77.45; 78.12; 77.92; 4934.48; 7006.18; 11093.32 dies irae; 2790; 2554; 58314; 88559; 28.76; 18.16; 1677110; 952246; 4005512; 3830009; 60.02; 69.97; 75.10; 74.65; 7104.40; 9418.83; 13124.90 dracuriot; 2218; 1944; 51751; 84258; 23.36; 13.65; 1208987; 660083; 2956248; 2832280; 40.95; 80.31; 80.42; 80.84; 4025.53; 5561.44; 8337.36 eustia; 2454; 2210; 64697; 69324; 15.16; 13.65; 980871; 564560; 2397710; 2292286; 34.92; 78.84; 79.83; 80.19; 6610.72; 9873.39; 14385.51 fate stay night; 2556; 2320; 75159; 90847; 23.04; 17.88; 1731549; 965201; 4260695; 3870323; 59.09; 71.48; 75.96; 74.58; 6952.51; 8997.05; 14100.35 flowers1+2+3; 2412; 2178; 35460; 49370; 24.17; 17.34; 856990; 519241; 1979933; 1949229; 32.04; 72.20; 71.72; 70.19; 7416.38; 10262.00; 15155.94 flowers1; 1979; 1690; 13289; 18873; 23.85; 16.78; 316955; 191587; 737313; 726823; 11.81; 73.94; 75.47; 73.90; 5685.78; 8382.00; 12693.57 flowers2; 2032; 1731; 10695; 14634; 24.14; 17.65; 258169; 155373; 595039; 587710; 9.67; 70.74; 69.27; 67.97; 8496.30; 12226.23; 17053.56 flowers3; 2084; 1808; 11476; 16109; 24.56; 17.52; 281866; 172781; 647581; 639731; 10.59; 71.72; 69.60; 67.69; 7813.65; 10707.07; 15666.80 flyable heart; 1849; 1626; 44569; 56254; 18.36; 13.93; 818168; 458851; 1963723; 1872189; 28.58; 83.65; 86.06; 85.82; 2588.54; 3714.02; 5668.31 fortissimoexs; 2306; 2107; 45040; 66427; 27.76; 18.61; 1250088; 719523; 3151153; 3045669; 45.47; 71.79; 77.73; 76.74; 4978.80; 6779.78; 9444.35 fortunearterial; 2186; 1942; 65296; 66515; 13.52; 12.80; 882508; 503887; 2153109; 2036302; 31.55; 80.40; 81.50; 81.35; 4615.43; 6550.14; 8690.00 fureraba; 2083; 1853; 50051; 66377; 20.05; 14.57; 1003649; 556765; 2425789; 2352972; 34.79; 80.29; 78.55; 78.69; 3871.65; 5618.56; 8675.75 futsuu no fantasy; 2018; 1777; 39163; 48822; 19.05; 14.74; 745922; 422486; 1778854; 1719851; 26.29; 78.63; 81.48; 81.90; 5093.07; 6555.04; 8798.42 gensou no idea; 2481; 2225; 32461; 47681; 25.32; 17.16; 821785; 475016; 1958269; 1929489; 29.69; 78.89; 79.14; 78.06; 6586.57; 8851.71; 11702.65 grisaia; 2611; 2364; 62748; 96326; 27.18; 16.69; 1705580; 967235; 3971468; 3767371; 58.75; 77.79; 78.23; 77.87; 5047.73; 7139.40; 10807.04 hanachirasu; 2149; 1742; 5877; 7823; 23.91; 17.90; 140515; 87663; 349599; 345074; 5.50; 72.57; 59.90; 58.25; 10553.52; 14065.49; 19712.65 hanahira; 947; 654; 3571; 4263; 13.40; 10.88; 47866; 25278; 124311; 120902; 1.61; 87.59; 83.47; 84.41; 4043.80; 5844.62; 9641.90 hatsukoi yohou; 1834; 1586; 30370; 48340; 20.26; 12.39; 615425; 351700; 1523937; 1483369; 21.96; 81.41; 82.59; 83.20; 3217.88; 4338.08; 5933.80 henkoi; 1897; 1602; 21719; 48348; 25.13; 11.00; 545804; 294522; 1373860; 1361135; 18.42; 80.41; 75.64; 75.78; 5355.78; 8179.17; 13428.38 hoshimemo; 2080; 1864; 54205; 60836; 16.99; 14.68; 921017; 537002; 2073147; 1997427; 32.91; 82.82; 82.02; 81.90; 6350.20; 8981.39; 11145.98 iinchou shounin; 2051; 1789; 32743; 57165; 18.25; 10.10; 597436; 329258; 1508808; 1481290; 20.45; 81.00; 78.78; 79.84; 4747.55; 7171.88; 11206.10 imakoi; 1446; 1157; 5991; 9542; 24.60; 15.16; 147388; 81016; 342955; 341436; 5.10; 82.87; 77.66; 77.54; 3776.20; 4628.15; 6612.52 inganock; 2065; 1816; 17648; 32300; 23.39; 11.92; 412809; 228753; 968180; 896988; 14.13; 76.22; 71.62; 70.14; 8642.80; 11429.83; 15904.70 itsusora; 2465; 2182; 30247; 36196; 19.68; 16.10; 595181; 355594; 1433403; 1386755; 21.77; 82.58; 80.12; 77.93; 5736.38; 7820.06; 11192.94 jingai makyou; 2495; 2208; 35361; 53182; 23.75; 13.92; 839691; 451756; 2055351; 1804776; 28.07; 74.33; 79.91; 78.26; 6611.80; 9057.73; 13538.36 kagerou; 2938; 2598; 21148; 27024; 37.73; 29.67; 797910; 488504; 1912123; 1897640; 30.67; 71.14; 58.17; 62.25; 13191.92; 16752.53; 22149.31 kajiri akebono; 2861; 2565; 32668; 52551; 32.12; 19.43; 1049349; 624008; 2515798; 2457232; 39.36; 80.75; 61.91; 60.65; 8906.29; 12103.16; 16358.04 kamikaze explorer; 2244; 1981; 45828; 76382; 23.82; 13.93; 1091420; 604293; 2668876; 2617771; 37.80; 77.41; 78.46; 77.12; 4672.13; 6834.55; 9942.38 kamimaho; 2159; 1945; 44145; 51492; 20.02; 16.94; 883782; 523540; 2152608; 2117316; 32.85; 78.50; 79.65; 78.94; 4712.74; 6824.14; 9277.28 kanojo no seiiki; 1294; 1056; 8188; 11395; 19.80; 13.92; 162124; 92009; 394844; 388839; 5.71; 83.47; 85.45; 85.76; 2740.31; 3767.90; 5465.47 katahane; 1865; 1659; 46768; 40574; 13.15; 14.30; 614909; 330445; 1481610; 1425979; 20.09; 82.46; 79.38; 79.12; 4973.45; 7158.86; 9720.50 kaziklu; 2068; 1726; 6099; 10068; 34.54; 20.67; 210682; 122656; 484567; 482447; 7.66; 67.93; 74.49; 75.47; 6878.90; 9066.66; 12242.97 kimikoe; 2222; 1981; 44891; 56879; 16.57; 12.70; 743935; 418580; 1819039; 1772716; 26.39; 81.05; 81.34; 81.82; 5406.15; 6678.88; 9537.60 kirakira; 2281; 1986; 35716; 50270; 30.25; 21.12; 1080238; 630810; 2557768; 2519197; 38.90; 74.75; 78.73; 80.45; 4845.36; 6991.68; 9323.66 koichoco; 1991; 1760; 41241; 56740; 18.93; 13.32; 780580; 434221; 1979633; 1881859; 27.31; 76.64; 79.72; 79.60; 5216.90; 7093.15; 10367.72 leyline1+2+3; 2019; 1795; 57821; 76028; 19.90; 14.70; 1150758; 667259; 2777676; 2694759; 41.09; 83.67; 83.97; 84.42; 3397.55; 4999.24; 7854.55 leyline1; 1596; 1323; 17968; 23564; 18.62; 13.73; 334620; 194618; 813931; 791074; 11.93; 86.85; 83.52; 83.77; 3311.38; 4797.03; 7854.41 leyline2; 1748; 1473; 21063; 27396; 20.49; 15.33; 431582; 251488; 1036671; 1009047; 15.44; 83.47; 83.68; 84.24; 3322.30; 4789.04; 7776.15 leyline3; 1661; 1441; 18790; 25796; 20.43; 14.60; 383865; 223425; 926788; 909650; 13.83; 82.01; 83.56; 83.98; 3653.30; 5328.08; 8075.14 magical charming; 2118; 1803; 37239; 55448; 17.75; 11.63; 661122; 365137; 1649810; 1611665; 22.92; 80.49; 81.88; 81.78; 3866.93; 5833.03; 8907.40 majokoi; 1970; 1709; 37288; 46138; 15.83; 11.85; 590196; 320054; 1490266; 1349107; 19.68; 84.50; 87.20; 86.45; 3794.16; 5308.89; 7860.22 mamiyakun-chi; 1945; 1723; 39099; 62619; 24.29; 14.86; 949907; 537997; 2293535; 2266268; 34.24; 77.16; 82.17; 81.35; 3678.37; 5096.99; 7877.85 monobeno; 2417; 2176; 93847; 150141; 21.83; 13.27; 2048550; 1074262; 5015085; 4807585; 69.60; 82.80; 88.81; 86.28; 6880.23; 8349.83; 11961.41 muramasa; 3070; 2793; 80564; 87653; 15.30; 13.75; 1232446; 733011; 3176908; 3019944; 46.79; 75.48; 61.85; 60.95; 10812.28; 14292.31; 19298.60 nanarin; 1851; 1589; 39789; 42928; 17.83; 10.27; 709247; 248506; 1830351; 1120735; 15.83; 79.26; 84.39; 82.85; 3807.73; 5502.05; 8310.86 nanatsuiro; 1543; 1312; 26930; 36064; 17.12; 12.61; 460913; 269083; 1122537; 1122517; 16.50; 83.64; 86.43; 86.44; 2771.51; 4198.34; 7953.80 nine kokoiro; 1536; 1236; 8802; 12706; 16.55; 11.26; 145707; 82176; 369833; 358303; 5.18; 75.61; 77.19; 77.37; 4783.30; 6580.11; 9447.46 noratoto; 2050; 1783; 41303; 58114; 16.35; 11.27; 675396; 365327; 1692782; 1636726; 22.74; 84.67; 81.84; 83.46; 4210.90; 6046.12; 9479.70 nursery rhyme; 2046; 1779; 32500; 41516; 20.63; 15.78; 670321; 374822; 1616247; 1577109; 23.50; 81.65; 81.75; 81.86; 4155.40; 5876.85; 9014.70 oniikiss fd; 1449; 1176; 22708; 19526; 17.09; 12.53; 388161; 138850; 971198; 597288; 8.56; 84.41; 84.67; 86.92; 3553.52; 4596.83; 6423.64 oniikiss; 1951; 1681; 41966; 50792; 20.69; 12.36; 868147; 356678; 2214340; 1564783; 22.34; 81.36; 86.35; 88.37; 3682.53; 4772.95; 6654.20 oretsuba afterstory; 2131; 1827; 16417; 26109; 25.53; 15.72; 419120; 231391; 995689; 979710; 14.56; 81.45; 79.61; 79.59; 6250.60; 8688.65; 12389.20 oretsuba prelude; 2171; 1798; 8816; 15168; 31.09; 17.69; 274070; 150433; 634811; 625030; 9.41; 79.57; 71.92; 70.42; 9109.20; 12133.81; 16530.30 oretsuba; 2770; 2482; 56675; 89741; 30.23; 17.71; 1713369; 908305; 3978483; 3692838; 56.59; 80.60; 77.87; 77.92; 7931.34; 10537.80; 14959.85 parfait; 2113; 1834; 37003; 49015; 18.64; 11.60; 689863; 327039; 1730006; 1396010; 20.52; 73.68; 80.00; 79.12; 5481.08; 7823.12; 10696.66 prawfclwyd; 2018; 1766; 25602; 34977; 18.99; 13.57; 486264; 270053; 1217811; 1187626; 17.17; 74.35; 81.02; 81.70; 5952.19; 8629.89; 13154.91 princessfrontier; 2342; 2096; 48063; 61194; 16.86; 12.89; 810467; 449604; 1965704; 1927480; 27.99; 81.85; 78.78; 79.22; 7213.10; 10478.61; 15353.76 rabuobu; 2169; 1904; 34143; 53700; 19.47; 11.64; 664852; 356575; 1613985; 1530452; 22.10; 83.09; 79.47; 80.13; 6408.46; 8875.00; 13500.00 rinshin; 2210; 1949; 28964; 46057; 26.02; 15.53; 753720; 414396; 1787780; 1707720; 25.88; 78.39; 79.03; 78.95; 6847.02; 8662.52; 12694.05 sansha mendan; 2042; 1841; 34816; 64406; 34.77; 18.37; 1210691; 621255; 2817128; 2785920; 41.26; 77.20; 71.42; 68.16; 5597.87; 7556.90; 10385.60 satsukoi; 1882; 1587; 23111; 23947; 12.80; 11.93; 295846; 169260; 743615; 710642; 10.52; 80.51; 81.48; 82.16; 4842.92; 6247.97; 9130.67 sengoku koihime x; 2915; 2667; 122581; 199749; 22.78; 13.60; 2792693; 1633397; 6883907; 6729611; 102.29; 84.48; 79.19; 78.88; 6630.47; 9805.46; 13989.15 senmomo; 2513; 2235; 48841; 54049; 16.87; 14.91; 824140; 491207; 1981794; 1946095; 31.45; 75.08; 65.62; 63.70; 8970.55; 11767.42; 17195.37 senrenbanka; 2222; 1918; 54585; 79446; 20.03; 13.42; 1093530; 617721; 2672904; 2618031; 38.39; 81.96; 84.18; 84.56; 3494.55; 5083.19; 8272.57 senshinkan bansenjin; 2644; 2376; 26142; 42276; 33.07; 20.27; 864568; 516024; 1994101; 1977766; 32.45; 76.73; 73.87; 75.14; 6270.58; 8362.88; 11812.10 senshinkan hachimyoujin; 2858; 2544; 34771; 56287; 33.51; 20.49; 1165087; 696088; 2740617; 2711958; 43.93; 78.27; 72.25; 73.95; 7085.51; 9339.87; 12619.70 sharnoth fvr; 2124; 1877; 20847; 35054; 24.15; 13.12; 503476; 265581; 1173739; 1066449; 16.44; 73.29; 73.57; 71.34; 6337.59; 8640.34; 12867.42 shin koihime musou kakumei 1; 2608; 2363; 76318; 132230; 22.76; 12.74; 1736755; 1002655; 4287602; 4207252; 62.59; 86.00; 83.07; 83.70; 5472.59; 8007.87; 12418.33 shirokuma; 2432; 2127; 48077; 70659; 21.46; 14.01; 1031582; 557907; 2515346; 2452640; 34.61; 80.86; 75.61; 76.16; 8777.70; 11479.83; 16993.03 shugaten; 1763; 1521; 24869; 29261; 15.57; 12.91; 387316; 214006; 965349; 901986; 13.13; 83.74; 78.59; 78.99; 6170.80; 8985.45; 15010.15 silverio vendetta; 2758; 2487; 24342; 39584; 35.67; 21.82; 868301; 510102; 2158325; 2150337; 33.02; 70.10; 65.80; 67.46; 9926.80; 12529.49; 16464.95 simulacre; 1771; 1515; 13577; 19050; 21.27; 15.03; 288819; 178681; 685150; 674597; 10.82; 81.36; 82.51; 80.52; 3624.70; 5071.80; 7745.54 snowwhite; 1546; 1240; 5778; 7959; 30.93; 22.14; 178726; 106545; 417532; 410758; 6.49; 78.65; 83.30; 85.44; 3604.40; 5376.80; 9476.20 soramitsu; 2125; 1925; 46347; 58061; 22.64; 15.36; 1049089; 518230; 2578691; 2185261; 32.49; 79.44; 83.53; 83.34; 4164.27; 5726.87; 8516.71 sourire; 1894; 1637; 30168; 44601; 20.83; 13.77; 628424; 362062; 1555598; 1511058; 22.50; 80.49; 85.87; 85.02; 3136.88; 4685.66; 7710.32 subahibi; 2238; 1996; 58018; 74763; 18.33; 11.77; 1063337; 520905; 2713808; 2237407; 32.17; 78.01; 79.87; 79.81; 4914.62; 6991.37; 10401.90 sukinara; 2069; 1835; 60041; 84942; 20.91; 14.09; 1255586; 682601; 3147409; 3007064; 42.08; 82.34; 84.21; 83.93; 4472.67; 6542.33; 11190.09 tarareba; 1797; 1553; 20992; 32452; 22.27; 14.25; 467570; 262555; 1119586; 1119535; 16.43; 79.21; 80.12; 80.69; 3901.63; 5928.82; 10600.45 trinoline; 1954; 1692; 27628; 34306; 18.66; 14.67; 515408; 286655; 1259214; 1226295; 18.14; 77.91; 84.17; 82.92; 3438.68; 4970.64; 7740.77 tsujidou-san no jun'ai road; 2269; 2019; 80118; 102793; 14.93; 11.31; 1196359; 651727; 2940726; 2766732; 40.48; 84.30; 75.83; 75.80; 5894.16; 8101.06; 11726.09 tsujidou-san no virgin road; 2064; 1802; 43219; 54886; 15.43; 11.86; 666755; 367278; 1632300; 1545307; 22.70; 83.32; 75.91; 75.72; 5715.50; 8029.27; 11798.46 tsuriotsu; 2390; 2102; 30932; 60869; 34.31; 17.25; 1061406; 636679; 2455467; 2436023; 38.67; 79.87; 80.83; 81.47; 4937.62; 7512.98; 11264.25 tsuushinbo; 1866; 1617; 28505; 43993; 21.66; 13.82; 617432; 343593; 1503324; 1477566; 21.70; 86.13; 87.72; 87.07; 2707.59; 3714.72; 5433.05 twinklecrusaders; 2586; 2313; 77293; 115311; 19.82; 13.10; 1531958; 850300; 3680074; 3678307; 52.76; 80.37; 75.27; 74.89; 6905.86; 9637.97; 14859.55 white_album; 1831; 1481; 29108; 31890; 15.90; 13.32; 462896; 251596; 1123118; 1014554; 15.59; 79.00; 83.17; 81.63; 4492.93; 7023.85; 10696.53 yoakena; 2134; 1902; 57455; 60314; 14.48; 13.37; 831742; 467022; 2074181; 1942943; 29.29; 78.88; 79.41; 79.77; 3959.49; 5642.02; 8616.78 }}} The Hayashi metric is derived from: chars per sentence; commas per periods*; average consecutive length of each of kanji/hiragana/katakana/other * sentence endings imply periods The custom metrics are derived from: {{{#!python runlen_han = counts[0]/runs[0] runlen_hira = counts[1]/runs[1] runlen_kata = counts[2]/runs[2] avg_counts = sum(counts[:3])/3 prop_han = counts[0]/avg_counts prop_hira = counts[1]/avg_counts prop_kata = counts[2]/avg_counts avg_runs = sum(runs[:3])/3 prop_runs_han = runs[0]/avg_runs prop_runs_hira = runs[1]/avg_runs prop_runs_kata = runs[2]/avg_runs norm_han = runlen_han *prop_han norm_hira = runlen_hira*prop_hira norm_kata = runlen_kata*prop_kata sentence_han = counts[0]/sentences sentence_hira = counts[1]/sentences sentence_kata = counts[2]/sentences runs_sentence = sum(runs[:3])/sentences sentencelen = sentencechars/sentences # .... properties_a = [ math.log(prop_han), math.log(prop_hira), math.log(prop_kata), math.log(prop_runs_han), math.log(prop_runs_hira), math.log(prop_runs_kata), norm_han, norm_hira, norm_kata, sentence_han, sentence_hira, sentence_kata, 1/runs_sentence, math.log(sentencelen) ] weights_a = [ -2.4737978 , -0.9108987 , -0.29345325, 0.35696763, -0.41694015, 0.09123166, 1.5103536 , -0.0548119 , 0.550222 , 0.08351804, 0.05163162, -0.02453031, -2.9735322 , -1.3019414 , 1.7038546 ] properties_b = [ runlen_han, runlen_hira, runlen_kata, math.log(prop_han), math.log(prop_hira), math.log(prop_kata), math.log(prop_runs_han), math.log(prop_runs_hira), math.log(prop_runs_kata), ] weights_b = [ 0.83993196, -0.15065329, 0.13919145, -2.0429616 , -6.264391 , -0.5884924 , 0.93357515, 0.8694178 , 0.30005294, 2.1083217 ] nothayashi_a = weights_a[-1] + sum(properties_a[i]*weights_a[i] for i in range(len(properties_a))) nothayashi_a = (1-nothayashi_a)*50+50 nothayashi_b = weights_b[-1] + sum(properties_b[i]*weights_b[i] for i in range(len(properties_b))) nothayashi_b = (1-nothayashi_b)*50+50 }}} where "counts" stores the number of times a writing system occurs, and "runs" stores the number of runs there are of that writing system. The weights were derived from multiple regression with keras. |
Vivify Health & Chiropractic<<<BR>> ><<<BR>> > 2/590 Hay St,<<<BR>> ><<<BR>> > Subiaco WA 6008<<<BR>> ><<<BR>> > (08) 9381 3150<<<BR>> ><<<BR>> > <<<BR>> ><<<BR>> > my webpage :: [[https://www.healthdirect.gov.au/chiropractors|www.healthdirect.gov.au]] |
Vivify Health & Chiropractic<
><
> 2/590 Hay St,<
><
> Subiaco WA 6008<
><
> (08) 9381 3150<
><
> <
><
> my webpage :: www.healthdirect.gov.au