Diff for "Stats" - VN Stats

Differences between revisions 80 and 81

Click on Old Stats if you want to see the old stats, like the Core 6k or Hayashi stats.

TODO: Fix scripts with broken linewraps (affects sentence count, line count, and metrics a/d).

All stats work on deduplicated copies of the script.

If you want to add a script, post it to the Requests page.

See also Changes.

You can get the new analysis tools here. I hope you know how to use rust!

Higher is easier: metric a/b/c/d

Lower is easier: everything else

The "freqlistX% Target" metrics are an estimate of lexical complexity. High measurements mean that the script uses uncommon words more frequently, or common words less frequently. Commonness is based on every long-enough script combined, not on general purpose frequency lists or the frequency list of the single script in question. However, the most common uncovered 20 words in the script are ignored, because they're probably names or setting jargon, or even parsing errors. This entire process ignores grammatical words, proper nouns, and numbers.

The "metric a/b/c/d" lines are derived from linear regression targeting the "freqlist 92.5% Target" metric. An exact description of the processing for these metrics is here. The math is reverse polish notation.

The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It assumes a reading speed of 475 characters per minute, in general. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. It is completely useless for VNs with nontrivial amounts of gameplay, or where rereading is expected, or where you're expected to miss a lot of content, or where you're only meant to read one or two out of several routes. Example of calibrating with only character count as a source variable: https://i.imgur.com/tqTGVlB.png

Frequency lists, raw stats database: https://github.com/wareya/jpstats/tree/master/workspace

There is a graph at the bottom of the page.

The character counting stats here ignore some punctuation characters. This is because some script ripping methods strip some types of punctuation, such as quotes around lines of dialogue. For example, without this adjustment, hoshimemo would look smaller compared to other VNs than it actually is. If I ever have a chance to revisit old dumps and make sure they all handle punctuation consistently, I will "fix" this, because it's a source of confusion when comparing to the old tlwiki stats. It also does not count newlines, but this won't ever change.

name	link	kanji (unique)	kanji (2+)	chars	lexemes	sentences	lines	chars /line	chars /sentence	hours estimate	sjis bytes	freqlist 90% Target	freqlist 92.5% Target	freqlist 95% Target	metric a	metric b	metric c	metric d
aete mushisuru	vndb	1987	1723	535637	285571	41916	35166	15.23	11.49	17.75	1186788	3777.40	5258.01	7610.57	82.34	80.82	81.11	82.23
amakoi	vndb	2028	1752	865094	442826	54686	28028	30.87	13.96	27.61	1863787	2581.85	3586.60	5489.47	90.90	91.78	90.61	89.37
ao no kanata	vndb	2129	1846	940519	505670	56968	42554	22.10	15.15	31.46	2039182	3285.70	4610.83	6743.76	81.37	80.65	81.08	81.03
astelight shuushuubako	vndb	2982	2595	515830	293340	14344	9535	54.10	33.55	18.65	1062193	11659.72	14762.33	19814.14	48.46	66.72	63.82	59.51
axanael	vndb	1861	1585	452892	208590	43090	31457	14.40	8.66	12.86	1018620	4513.05	6155.44	9025.55	77.62	75.34	75.04	76.61
biman1	vndb	1750	1394	204695	98201	12451	7630	26.83	14.05	6.27	435951	4259.60	5672.43	7989.30	82.63	82.33	82.69	82.50
buraban	vndb	1800	1570	857148	437600	59511	39213	21.86	12.38	27.10	1843652	1930.16	2685.99	4154.82	85.25	85.52	86.05	86.40
chronobox	vndb	1985	1737	558728	275580	41199	22341	25.01	11.60	17.54	1215132	4021.21	5445.72	7951.80	82.62	82.86	83.23	83.19
chronobox trials	vndb	1265	914	70097	35103	5448	3102	22.60	11.14	2.24	153851	3187.80	4293.45	6507.90	82.76	84.04	84.08	84.39
clacra	vndb	2215	1954	913337	448038	58006	40785	22.39	13.48	28.51	1966623	3950.49	5503.48	7803.15	83.38	82.68	83.22	83.32
cloverpoint	vndb	2258	1995	930226	474200	60632	40705	22.85	13.47	29.68	2000171	4714.49	6393.75	9341.15	82.39	81.74	82.21	81.95
daitoshokan	vndb	2312	2055	1150641	627059	76469	65781	17.49	13.81	39.49	2517383	3868.15	5334.45	7652.41	80.59	79.67	79.70	80.02
daitoshokan fandisk	vndb	2035	1760	498115	267957	34261	28268	17.62	13.31	16.96	1090969	3849.46	5159.49	7403.82	81.51	80.71	80.93	81.18
dies irae	vndb	2790	2551	1713635	951741	89885	54695	31.33	17.69	59.89	3623949	6574.46	8689.31	11821.70	76.67	76.36	76.19	76.10
dracuriot	vndb	2218	1944	1289692	663550	84384	49856	25.87	13.54	40.95	2788115	3043.32	4249.33	6413.15	83.07	82.65	82.80	82.02
eustia	vndb	2454	2210	1020293	565396	69146	61214	16.67	13.65	34.92	2233829	4266.90	6050.11	8773.62	83.55	82.46	83.17	83.48
fate stay night	vndb	2556	2320	1730055	958825	93064	67643	25.58	17.06	59.12	3670684	4730.39	6450.85	8864.22	76.51	77.12	77.68	77.05
flowers1	vndb	1979	1690	336967	191620	18334	12505	26.95	16.99	11.82	715696	4035.10	5666.21	8213.74	76.35	75.58	75.29	75.58
flowers1+2+3	x	2412	2178	902724	519146	48779	33604	26.86	17.26	32.04	1918212	5138.83	7045.19	9870.61	73.02	72.96	72.46	72.67
flowers2	vndb	2032	1731	271482	155134	14646	10300	26.36	17.34	9.66	577012	5506.95	7395.54	10538.35	71.17	71.47	70.81	70.99
flowers3	vndb	2084	1808	295577	172879	16034	11020	26.82	17.30	10.59	628936	5409.60	7225.76	10205.10	70.87	71.21	70.73	70.90
flyable heart	vndb	1849	1626	854635	460113	56446	42919	19.91	13.81	28.58	1856734	2118.32	2936.39	4518.75	87.36	87.40	87.37	87.51
fortissimoexs	vndb	2306	2107	1362699	719469	68827	42717	31.90	17.43	45.47	2898110	3940.85	5350.83	7461.34	79.10	79.48	79.17	77.38
fortunearterial	vndb	2186	1942	914471	505495	66355	62552	14.62	12.79	31.55	2020723	3557.63	4900.42	7187.77	83.29	82.82	83.08	83.89
fureraba	vndb	2083	1853	1071190	557185	65668	49041	21.84	14.63	34.79	2326559	3289.97	4635.83	7038.88	81.01	80.41	80.89	80.64
futsuu no fantasy	vndb	2018	1777	782846	422455	48851	36967	21.18	14.67	26.28	1685892	3582.82	4832.40	6933.22	84.66	84.16	84.62	84.32
gensou no idea	vndb	2481	2225	869906	476863	48809	31707	27.44	16.27	29.69	1860870	5572.23	7472.71	10134.97	78.83	78.23	77.86	77.95
grisaia	vndb	2611	2364	1745874	967480	95866	58976	29.60	16.58	58.75	3722925	4474.91	6263.88	9334.38	79.24	79.44	79.86	79.13
hanachirasu	vndb	2149	1742	147576	88041	7848	5840	25.27	17.66	5.50	313174	8993.80	11711.35	16206.98	61.25	60.20	57.71	58.54
hanahira	vndb	947	654	52047	25363	4264	3487	14.93	10.77	1.61	118834	2841.60	3964.80	6062.90	84.55	86.26	83.83	83.80
harumade kururu	vndb	1908	1659	615399	329066	41978	24170	25.46	13.24	20.04	1331974	2808.17	3965.41	6216.15	86.78	87.04	86.55	86.82
hatsukoi yohou	vndb	1834	1586	680448	352632	47730	28876	23.56	12.46	21.96	1462836	2214.24	3113.53	4764.58	85.23	85.10	85.20	85.48
hatsuyuki sakura	vndb	1980	1705	586154	314103	47091	34890	16.80	11.29	19.17	1321507	3962.50	5449.56	8171.53	85.33	86.43	86.23	87.61
henkoi	vndb	1897	1602	624716	296027	46944	21506	29.05	11.19	18.42	1341639	2957.33	4273.25	6294.44	78.77	77.08	77.68	77.28
hoshimemo	vndb	2080	1864	960610	538675	60811	53037	18.11	14.64	32.92	1967904	4045.13	5522.70	7853.08	82.40	81.40	81.39	82.40
iinchou shounin	vndb	2051	1789	664500	330257	57137	31613	21.02	9.97	20.45	1452024	3169.00	4459.35	6646.50	82.79	82.19	82.58	83.35
imakoi	vndb	1446	1157	158324	81099	9229	5826	27.18	15.52	5.10	335623	2984.67	3913.39	5467.37	78.18	78.58	79.12	78.79
inganock	vndb	2065	1816	411434	229312	32103	16295	25.25	11.60	14.13	882985	5126.33	6996.54	9678.50	76.16	73.04	72.54	74.63
itsusora	vndb	2465	2182	623109	356470	35948	29092	21.42	15.86	21.78	1329820	4958.60	6830.42	9823.12	80.71	79.35	80.24	80.40
jingai makyou	vndb	2495	2207	791758	450310	52865	30595	25.88	13.86	27.93	1742586	5250.83	7065.93	9910.80	81.91	80.15	80.98	81.87
kagerou	vndb	2938	2598	854180	489011	26550	19906	42.91	29.79	30.67	1761494	8421.57	11241.18	15728.37	66.03	63.30	66.76	63.99
kajiri 18	vndb	2798	2488	895829	512648	45515	27063	33.10	18.29	32.35	1899540	7576.08	9989.89	13638.11	66.43	65.51	66.67	66.68
kajiri akebono	vndb	2861	2565	1083276	624653	53302	31694	34.18	19.00	39.37	2293097	7430.85	9782.34	13485.02	66.40	65.31	66.41	66.29
kamikaze explorer	vndb	2244	1981	1194658	604325	76446	44103	27.09	13.72	37.80	2571862	3489.05	4768.44	7064.32	80.45	79.72	80.63	80.04
kamimaho	vndb	2159	1945	940485	524213	52471	42813	21.97	16.53	32.85	2014648	3417.20	4606.41	6753.12	80.67	78.88	79.22	79.68
kanojo no seiiki	vndb	1294	1056	176214	92009	11349	7970	22.11	13.92	5.71	381072	2358.43	3248.18	4782.71	86.96	86.82	86.39	86.71
katahane	vndb	1865	1659	643411	332630	40062	28103	22.89	14.19	20.09	1385255	3420.90	4834.84	7216.18	80.80	80.70	80.73	79.85
kaziklu	vndb	2068	1726	219863	122771	10189	6061	36.28	20.33	7.66	462813	6247.33	8232.95	11101.50	76.41	78.15	78.35	77.72
kikaijikake no eve	vndb	2566	2361	1682391	898559	85737	43525	38.65	17.68	56.49	3541220	6357.62	8337.87	11303.81	67.82	70.35	70.94	69.73
kimikoe	vndb	2222	1981	797849	420545	57012	43427	18.37	12.55	26.39	1739034	4145.10	5667.10	8403.18	84.17	83.64	83.77	84.02
kirakira	vndb	2281	1986	1129923	631370	50511	34586	32.67	20.98	38.92	2380568	3656.54	5064.74	7570.82	80.79	81.27	81.54	79.96
koichoco	vndb	1991	1760	863575	434318	56921	39071	22.10	13.19	27.31	1855570	4031.75	5545.06	7970.58	82.28	81.80	82.33	81.71
leyline1	vndb	1596	1323	357157	194743	23200	17452	20.47	13.87	11.93	778333	1964.10	2714.68	3912.36	86.32	86.98	86.69	86.36
leyline1+2+3	x	2019	1795	1227766	669613	75191	55792	22.01	14.77	41.08	2655246	2289.94	3170.42	4563.59	86.36	86.02	85.85	85.31
leyline2	vndb	1748	1473	460293	252367	27251	20727	22.21	15.34	15.44	996191	2251.37	3156.03	4525.47	86.01	85.47	85.33	84.71
leyline3	vndb	1661	1441	415297	224473	25497	18358	22.62	14.66	13.83	893636	2453.82	3333.12	4749.25	86.01	85.65	85.60	84.94
magical charming	vndb	2118	1803	726822	365851	55385	36516	19.90	11.54	22.92	1589846	3083.70	4491.40	6946.82	84.48	84.94	84.85	85.60
majokoi	vndb	1970	1709	605714	320953	45995	35060	17.28	11.84	19.68	1347720	3003.77	4322.96	6432.82	87.31	89.13	88.65	89.46
mamiyakun-chi	vndb	1945	1723	1035063	538033	62698	38082	27.18	14.82	34.24	2231160	2922.99	3892.32	5571.56	84.27	83.55	84.14	83.64
monobeno	vndb	2421	2186	2276982	1112344	172390	90236	25.23	11.55	72.02	4887951	4840.85	6638.66	9689.69	86.93	89.09	88.72	89.31
muramasa	vndb	3070	2793	1298400	734933	89355	78135	16.62	13.24	46.82	2790559	9666.37	12614.85	17117.27	64.62	63.54	59.90	62.13
nanarin	vndb	1851	1589	501710	249239	42533	26282	19.09	10.22	15.83	1122490	2914.99	4012.35	5820.38	84.17	86.90	87.45	88.05
nanatsuiro	vndb	1543	1312	500098	269699	36028	26947	18.56	12.51	16.50	1095590	1703.70	2366.63	3606.98	87.84	88.57	88.47	88.80
natsukumo yururu	vndb	2004	1768	815928	442961	53449	31376	26.00	13.93	26.78	1766298	3145.45	4373.94	6608.84	85.69	85.52	85.11	85.42
nine kokoiro	vndb	1536	1236	160876	82198	12729	9035	17.81	11.15	5.18	355520	3491.15	4630.35	6545.56	82.09	81.67	82.35	83.28
noratoto	vndb	2050	1783	725185	367290	57781	40372	17.96	11.17	22.74	1611264	3700.21	5116.97	7846.86	85.34	85.58	84.12	84.57
nursery rhyme	vndb	2046	1779	709248	377828	41431	31423	22.57	15.72	23.50	1529245	3202.27	4456.63	6509.72	83.22	82.89	82.97	82.46
oniikiss	vndb	1951	1681	725977	356693	50762	29170	24.89	12.26	22.34	1549471	2542.02	3477.19	5127.19	90.57	92.29	90.84	89.71
oniikiss fd	vndb	1449	1176	275865	138855	19471	14206	19.42	12.48	8.56	597564	2348.95	3254.81	4784.42	89.33	91.19	88.00	87.16
oretsuba	vndb	2770	2482	1694202	911520	89710	52522	32.26	17.58	56.59	3616658	6919.67	9281.97	12996.72	76.97	78.38	78.86	77.52
oretsuba afterstory	vndb	2131	1827	444441	232540	26122	16054	27.68	15.58	14.56	955772	5309.70	7254.62	10274.15	80.14	79.91	80.13	78.84
oretsuba prelude	vndb	2171	1798	285845	150890	15150	8671	32.97	17.53	9.41	611915	8042.90	10698.34	14506.45	67.91	70.21	71.73	70.40
ouka sabaki	vndb	2145	1914	756726	411106	54008	31873	23.74	12.42	25.43	1680317	3568.67	5073.90	7865.00	75.12	77.97	78.41	79.22
parfait	vndb	2113	1834	645875	327105	48972	33091	19.52	11.49	20.52	1402932	3978.27	5485.14	8073.40	83.19	83.68	84.39	84.51
prawfclwyd	vndb	2018	1766	539238	271160	34908	24396	22.10	13.52	17.17	1171815	4072.27	5722.17	8395.52	85.94	86.20	86.73	85.21
primary by skyfish	vndb	2024	1778	936965	474158	67737	35497	26.40	12.05	29.24	2076479	2925.42	4174.04	6589.35	81.81	81.17	81.71	81.97
princessfrontier	vndb	2342	2096	868621	453081	61397	46855	18.54	12.72	27.99	1887534	5172.70	7215.97	10574.89	82.33	81.09	81.67	81.64
rabuobu	vndb	2169	1904	685392	357904	53398	33008	20.76	11.57	22.10	1503986	5161.12	7134.27	10391.38	82.72	81.49	81.62	82.76
rewrite+	vndb	2646	2409	1698025	930667	114939	98133	17.30	13.61	58.14	3708167	6688.35	8726.25	12066.88	77.20	75.48	75.32	76.44
rinshin	vndb	2210	1950	784371	415286	45936	27074	28.97	15.48	25.88	1679160	5231.71	7185.57	10057.35	81.11	80.54	81.03	80.03
satsukoi	vndb	1882	1587	313821	169911	24064	22372	14.03	11.77	10.52	700304	3557.50	4936.88	7065.75	85.01	83.96	84.29	85.29
sengoku koihime x	vndb	2915	2667	3026212	1633391	198910	116794	25.91	13.58	102.29	6571915	4863.88	6892.79	10458.82	81.44	81.82	82.03	82.56
senmomo	vndb	2513	2235	872642	492352	53978	47589	18.34	14.88	31.45	1894262	5512.62	7383.83	10525.32	67.28	66.34	65.57	66.41
senrenbanka	vndb	2222	1918	1187991	619622	79277	53777	22.09	13.36	38.39	2577729	2593.76	3658.84	5576.30	86.44	86.41	86.24	86.05
senshinkan bansenzin	vndb	2644	2376	902342	516408	42693	25801	34.97	19.96	32.45	1905606	5428.33	7357.42	10407.75	76.81	75.22	74.88	74.13
senshinkan hatimyouzin	vndb	2858	2544	1209693	696234	56847	34121	35.45	20.14	43.91	2549881	6594.17	8719.55	11902.73	75.72	74.23	73.65	72.94
sharnoth fvr	vndb	2124	1877	493611	265506	34861	18887	26.13	12.66	16.44	1049854	5190.59	6860.46	9832.95	78.32	75.86	76.81	78.27
shin koihime eiyuutan 1	vndb	1857	1567	443960	227928	28739	14550	30.51	13.55	14.50	948719	2844.15	3921.26	5762.74	86.84	88.01	87.96	87.30
shin koihime eiyuutan 2	vndb	1897	1659	515162	264335	37757	18946	27.19	11.68	16.47	1113805	2831.92	3994.94	6149.55	84.04	86.47	86.91	87.10
shin koihime eiyuutan 3	vndb	1921	1669	480971	246360	32296	18923	25.42	12.95	15.55	1039439	3213.46	4490.69	6603.62	85.22	86.25	86.78	86.89
shin koihime eiyuutan plus	vndb	1366	1062	118416	59698	7885	4544	26.06	13.06	3.75	256889	3013.55	4249.71	6339.55	88.82	90.30	89.53	89.26
shin koihime musou kakumei 1	vndb	2608	2363	1904437	1002652	131662	73512	25.91	12.75	62.59	4138565	4146.23	5881.00	8871.65	85.69	86.84	86.51	86.82
shirokuma	vndb	2432	2127	1092821	559611	70374	46484	23.51	13.94	34.61	2409592	5985.95	8018.97	11319.29	79.16	78.72	79.10	78.42
shugaten	vndb	1763	1521	404773	215826	29312	24543	16.49	12.77	13.16	898595	3998.35	5690.53	8332.35	80.65	79.85	79.49	80.17
silverio vendetta	vndb	2758	2486	907287	510541	39798	24114	37.62	21.47	33.01	1898888	8825.40	11024.14	14322.30	67.04	69.40	67.14	66.07
simulacre	vndb	1771	1515	307971	178791	19263	13170	23.38	14.75	10.82	662112	2618.88	3597.95	5353.12	82.64	81.13	82.44	83.20
snowwhite	vndb	1546	1240	186893	107042	8085	5681	32.90	21.70	6.49	394306	2523.20	3503.77	5177.60	84.96	85.61	85.88	84.22
soramitsu	vndb	2125	1925	990611	519719	57642	39593	25.02	15.32	32.49	2147612	3504.09	4791.25	6796.54	85.72	85.19	85.46	84.78
sourire	vndb	1894	1637	689587	363343	44900	28629	24.09	13.59	22.50	1489796	2359.10	3226.28	4835.43	87.14	87.14	87.59	87.61
subahibi	vndb	2238	1996	1002475	523303	74527	47508	21.10	11.64	32.17	2157907	3920.09	5502.20	8138.15	82.15	81.44	81.57	82.81
sukinara	vndb	2069	1835	1310330	685809	85195	56305	23.27	13.92	42.10	2930318	3183.97	4415.14	6643.10	86.71	87.17	86.04	85.43
summer pockets	vndb	2115	1848	758893	407996	63937	57625	13.17	10.64	24.50	1711511	3715.70	5413.14	8144.70	87.53	88.84	87.98	89.60
tarareba	vndb	1797	1553	507652	263306	32798	20984	24.19	13.94	16.43	1098004	2640.91	3590.20	5355.77	83.73	83.47	83.77	83.28
trinoline	vndb	1954	1692	550090	287809	34375	26522	20.74	14.31	18.14	1195563	2657.40	3607.93	5396.90	85.40	84.71	85.05	85.08
tsujidou-san no jun'ai road	vndb	2269	2019	1242389	656009	102403	78598	15.81	11.18	40.49	2783014	5141.57	7116.95	10194.23	78.72	75.86	76.44	78.00
tsujidou-san no virgin road	vndb	2064	1802	693390	369377	54690	42858	16.18	11.72	22.70	1553124	4979.80	6865.18	10013.77	78.60	76.23	76.86	78.15
tsuriotsu	vndb	2390	2102	1122475	637552	60946	30444	36.87	17.19	38.67	2388922	3277.00	4575.11	7022.50	81.94	81.47	81.56	81.48
tsuushinbo	vndb	1866	1617	673834	344763	44156	27811	24.23	13.66	21.70	1453184	2517.85	3378.20	5007.71	89.53	90.65	89.60	88.93
twinklecrusaders	vndb	2586	2313	1639472	856148	116844	77205	21.24	12.71	52.75	3600579	5297.93	7188.15	10369.42	78.23	76.51	77.37	77.74
tyrhhia	vndb	2604	2206	315474	179000	18314	11773	26.80	15.71	11.36	661103	10433.00	13511.32	18183.50	64.69	63.32	62.44	63.43
white_album	vndb	1831	1481	461704	251896	31841	26146	17.66	13.31	15.59	1008614	2631.26	3784.74	5690.65	83.87	83.34	83.83	84.98
yoakena	vndb	2134	1902	884674	467812	60023	59051	14.98	13.31	29.25	1945323	3479.46	4782.16	7082.96	83.65	82.50	83.38	83.79

-  ⇤ ← Revision 80 as of 2019-12-15 02:43:17 → 
  Size: 20381
  Editor: weh
  Comment:
+   ← Revision 81 as of 2019-12-15 02:43:35 → ⇥
  Size: 20381
  Editor: weh
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 27:
-'''The character counting stats here ignore most punctuation characters.''' This is because some script ripping methods strip some types of punctuation, such as quotes around lines of dialogue. For example, without this adjustment, hoshimemo would look smaller compared to other VNs than it actually is. If I ever have a chance to revisit old dumps and make sure they all handle punctuation consistently, I will "fix" this, because it's a source of confusion when comparing to the old tlwiki stats. It also does not count newlines, but this won't ever change.
+'''The character counting stats here ignore some punctuation characters.''' This is because some script ripping methods strip some types of punctuation, such as quotes around lines of dialogue. For example, without this adjustment, hoshimemo would look smaller compared to other VNs than it actually is. If I ever have a chance to revisit old dumps and make sure they all handle punctuation consistently, I will "fix" this, because it's a source of confusion when comparing to the old tlwiki stats. It also does not count newlines, but this won't ever change.