Diff for "Stats" - VN Stats

Differences between revisions 78 and 79

Click on Old Stats if you want to see the old stats, like the Core 6k or Hayashi stats.

TODO: Fix scripts with broken linewraps (affects sentence count, line count, and metrics a/d).

All stats work on deduplicated copies of the script.

If you want to add a script, post it to the Requests page.

See also Changes.

You can get the new analysis tools here. I hope you know how to use rust!

Higher is easier: metric a/b/c/d

Lower is easier: everything else

The "freqlistX% Target" metrics are an estimate of lexical complexity. High measurements mean that the script uses uncommon words more frequently, or common words less frequently. Commonness is based on every long-enough script combined, not on general purpose frequency lists or the frequency list of the single script in question. However, the most common uncovered 20 words in the script are ignored, because they're probably names or setting jargon, or even parsing errors. This entire process ignores grammatical words, proper nouns, and numbers.

The "metric a/b/c/d" lines are derived from linear regression targeting the "freqlist 92.5% Target" metric. An exact description of the processing for these metrics is here. The math is reverse polish notation.

The hours estimate is kanji/18000 + hiragana/31500 + katakana/61400. It assumes a reading speed of 475 characters per minute, in general. It's calibrated based on a bunch of vndb length ratings with "very short" assigned to 1 hour and "very long" assigned to 60 hours. It is completely useless for VNs with nontrivial amounts of gameplay, or where rereading is expected, or where you're expected to miss a lot of content, or where you're only meant to read one or two out of several routes. Example of calibrating with only character count as a source variable: https://i.imgur.com/tqTGVlB.png

Frequency lists, raw stats database: https://github.com/wareya/jpstats/tree/master/workspace

There is a graph at the bottom of the page.

The character counting stats here ignore most punctuation characters. This is because some script ripping methods strip some types of punctuation, such as quotes around lines of dialogue. For example, without this adjustment, hoshimemo would look smaller compared to other VNs than it actually is. If I ever have a chance to revisit old dumps and make sure they all handle punctuation consistently, I will "fix" this, because it's a source of confusion when comparing to the old tlwiki stats. It also does not count newlines, but this won't ever change.

name	link	kanji (unique)	kanji (2+)	chars	lexemes	sentences	lines	chars /line	chars /sentence	hours estimate	sjis bytes	freqlist 90% Target	freqlist 92.5% Target	freqlist 95% Target	metric a	metric b	metric c	metric d
aete mushisuru	vndb	1987	1723	487284	285571	41916	35166	13.86	11.49	17.75	1186788	3791.98	5272.01	7622.85	82.18	80.63	80.89	82.00
amakoi	vndb	2028	1752	780069	442826	54686	28028	27.83	13.96	27.61	1863787	2610.24	3623.40	5478.91	90.94	91.77	90.64	89.41
ao no kanata	vndb	2129	1846	873044	505670	56968	42554	20.52	15.15	31.46	2039182	3266.83	4551.23	6764.82	81.27	80.53	80.93	80.88
astelight shuushuubako	vndb	2982	2595	485559	293340	14344	9535	50.92	33.55	18.65	1062193	11822.55	14968.33	20006.85	47.72	66.12	63.25	58.97
axanael	vndb	1861	1585	378897	208590	43090	31457	12.04	8.66	12.86	1018620	4473.03	6185.94	8852.18	77.48	75.23	74.93	76.49
biman1	vndb	1750	1394	177219	98201	12451	7630	23.23	14.05	6.27	435951	4260.90	5683.87	8101.80	82.46	82.16	82.53	82.34
buraban	vndb	1800	1570	743503	437600	59511	39213	18.96	12.38	27.10	1843652	1935.97	2684.83	4162.70	85.15	85.40	85.93	86.28
chronobox	vndb	1985	1737	490390	275580	41199	22341	21.95	11.60	17.54	1215132	4078.96	5481.36	8027.40	82.55	82.75	83.05	83.02
chronobox trials	vndb	1265	914	62045	35103	5448	3102	20.00	11.14	2.24	153851	3214.80	4330.18	6543.58	82.70	83.90	83.93	84.23
clacra	vndb	2215	1954	798979	448038	58006	40785	19.59	13.48	28.51	1966623	3943.99	5445.39	7776.45	83.20	82.47	83.03	83.13
cloverpoint	vndb	2258	1995	826177	474200	60632	40705	20.30	13.47	29.68	2000171	4705.86	6448.75	9354.50	82.27	81.62	82.05	81.79
daitoshokan	vndb	2312	2055	1062593	627059	76469	65781	16.15	13.81	39.49	2517383	3876.12	5338.45	7770.46	80.40	79.48	79.45	79.77
daitoshokan fandisk	vndb	2035	1760	458971	267957	34261	28268	16.24	13.31	16.96	1090969	3826.30	5230.74	7475.65	81.34	80.51	80.70	80.94
dies irae	vndb	2790	2551	1614080	951741	89885	54695	29.51	17.69	59.89	3623949	6527.17	8713.60	11887.69	76.33	75.95	75.88	75.80
dracuriot	vndb	2218	1944	1154120	663550	84384	49856	23.15	13.54	40.95	2788115	3082.67	4276.20	6400.32	83.00	82.57	82.70	81.93
eustia	vndb	2454	2210	946912	565396	69146	61214	15.47	13.65	34.92	2233829	4351.62	6186.41	8976.12	83.30	82.24	82.95	83.26
fate stay night	vndb	2556	2320	1598035	958825	93064	67643	23.62	17.06	59.12	3670684	4877.72	6484.58	9027.63	76.15	76.79	77.36	76.74
flowers1	vndb	1979	1690	313427	191620	18334	12505	25.06	16.99	11.82	715696	4197.77	5878.24	8919.55	75.92	75.15	74.96	75.25
flowers1+2+3	x	2412	2178	847201	519146	48779	33604	25.21	17.26	32.04	1918212	5279.37	7351.33	10499.59	72.48	72.41	72.05	72.26
flowers2	vndb	2032	1731	255414	155134	14646	10300	24.80	17.34	9.66	577012	5762.85	8023.76	11401.67	70.60	70.83	70.35	70.53
flowers3	vndb	2084	1808	279235	172879	16034	11020	25.34	17.30	10.59	628936	5631.20	7768.65	10836.87	70.23	70.60	70.26	70.43
flyable heart	vndb	1849	1626	786204	460113	56446	42919	18.32	13.81	28.58	1856734	2106.53	2934.41	4518.75	87.28	87.41	87.34	87.48
fortissimoexs	vndb	2306	2107	1229133	719469	68827	42717	28.77	17.43	45.47	2898110	3990.75	5352.41	7473.89	78.80	79.22	78.84	77.07
fortunearterial	vndb	2186	1942	852111	505495	66355	62552	13.62	12.79	31.55	2020723	3594.68	4918.94	7294.45	83.14	82.71	82.91	83.71
fureraba	vndb	2083	1853	972057	557185	65668	49041	19.82	14.63	34.79	2326559	3279.63	4638.94	7076.20	80.88	80.28	80.73	80.48
futsuu no fantasy	vndb	2018	1777	719328	422455	48851	36967	19.46	14.67	26.28	1685892	3588.67	4914.03	7082.67	84.49	83.99	84.46	84.16
gensou no idea	vndb	2481	2225	809804	476863	48809	31707	25.54	16.27	29.69	1860870	5529.10	7439.72	10088.85	78.52	78.04	77.61	77.70
grisaia	vndb	2611	2364	1616264	967480	95866	58976	27.41	16.58	58.75	3722925	4443.94	6246.21	9307.31	78.99	79.23	79.62	78.89
hanachirasu	vndb	2149	1742	139219	88041	7848	5840	23.84	17.66	5.50	313174	9058.90	11780.35	16101.97	60.46	59.73	57.10	57.93
hanahira	vndb	947	654	46525	25363	4264	3487	13.34	10.77	1.61	118834	2857.60	3937.60	6067.40	84.44	86.26	83.91	83.88
harumade kururu	vndb	1908	1659	561302	329066	41978	24170	23.22	13.24	20.04	1331974	2799.83	3958.99	6162.05	86.71	87.09	86.55	86.82
hatsukoi yohou	vndb	1834	1586	596846	352632	47730	28876	20.67	12.46	21.96	1462836	2200.27	3082.53	4713.60	85.10	85.00	85.05	85.33
hatsuyuki sakura	vndb	1980	1705	535514	314103	47091	34890	15.35	11.29	19.17	1321507	3958.88	5473.78	8251.62	85.21	86.41	86.20	87.57
henkoi	vndb	1897	1602	529937	296027	46944	21506	24.64	11.19	18.42	1341639	2985.29	4302.73	6377.17	78.66	76.97	77.58	77.18
hoshimemo	vndb	2080	1864	893158	538675	60811	53037	16.84	14.64	32.92	1967904	4196.60	5635.32	8078.25	82.25	81.39	81.29	82.29
iinchou shounin	vndb	2051	1789	575115	330257	57137	31613	18.19	9.97	20.45	1452024	3199.60	4475.97	6707.17	82.73	82.06	82.45	83.20
imakoi	vndb	1446	1157	143689	81099	9229	5826	24.66	15.52	5.10	335623	3009.20	3901.80	5475.37	78.01	78.44	78.98	78.65
inganock	vndb	2065	1816	384975	229312	32103	16295	23.63	11.60	14.13	882985	5273.00	7044.01	9899.50	75.90	72.65	72.10	74.17
itsusora	vndb	2465	2182	583122	356470	35948	29092	20.04	15.86	21.78	1329820	4974.40	6841.88	9834.75	80.40	79.17	80.01	80.16
jingai makyou	vndb	2495	2207	752909	450310	52865	30595	24.61	13.86	27.93	1742586	5294.96	7068.57	9943.40	81.53	79.82	80.69	81.58
kagerou	vndb	2938	2598	792047	489011	26550	19906	39.79	29.79	30.67	1761494	8426.90	11310.26	15944.21	65.95	63.00	66.37	63.63
kajiri 18	vndb	2798	2488	846474	512648	45515	27063	31.28	18.29	32.35	1899540	7673.58	10054.90	13970.30	65.87	64.92	66.20	66.21
kajiri akebono	vndb	2861	2565	1027163	624653	53302	31694	32.41	19.00	39.37	2293097	7411.94	9880.73	13790.73	65.85	64.74	65.95	65.82
kamikaze explorer	vndb	2244	1981	1066809	604325	76446	44103	24.19	13.72	37.80	2571862	3510.22	4821.47	7104.64	80.38	79.60	80.48	79.90
kamimaho	vndb	2159	1945	870689	524213	52471	42813	20.34	16.53	32.85	2014648	3422.40	4648.41	6708.72	80.44	78.77	79.03	79.48
kanojo no seiiki	vndb	1294	1056	158859	92009	11349	7970	19.93	13.92	5.71	381072	2392.23	3243.93	4745.27	86.88	86.86	86.37	86.70
katahane	vndb	1865	1659	569480	332630	40062	28103	20.26	14.19	20.09	1385255	3440.08	4887.07	7330.26	80.68	80.56	80.62	79.75
kaziklu	vndb	2068	1726	209725	122771	10189	6061	34.60	20.33	7.66	462813	6177.00	8206.88	11068.17	76.27	77.60	78.11	77.49
kikaijikake no eve	vndb	2566	2361	1531763	898559	85737	43525	35.19	17.68	56.49	3541220	6339.68	8320.25	11444.91	67.31	69.93	70.48	69.27
kimikoe	vndb	2222	1981	722740	420545	57012	43427	16.64	12.55	26.39	1739034	4131.44	5669.68	8411.55	84.03	83.50	83.60	83.85
kirakira	vndb	2281	1986	1064565	631370	50511	34586	30.78	20.98	38.92	2380568	3663.04	5063.24	7536.61	80.97	81.14	81.41	79.84
koichoco	vndb	1991	1760	756457	434318	56921	39071	19.36	13.19	27.31	1855570	4004.70	5567.27	8166.71	82.20	81.71	82.18	81.57
leyline1	vndb	1596	1323	324310	194743	23200	17452	18.58	13.87	11.93	778333	2083.73	2816.15	4084.04	86.22	86.77	86.60	86.27
leyline1+2+3	x	2019	1795	1118688	669613	75191	55792	20.05	14.77	41.08	2655246	2381.49	3226.05	4683.90	86.28	85.94	85.75	85.21
leyline2	vndb	1748	1473	421338	252367	27251	20727	20.33	15.34	15.44	996191	2363.62	3276.50	4715.89	85.94	85.41	85.23	84.62
leyline3	vndb	1661	1441	376493	224473	25497	18358	20.51	14.66	13.83	893636	2616.58	3454.97	5012.77	85.90	85.55	85.47	84.82
magical charming	vndb	2118	1803	645324	365851	55385	36516	17.67	11.54	22.92	1589846	3076.84	4501.36	6923.74	84.36	84.86	84.77	85.53
majokoi	vndb	1970	1709	547341	320953	45995	35060	15.61	11.84	19.68	1347720	3043.70	4387.83	6548.27	87.22	89.20	88.67	89.48
mamiyakun-chi	vndb	1945	1723	945532	538033	62698	38082	24.83	14.82	34.24	2231160	2953.46	3886.52	5594.03	84.22	83.44	84.02	83.52
monobeno	vndb	2421	2186	2011868	1112344	172390	90236	22.30	11.55	72.02	4887951	4894.33	6677.16	9740.10	86.84	89.15	88.73	89.32
muramasa	vndb	3070	2793	1189809	734933	89355	78135	15.23	13.24	46.82	2790559	9833.49	12580.78	17094.95	64.17	63.10	59.28	61.50
nanarin	vndb	1851	1589	447450	249239	42533	26282	17.02	10.22	15.83	1122490	2916.19	4005.63	5825.71	84.12	86.79	87.36	87.96
nanatsuiro	vndb	1543	1312	453855	269699	36028	26947	16.84	12.51	16.50	1095590	1715.74	2385.16	3644.99	87.74	88.56	88.43	88.76
natsukumo yururu	vndb	2004	1768	750409	442961	53449	31376	23.92	13.93	26.78	1766298	3131.58	4401.96	6645.56	85.62	85.55	85.10	85.41
nine kokoiro	vndb	1536	1236	142515	82198	12729	9035	15.77	11.15	5.18	355520	3443.96	4611.48	6541.80	81.96	81.34	82.13	83.05
noratoto	vndb	2050	1783	651917	367290	57781	40372	16.15	11.17	22.74	1611264	3688.68	5132.89	7918.85	85.22	85.56	84.10	84.55
nursery rhyme	vndb	2046	1779	655804	377828	41431	31423	20.87	15.72	23.50	1529245	3184.56	4458.73	6532.36	83.19	82.86	82.89	82.39
oniikiss	vndb	1951	1681	627490	356693	50762	29170	21.51	12.26	22.34	1549471	2526.20	3511.09	5133.98	90.57	92.30	90.84	89.71
oniikiss fd	vndb	1449	1176	245920	138855	19471	14206	17.31	12.48	8.56	597564	2374.13	3258.86	4802.32	89.33	91.26	88.04	87.22
oretsuba	vndb	2770	2482	1596292	911520	89710	52522	30.39	17.58	56.59	3616658	6943.48	9352.95	13162.66	76.94	78.26	78.72	77.39
oretsuba afterstory	vndb	2131	1827	412904	232540	26122	16054	25.72	15.58	14.56	955772	5372.25	7310.58	10417.12	80.13	79.83	80.05	78.76
oretsuba prelude	vndb	2171	1798	269924	150890	15150	8671	31.13	17.53	9.41	611915	8083.95	10729.74	14619.72	67.80	70.00	71.52	70.20
ouka sabaki	vndb	2145	1914	674913	411106	54008	31873	21.18	12.42	25.43	1680317	3606.50	5181.50	7849.50	74.87	77.34	78.11	78.91
parfait	vndb	2113	1834	567028	327105	48972	33091	17.14	11.49	20.52	1402932	3982.45	5486.98	8108.40	83.11	83.39	84.22	84.34
prawfclwyd	vndb	2018	1766	474599	271160	34908	24396	19.45	13.52	17.17	1171815	4112.70	5710.21	8452.89	85.87	86.00	86.57	85.06
primary by skyfish	vndb	2024	1778	831422	474158	67737	35497	23.42	12.05	29.24	2076479	2977.73	4221.52	6725.20	81.66	80.92	81.53	81.78
princessfrontier	vndb	2342	2096	789097	453081	61397	46855	16.84	12.72	27.99	1887534	5257.59	7384.78	10864.27	82.14	80.92	81.52	81.48
rabuobu	vndb	2169	1904	625204	357904	53398	33008	18.94	11.57	22.10	1503986	5157.83	7143.38	10470.75	82.56	81.40	81.51	82.64
rewrite+	vndb	2646	2409	1575954	930667	114939	98133	16.06	13.61	58.14	3708167	6692.84	8758.10	12088.27	76.95	75.24	75.02	76.14
rinshin	vndb	2210	1950	715377	415286	45936	27074	26.42	15.48	25.88	1679160	5301.70	7280.01	10192.35	81.07	80.45	80.88	79.88
satsukoi	vndb	1882	1587	285162	169911	24064	22372	12.75	11.77	10.52	700304	3582.75	4947.58	7063.62	84.83	83.79	84.10	85.09
sengoku koihime x	vndb	2915	2667	2731166	1633391	198910	116794	23.38	13.58	102.29	6571915	4965.01	7095.20	10818.66	81.21	81.58	81.81	82.34
senmomo	vndb	2513	2235	806430	492352	53978	47589	16.95	14.88	31.45	1894262	5555.97	7714.71	11041.24	66.80	65.96	65.06	65.89
senrenbanka	vndb	2222	1918	1068052	619622	79277	53777	19.86	13.36	38.39	2577729	2605.11	3671.96	5604.45	86.36	86.39	86.18	85.99
senshinkan bansenzin	vndb	2644	2376	856646	516408	42693	25801	33.20	19.96	32.45	1905606	5251.71	7054.39	9914.25	76.62	75.06	74.61	73.87
senshinkan hatimyouzin	vndb	2858	2544	1152108	696234	56847	34121	33.77	20.14	43.91	2549881	6324.23	8316.73	11313.96	75.44	74.04	73.34	72.64
sharnoth fvr	vndb	2124	1877	460329	265506	34861	18887	24.37	12.66	16.44	1049854	5277.79	6955.84	9930.99	77.96	75.31	76.42	77.87
shin koihime eiyuutan 1	vndb	1857	1567	392490	227928	28739	14550	26.98	13.55	14.50	948719	2909.49	4008.64	5981.68	86.74	87.76	87.84	87.19
shin koihime eiyuutan 2	vndb	1897	1659	444312	264335	37757	18946	23.45	11.68	16.47	1113805	2887.67	4128.79	6436.02	83.92	86.26	86.76	86.95
shin koihime eiyuutan 3	vndb	1921	1669	423461	246360	32296	18923	22.38	12.95	15.55	1039439	3271.65	4605.40	6788.45	85.10	86.15	86.67	86.79
shin koihime eiyuutan plus	vndb	1366	1062	104297	59698	7885	4544	22.95	13.06	3.75	256889	3086.05	4245.83	6565.55	88.76	90.20	89.53	89.27
shin koihime musou kakumei 1	vndb	2608	2363	1696156	1002652	131662	73512	23.07	12.75	62.59	4138565	4189.13	6032.83	9190.66	85.54	86.62	86.39	86.69
shirokuma	vndb	2432	2127	1010345	559611	70374	46484	21.74	13.94	34.61	2409592	6018.56	8054.15	11507.63	79.03	78.58	78.95	78.28
shugaten	vndb	1763	1521	376878	215826	29312	24543	15.36	12.77	13.16	898595	4032.46	5755.26	8319.24	80.48	79.80	79.42	80.09
silverio vendetta	vndb	2758	2486	863983	510541	39798	24114	35.83	21.47	33.01	1898888	8915.47	11116.60	14519.37	66.42	68.92	66.66	65.60
simulacre	vndb	1771	1515	285163	178791	19263	13170	21.65	14.75	10.82	662112	2600.33	3563.06	5332.25	82.34	81.00	82.25	83.01
snowwhite	vndb	1546	1240	176057	107042	8085	5681	30.99	21.70	6.49	394306	2482.20	3471.80	5195.20	85.08	85.52	85.79	84.14
soramitsu	vndb	2125	1925	902605	519719	57642	39593	22.80	15.32	32.49	2147612	3477.89	4745.20	6785.37	85.63	85.09	85.34	84.66
sourire	vndb	1894	1637	618316	363343	44900	28629	21.60	13.59	22.50	1489796	2338.36	3207.45	4799.17	87.06	87.11	87.52	87.55
subahibi	vndb	2238	1996	883648	523303	74527	47508	18.60	11.64	32.17	2157907	3912.49	5536.02	8182.82	82.02	81.30	81.36	82.60
sukinara	vndb	2069	1835	1238443	685809	85195	56305	22.00	13.92	42.10	2930318	3228.64	4474.42	6723.62	86.73	87.20	86.05	85.45
summer pockets	vndb	2115	1848	686283	407996	63937	57625	11.91	10.64	24.50	1711511	3754.20	5511.91	8257.20	87.41	88.85	87.97	89.58
tarareba	vndb	1797	1553	462740	263306	32798	20984	22.05	13.94	16.43	1098004	2701.67	3666.95	5445.55	83.58	83.33	83.62	83.14
trinoline	vndb	1954	1692	495438	287809	34375	26522	18.68	14.31	18.14	1195563	2642.96	3609.71	5361.45	85.25	84.58	84.92	84.94
tsujidou-san no jun'ai road	vndb	2269	2019	1159724	656009	102403	78598	14.76	11.18	40.49	2783014	5193.59	7142.62	10308.76	78.52	75.73	76.31	77.86
tsujidou-san no virgin road	vndb	2064	1802	649154	369377	54690	42858	15.15	11.72	22.70	1553124	4985.60	6880.93	10150.30	78.40	76.11	76.72	78.00
tsuriotsu	vndb	2390	2102	1053271	637552	60946	30444	34.60	17.19	38.67	2388922	3250.97	4594.48	7043.25	81.79	81.36	81.41	81.33
tsuushinbo	vndb	1866	1617	612627	344763	44156	27811	22.03	13.66	21.70	1453184	2516.61	3367.62	5022.18	89.55	90.73	89.66	88.99
twinklecrusaders	vndb	2586	2313	1504925	856148	116844	77205	19.49	12.71	52.75	3600579	5358.97	7354.73	10578.42	78.05	76.36	77.19	77.56
tyrhhia	vndb	2604	2206	295145	179000	18314	11773	25.07	15.71	11.36	661103	10734.75	13882.75	18986.50	64.06	62.86	61.89	62.87
white_album	vndb	1831	1481	425614	251896	31841	26146	16.28	13.31	15.59	1008614	2603.59	3770.21	5720.65	83.72	83.18	83.73	84.88
yoakena	vndb	2134	1902	802113	467812	60023	59051	13.58	13.31	29.25	1945323	3488.03	4780.68	7093.70	83.40	82.28	83.17	83.58

-  ⇤ ← Revision 78 as of 2019-09-21 22:19:47 → 
  Size: 20330
  Editor: weh
  Comment:
+   ← Revision 79 as of 2019-09-28 22:37:53 → ⇥
  Size: 20378
  Editor: weh
  Comment:
-Deletions are marked like this.
+Additions are marked like this.
 Line 19:
-The "metric a/b/c/d" lines are derived from linear regression targeting the "freqlist 92.5% Target" metric. An exact description of the processing for these metrics is [[https://pastebin.com/TwZYeSbb|here]]. The math is reverse polish notation.
+The "metric a/b/c/d" lines are derived from linear regression targeting the "freqlist 92.5% Target" metric. An exact description of the processing for these metrics is [[https://github.com/wareya/jpstats/blob/master/workspace/config/regression.txt|here]]. The math is reverse polish notation.