FineWeb · sample-10BT · target inventory

FineWeb WCS Target Words

200 unique words from HuggingFaceFW/fineweb (sample-10BT), sampled from the middle-long-tail band of data/raw/norvig_count_1w.txt.

200target words

10,000-40,000selection band

10,019-39,746observed target ranks

10,000contexts

Frequency Selection Band

Norvig word-frequency curve with the sampled middle-long-tail rank segment highlighted.

Frequency list Selected rank band Target words

Target-word inventory 200 words

#	Word	Rank	Count	Contexts
1	nonfiction	10,019	5,039,708	50
2	phenomena	10,146	4,936,094	50
3	preschool	10,167	4,916,187	50
4	observers	10,332	4,796,192	50
5	lining	10,381	4,758,401	50
6	glove	10,453	4,714,578	50
7	wastewater	10,455	4,714,167	50
8	relaxed	10,615	4,603,097	50
9	adhesive	10,643	4,585,279	50
10	aperture	11,127	4,266,263	50
11	intuitive	11,181	4,241,404	50
12	coordinating	11,191	4,234,379	50
13	borrow	11,358	4,137,645	50
14	shocked	11,678	3,948,680	50
15	diaper	11,702	3,933,145	50
16	refuge	11,736	3,910,887	50
17	contexts	11,944	3,804,487	50
18	rename	12,029	3,757,535	50
19	petrol	12,158	3,690,703	50
20	lever	12,422	3,566,558	50
21	webs	12,569	3,501,990	50
22	honours	12,636	3,471,334	50
23	abundant	12,717	3,441,495	50
24	competitor	12,862	3,378,603	50
25	encounters	12,915	3,357,331	50
26	protests	13,042	3,303,934	50
27	vaccines	13,219	3,238,310	50
28	turbine	13,229	3,235,102	50
29	palms	13,514	3,127,466	50
30	textures	13,560	3,108,758	50
31	microscope	13,698	3,052,163	50
32	checksum	13,713	3,046,204	50
33	worksheet	13,776	3,019,301	50
34	brewing	13,896	2,974,086	50
35	autonomy	13,990	2,937,673	50
36	allergic	14,062	2,913,453	50
37	addict	14,072	2,910,117	50
38	juniors	14,086	2,904,014	50
39	admits	14,096	2,899,936	50
40	padding	14,131	2,890,936	50
41	comprehension	14,182	2,870,530	50
42	flea	14,392	2,796,116	50
43	karate	14,617	2,723,996	50
44	ceremonies	14,652	2,712,791	50
45	invaluable	14,736	2,682,391	50
46	undergo	14,957	2,620,082	50
47	mirage	15,383	2,493,561	50
48	wrought	15,949	2,345,069	50
49	comfortably	16,082	2,310,081	50
50	roadside	16,139	2,298,262	50
51	cessation	16,872	2,137,188	50
52	psychotherapy	16,899	2,131,314	50
53	emblem	17,091	2,089,468	50
54	dunes	17,097	2,088,285	50
55	praised	17,239	2,058,171	50
56	horseback	17,690	1,969,441	50
57	bullying	17,807	1,948,806	50
58	robotic	17,964	1,921,045	50
59	crypt	18,063	1,904,607	50
60	cubes	18,162	1,887,321	50
61	sanity	18,221	1,877,686	50
62	forefront	18,597	1,815,372	50
63	teal	18,672	1,803,669	50
64	frontiers	18,775	1,785,820	50
65	drank	18,821	1,777,243	50
66	watersports	18,895	1,765,286	50
67	commute	18,959	1,754,751	50
68	prognosis	19,019	1,746,165	50
69	determinants	19,034	1,744,062	50
70	phishing	19,206	1,718,427	50
71	newsfeed	19,224	1,716,299	50
72	ibn	19,272	1,710,709	50
73	overdrive	19,574	1,664,969	50
74	coffin	19,591	1,662,468	50
75	moi	19,720	1,644,951	50
76	ode	19,721	1,644,895	50
77	conferred	19,847	1,624,719	50
78	absorbing	19,926	1,613,367	50
79	wilder	19,964	1,607,947	50
80	sultan	20,280	1,564,160	50
81	nah	20,554	1,527,428	50
82	pinot	20,923	1,481,847	50
83	deputies	20,998	1,471,758	50
84	socioeconomic	21,225	1,445,397	50
85	inherit	21,257	1,440,810	50
86	surreal	21,289	1,437,237	50
87	encrypt	21,302	1,435,748	50
88	constable	21,318	1,433,656	50
89	phono	21,441	1,418,855	50
90	bps	21,643	1,395,862	50
91	renters	21,838	1,374,199	50
92	radiological	22,019	1,354,035	50
93	motorway	22,030	1,353,494	50
94	iodine	22,050	1,351,488	50
95	decorators	22,345	1,320,345	50
96	psoriasis	22,352	1,319,757	50
97	motorists	22,526	1,302,021	50
98	biodiesel	22,722	1,284,181	50
99	presume	22,857	1,272,666	50
100	dharma	23,121	1,247,164	50
101	calligraphy	23,210	1,238,383	50
102	starship	23,323	1,229,480	50
103	livelihood	23,358	1,226,471	50
104	drowned	23,473	1,217,295	50
105	sweeps	23,508	1,213,879	50
106	calves	23,565	1,208,012	50
107	lacy	23,573	1,207,457	50
108	walkthroughs	23,742	1,192,778	50
109	deliverables	24,026	1,167,801	50
110	inset	24,086	1,162,898	50
111	whispers	24,142	1,158,619	50
112	digitized	24,337	1,141,575	50
113	palmetto	24,668	1,116,605	50
114	pleasantly	24,767	1,108,641	50
115	communicates	24,788	1,106,439	50
116	wildfire	24,965	1,093,379	50
117	fruity	24,990	1,091,678	50
118	sonnet	25,111	1,081,841	50
119	bong	25,226	1,074,219	50
120	inadvertently	25,274	1,071,570	50
121	reacted	25,375	1,064,981	50
122	interplay	25,570	1,050,504	50
123	azure	25,682	1,042,257	50
124	pathogenesis	25,721	1,038,707	50
125	workbench	25,759	1,037,033	50
126	frontage	25,909	1,027,134	50
127	marketer	26,005	1,021,263	50
128	priori	26,063	1,016,603	50
129	unison	26,139	1,010,644	50
130	bassist	26,352	995,968	50
131	waterfowl	26,542	984,798	50
132	payback	26,663	977,064	50
133	slipper	27,106	946,965	50
134	governs	27,153	944,138	50
135	extraordinarily	27,253	938,117	50
136	antagonist	27,459	925,886	50
137	cadre	27,463	925,745	50
138	velour	27,490	924,178	50
139	marketable	27,623	916,698	50
140	machined	27,858	903,576	50
141	liturgical	27,888	901,774	50
142	cyclones	28,459	871,733	50
143	lament	28,523	868,477	50
144	terraces	28,525	868,409	50
145	repo	28,685	860,967	50
146	hassles	28,814	854,443	50
147	mosques	29,297	830,923	50
148	distractions	29,515	819,863	50
149	tentatively	29,692	811,676	50
150	conceptions	29,762	808,213	50
151	cfg	29,771	807,901	50
152	vigilance	29,889	801,669	50
153	humankind	30,114	791,114	50
154	forearm	30,313	782,319	50
155	eerie	30,535	772,484	50
156	electrochemical	30,681	766,527	50
157	jetty	30,713	765,224	50
158	ascertained	30,857	759,738	50
159	varnish	31,047	752,945	50
160	refinements	31,111	750,263	50
161	repost	31,114	750,029	50
162	streaks	31,550	731,843	50
163	subtracted	32,269	705,073	50
164	pathologist	32,474	698,084	50
165	irradiated	32,530	696,038	50
166	sari	32,632	692,213	50
167	hydrophobic	32,843	684,750	50
168	prim	33,359	666,550	50
169	feudal	33,531	661,772	50
170	receptacles	34,096	642,454	50
171	socialization	34,264	637,564	50
172	cosmological	34,520	629,347	50
173	compensating	34,618	626,448	50
174	guestrooms	34,696	623,988	50
175	dendritic	35,147	610,213	50
176	unskilled	35,413	602,968	50
177	numerator	35,512	599,807	50
178	biodegradable	35,892	589,155	50
179	lagging	36,202	580,241	50
180	radii	36,358	575,939	50
181	overflowing	36,438	573,925	50
182	croquet	36,538	571,392	50
183	ceasefire	36,610	569,390	50
184	creatinine	36,635	568,725	50
185	landmines	37,122	556,584	50
186	erections	37,209	554,572	50
187	multifunctional	37,364	550,923	50
188	revamp	37,429	549,489	50
189	subdomain	37,616	544,467	50
190	subspecies	37,788	540,016	50
191	nuance	37,939	536,418	50
192	freer	38,009	534,734	50
193	yanks	38,150	531,722	50
194	photojournalism	38,241	529,167	50
195	pronoun	38,652	519,635	50
196	subtropical	39,006	511,155	50
197	unbeaten	39,592	497,426	50
198	aloft	39,597	497,342	50
199	encased	39,739	494,670	50
200	credentialing	39,746	494,584	50