Skip to content

Commit 553aaa5

Browse files
trevorcampbelljoelostblom
trevorcampbell
and
joelostblom
authored
Production polish chapter 2 (#49)
* empty commit for WIP PR * hide ignore warnings cell; import pandas move down; remove read_table from objectives; .csv formatting consistency * fixed canadian language data with metainfo * fixed tsv/no cols data in ch2 * working on polishing reading * polished ch2 up to db section * commented out web scraping and api for first round; issue opened * commented out learning objs for scraping/api * built_html executable * done new ibis database section * Fixed learning objectives sqlalch -> ibis; minor sqlalch bugfixes * ibis "modern" Co-authored-by: Joel Ostblom <[email protected]> * nicer formatting of readcsv with args Co-authored-by: Joel Ostblom <[email protected]> * minor polish on wording * fix header in skiprows example * nicer formatting on ibis connect args Co-authored-by: Joel Ostblom <[email protected]> * Removed warnings filter--unneeded * index false in to_csv Co-authored-by: Joel Ostblom <[email protected]>
1 parent 7e6fe9b commit 553aaa5

File tree

6 files changed

+1590
-1644
lines changed

6 files changed

+1590
-1644
lines changed

‎source/data/can_lang-meta-data.csv

Lines changed: 0 additions & 430 deletions
This file was deleted.

‎source/data/can_lang.tsv

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,4 @@
1+
category language mother_tongue most_at_home most_at_work lang_known
12
Aboriginal languages Aboriginal languages, n.o.s. 590 235 30 665
23
Non-Official & Non-Aboriginal languages Afrikaans 10260 4785 85 23415
34
Non-Official & Non-Aboriginal languages Afro-Asiatic languages, n.i.e. 1150 445 10 2775

‎source/data/can_lang_meta-data.csv

Lines changed: 218 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,218 @@
1+
Data source: https://ttimbers.github.io/canlang/
2+
Data originally published in: Statistics Canada Census of Population 2016.
3+
Reproduced and distributed on an as-is basis with their permission.
4+
category,language,mother_tongue,most_at_home,most_at_work,lang_known
5+
Aboriginal languages,"Aboriginal languages, n.o.s.",590,235,30,665
6+
Non-Official & Non-Aboriginal languages,Afrikaans,10260,4785,85,23415
7+
Non-Official & Non-Aboriginal languages,"Afro-Asiatic languages, n.i.e.",1150,445,10,2775
8+
Non-Official & Non-Aboriginal languages,Akan (Twi),13460,5985,25,22150
9+
Non-Official & Non-Aboriginal languages,Albanian,26895,13135,345,31930
10+
Aboriginal languages,"Algonquian languages, n.i.e.",45,10,0,120
11+
Aboriginal languages,Algonquin,1260,370,40,2480
12+
Non-Official & Non-Aboriginal languages,American Sign Language,2685,3020,1145,21930
13+
Non-Official & Non-Aboriginal languages,Amharic,22465,12785,200,33670
14+
Non-Official & Non-Aboriginal languages,Arabic,419890,223535,5585,629055
15+
Non-Official & Non-Aboriginal languages,Armenian,33460,21510,450,41295
16+
Non-Official & Non-Aboriginal languages,Assyrian Neo-Aramaic,16070,10510,205,19740
17+
Aboriginal languages,"Athabaskan languages, n.i.e.",50,10,0,85
18+
Aboriginal languages,Atikamekw,6150,5465,1100,6645
19+
Non-Official & Non-Aboriginal languages,"Austro-Asiatic languages, n.i.e",170,80,0,190
20+
Non-Official & Non-Aboriginal languages,"Austronesian languages, n.i.e.",4195,1160,35,5585
21+
Non-Official & Non-Aboriginal languages,Azerbaijani,3255,1245,25,5455
22+
Aboriginal languages,Babine (Wetsuwet'en),110,20,10,210
23+
Non-Official & Non-Aboriginal languages,Bamanankan,1535,345,0,3190
24+
Aboriginal languages,Beaver,190,50,0,340
25+
Non-Official & Non-Aboriginal languages,Belarusan,810,225,0,2265
26+
Non-Official & Non-Aboriginal languages,Bengali,73125,47350,525,91220
27+
Non-Official & Non-Aboriginal languages,"Berber languages, n.i.e.",8985,2615,15,12510
28+
Non-Official & Non-Aboriginal languages,Bikol,1785,290,0,2075
29+
Non-Official & Non-Aboriginal languages,Bilen,805,615,15,1085
30+
Aboriginal languages,Blackfoot,2815,1110,85,5645
31+
Non-Official & Non-Aboriginal languages,Bosnian,12215,6045,155,18265
32+
Non-Official & Non-Aboriginal languages,Bulgarian,20020,11985,200,22425
33+
Non-Official & Non-Aboriginal languages,Burmese,3585,2245,75,4995
34+
Non-Official & Non-Aboriginal languages,Cantonese,565270,400220,58820,699125
35+
Aboriginal languages,Carrier,1025,250,15,2100
36+
Non-Official & Non-Aboriginal languages,Catalan,870,350,30,2035
37+
Aboriginal languages,Cayuga,45,10,10,125
38+
Non-Official & Non-Aboriginal languages,Cebuano,19890,7205,70,27040
39+
Non-Official & Non-Aboriginal languages,"Celtic languages, n.i.e.",525,80,10,3595
40+
Non-Official & Non-Aboriginal languages,Chaldean Neo-Aramaic,5545,3445,35,7115
41+
Aboriginal languages,Chilcotin,655,255,15,1150
42+
Non-Official & Non-Aboriginal languages,"Chinese languages, n.i.e.",615,280,0,590
43+
Non-Official & Non-Aboriginal languages,"Chinese, n.o.s.",38580,23940,2935,41685
44+
Aboriginal languages,Comox,85,0,0,185
45+
Aboriginal languages,"Cree, n.o.s.",64050,37950,7800,86115
46+
Non-Official & Non-Aboriginal languages,"Creole languages, n.i.e.",4985,2005,15,16635
47+
Non-Official & Non-Aboriginal languages,"Creole, n.o.s.",64110,24570,310,133045
48+
Non-Official & Non-Aboriginal languages,Croatian,48200,16775,220,69835
49+
Non-Official & Non-Aboriginal languages,"Cushitic languages, n.i.e.",365,180,0,480
50+
Non-Official & Non-Aboriginal languages,Czech,22295,6235,70,28725
51+
Aboriginal languages,Dakota,1210,255,20,1760
52+
Non-Official & Non-Aboriginal languages,Danish,12630,855,85,15750
53+
Aboriginal languages,Dene,10700,7710,770,13060
54+
Non-Official & Non-Aboriginal languages,Dinka,2120,1130,0,2475
55+
Aboriginal languages,Dogrib (Tlicho),1650,1020,165,2375
56+
Non-Official & Non-Aboriginal languages,"Dravidian languages, n.i.e.",490,190,0,790
57+
Non-Official & Non-Aboriginal languages,Dutch,99015,9565,1165,120870
58+
Non-Official & Non-Aboriginal languages,Edo,1670,410,0,3220
59+
Official languages,English,19460850,22162865,15265335,29748265
60+
Non-Official & Non-Aboriginal languages,Estonian,5445,975,55,6070
61+
Non-Official & Non-Aboriginal languages,Ewe,1760,405,10,3000
62+
Non-Official & Non-Aboriginal languages,Fijian,745,195,0,1665
63+
Non-Official & Non-Aboriginal languages,Finnish,15295,2790,105,17590
64+
Official languages,French,7166700,6943800,3825215,10242945
65+
Non-Official & Non-Aboriginal languages,Frisian,2100,185,40,2910
66+
Non-Official & Non-Aboriginal languages,"Fulah (Pular, Pulaar, Fulfulde)",2825,825,0,4725
67+
Non-Official & Non-Aboriginal languages,Ga,920,250,0,2250
68+
Non-Official & Non-Aboriginal languages,Ganda,1295,345,25,2495
69+
Non-Official & Non-Aboriginal languages,Georgian,1710,1040,25,2150
70+
Non-Official & Non-Aboriginal languages,German,384040,120335,10065,502735
71+
Non-Official & Non-Aboriginal languages,"Germanic languages, n.i.e.",525,1630,725,8705
72+
Aboriginal languages,Gitxsan (Gitksan),880,315,10,1305
73+
Non-Official & Non-Aboriginal languages,Greek,106525,44550,1020,150965
74+
Non-Official & Non-Aboriginal languages,Gujarati,108780,64150,885,149045
75+
Aboriginal languages,Gwich'in,255,50,10,360
76+
Aboriginal languages,Haida,80,10,0,465
77+
Aboriginal languages,Haisla,90,20,0,175
78+
Non-Official & Non-Aboriginal languages,Haitian Creole,3030,1280,25,6855
79+
Non-Official & Non-Aboriginal languages,Hakka,10910,4085,70,12445
80+
Aboriginal languages,Halkomelem,480,50,20,1060
81+
Non-Official & Non-Aboriginal languages,Harari,1320,735,0,1715
82+
Non-Official & Non-Aboriginal languages,Hebrew,19530,8560,825,75020
83+
Aboriginal languages,Heiltsuk,100,5,10,125
84+
Non-Official & Non-Aboriginal languages,Hiligaynon,6880,2210,25,7925
85+
Non-Official & Non-Aboriginal languages,Hindi,110645,55510,1405,433365
86+
Non-Official & Non-Aboriginal languages,Hmong-Mien languages,795,335,10,870
87+
Non-Official & Non-Aboriginal languages,Hungarian,61235,19480,440,71285
88+
Non-Official & Non-Aboriginal languages,Icelandic,1285,270,0,1780
89+
Non-Official & Non-Aboriginal languages,Igbo,4235,1000,10,8855
90+
Non-Official & Non-Aboriginal languages,Ilocano,26345,9125,110,34530
91+
Non-Official & Non-Aboriginal languages,"Indo-Iranian languages, n.i.e.",5185,2380,20,8870
92+
Aboriginal languages,Inuinnaqtun (Inuvialuktun),1020,165,30,1975
93+
Aboriginal languages,"Inuit languages, n.i.e.",310,90,15,470
94+
Aboriginal languages,Inuktitut,35210,29230,8795,40620
95+
Aboriginal languages,"Iroquoian languages, n.i.e.",35,5,0,115
96+
Non-Official & Non-Aboriginal languages,Italian,375635,115415,1705,574725
97+
Non-Official & Non-Aboriginal languages,"Italic (Romance) languages, n.i.e.",720,175,25,2680
98+
Non-Official & Non-Aboriginal languages,Japanese,43640,19785,3255,83095
99+
Non-Official & Non-Aboriginal languages,Kabyle,13150,5490,15,17120
100+
Non-Official & Non-Aboriginal languages,Kannada,3970,1630,10,8245
101+
Non-Official & Non-Aboriginal languages,Karenic languages,4705,3860,135,4895
102+
Non-Official & Non-Aboriginal languages,Kashmiri,565,135,0,905
103+
Aboriginal languages,Kaska (Nahani),180,20,10,365
104+
Non-Official & Non-Aboriginal languages,Khmer (Cambodian),20130,10885,475,27035
105+
Non-Official & Non-Aboriginal languages,Kinyarwanda (Rwanda),5250,1530,25,7860
106+
Non-Official & Non-Aboriginal languages,Konkani,3330,720,10,6790
107+
Non-Official & Non-Aboriginal languages,Korean,153425,109705,12150,172750
108+
Non-Official & Non-Aboriginal languages,Kurdish,11705,6580,185,15290
109+
Aboriginal languages,Kutenai,110,10,0,170
110+
Aboriginal languages,Kwakiutl (Kwak'wala),325,25,15,605
111+
Non-Official & Non-Aboriginal languages,Lao,12670,6175,150,17235
112+
Non-Official & Non-Aboriginal languages,Latvian,5450,1255,35,6500
113+
Aboriginal languages,Lillooet,315,25,15,790
114+
Non-Official & Non-Aboriginal languages,Lingala,3805,1045,10,17010
115+
Non-Official & Non-Aboriginal languages,Lithuanian,7075,2015,60,8185
116+
Non-Official & Non-Aboriginal languages,Macedonian,16770,6830,95,23075
117+
Non-Official & Non-Aboriginal languages,Malagasy,1430,430,0,2340
118+
Non-Official & Non-Aboriginal languages,Malay,12275,3625,140,22470
119+
Non-Official & Non-Aboriginal languages,Malayalam,28565,15440,95,37810
120+
Aboriginal languages,Malecite,300,55,10,760
121+
Non-Official & Non-Aboriginal languages,Maltese,5565,1125,25,7625
122+
Non-Official & Non-Aboriginal languages,Mandarin,592040,462890,60090,814450
123+
Non-Official & Non-Aboriginal languages,Marathi,8295,3780,30,15565
124+
Aboriginal languages,Mi'kmaq,6690,3565,915,9025
125+
Aboriginal languages,Michif,465,80,10,1210
126+
Non-Official & Non-Aboriginal languages,Min Dong,1230,345,30,1045
127+
Non-Official & Non-Aboriginal languages,"Min Nan (Chaochow, Teochow, Fukien, Taiwanese)",31800,13965,565,42840
128+
Aboriginal languages,Mohawk,985,255,30,2415
129+
Non-Official & Non-Aboriginal languages,Mongolian,1575,905,10,2095
130+
Aboriginal languages,Montagnais (Innu),10235,8585,2055,11445
131+
Aboriginal languages,Moose Cree,105,10,0,195
132+
Aboriginal languages,Naskapi,1205,1195,370,1465
133+
Non-Official & Non-Aboriginal languages,Nepali,18275,13375,195,21385
134+
Non-Official & Non-Aboriginal languages,"Niger-Congo languages, n.i.e.",19135,4010,30,40760
135+
Non-Official & Non-Aboriginal languages,"Nilo-Saharan languages, n.i.e.",3750,1520,0,4550
136+
Aboriginal languages,Nisga'a,400,75,10,1055
137+
Aboriginal languages,North Slavey (Hare),765,340,95,1005
138+
Aboriginal languages,Northern East Cree,315,110,35,550
139+
Aboriginal languages,Northern Tutchone,220,30,0,280
140+
Non-Official & Non-Aboriginal languages,Norwegian,4615,350,70,8120
141+
Aboriginal languages,Nuu-chah-nulth (Nootka),280,30,10,560
142+
Aboriginal languages,Oji-Cree,12855,7905,1080,15605
143+
Aboriginal languages,Ojibway,17885,6175,765,28580
144+
Aboriginal languages,Okanagan,275,80,20,820
145+
Aboriginal languages,Oneida,60,15,0,185
146+
Non-Official & Non-Aboriginal languages,Oriya (Odia),1055,475,0,1530
147+
Non-Official & Non-Aboriginal languages,Oromo,4960,3410,45,6245
148+
Non-Official & Non-Aboriginal languages,"Other languages, n.i.e.",3685,1110,80,9730
149+
Aboriginal languages,Ottawa (Odawa),150,75,0,205
150+
Non-Official & Non-Aboriginal languages,"Pampangan (Kapampangan, Pampango)",4045,1200,10,5425
151+
Non-Official & Non-Aboriginal languages,Pangasinan,1390,240,0,1800
152+
Non-Official & Non-Aboriginal languages,Pashto,16905,10590,50,23180
153+
Non-Official & Non-Aboriginal languages,Persian (Farsi),214200,143025,4580,252325
154+
Aboriginal languages,Plains Cree,3065,1345,95,5905
155+
Non-Official & Non-Aboriginal languages,Polish,181710,74780,2495,214965
156+
Non-Official & Non-Aboriginal languages,Portuguese,221535,98710,7485,295955
157+
Non-Official & Non-Aboriginal languages,Punjabi (Panjabi),501680,349140,27865,668240
158+
Non-Official & Non-Aboriginal languages,Quebec Sign Language,695,730,130,4665
159+
Non-Official & Non-Aboriginal languages,Romanian,96660,53325,745,115050
160+
Non-Official & Non-Aboriginal languages,Rundi (Kirundi),5850,2110,0,8590
161+
Non-Official & Non-Aboriginal languages,Russian,188255,116595,4855,269645
162+
Aboriginal languages,"Salish languages, n.i.e.",260,25,0,560
163+
Aboriginal languages,Sarsi (Sarcee),80,10,0,145
164+
Non-Official & Non-Aboriginal languages,Scottish Gaelic,1090,190,15,3980
165+
Aboriginal languages,Sekani,85,15,0,185
166+
Non-Official & Non-Aboriginal languages,"Semitic languages, n.i.e.",2150,1205,65,3220
167+
Non-Official & Non-Aboriginal languages,Serbian,57350,31750,530,73780
168+
Non-Official & Non-Aboriginal languages,Serbo-Croatian,9550,3890,30,11275
169+
Non-Official & Non-Aboriginal languages,Shona,3185,1035,0,5430
170+
Aboriginal languages,Shuswap (Secwepemctsin),445,50,35,1305
171+
Non-Official & Non-Aboriginal languages,"Sign languages, n.i.e",4125,6690,645,22280
172+
Non-Official & Non-Aboriginal languages,Sindhi,11860,4975,35,20260
173+
Non-Official & Non-Aboriginal languages,Sinhala (Sinhalese),16335,7790,40,27825
174+
Aboriginal languages,"Siouan languages, n.i.e.",55,20,0,140
175+
Aboriginal languages,"Slavey, n.o.s.",280,105,10,675
176+
Non-Official & Non-Aboriginal languages,"Slavic languages, n.i.e.",2420,670,10,2995
177+
Non-Official & Non-Aboriginal languages,Slovak,17580,5610,100,21470
178+
Non-Official & Non-Aboriginal languages,Slovene (Slovenian),9785,2055,15,11490
179+
Non-Official & Non-Aboriginal languages,Somali,36755,22895,220,49660
180+
Aboriginal languages,South Slavey,945,370,35,1365
181+
Aboriginal languages,Southern East Cree,45,15,0,40
182+
Aboriginal languages,Southern Tutchone,70,5,0,145
183+
Non-Official & Non-Aboriginal languages,Spanish,458850,263505,13030,995260
184+
Aboriginal languages,Squamish,40,5,10,285
185+
Aboriginal languages,Stoney,3025,1950,240,3675
186+
Aboriginal languages,Straits,80,25,15,365
187+
Non-Official & Non-Aboriginal languages,Swahili,13370,5370,80,38685
188+
Aboriginal languages,Swampy Cree,1440,330,10,2350
189+
Non-Official & Non-Aboriginal languages,Swedish,6840,1050,125,14140
190+
Non-Official & Non-Aboriginal languages,"Tagalog (Pilipino, Filipino)",431385,213790,3450,612735
191+
Aboriginal languages,Tahltan,95,5,0,265
192+
Non-Official & Non-Aboriginal languages,"Tai-Kadai languages, n.i.e",85,30,0,115
193+
Non-Official & Non-Aboriginal languages,Tamil,140720,96955,2085,189860
194+
Non-Official & Non-Aboriginal languages,Telugu,15660,8280,40,23165
195+
Non-Official & Non-Aboriginal languages,Thai,9255,3365,525,15395
196+
Aboriginal languages,Thompson (Ntlakapamux),335,20,0,450
197+
Non-Official & Non-Aboriginal languages,Tibetan,6160,4590,50,7050
198+
Non-Official & Non-Aboriginal languages,"Tibeto-Burman languages, n.i.e.",1405,655,15,2380
199+
Non-Official & Non-Aboriginal languages,Tigrigna,16645,10205,130,21340
200+
Aboriginal languages,Tlingit,95,0,10,260
201+
Aboriginal languages,Tsimshian,200,30,10,410
202+
Non-Official & Non-Aboriginal languages,"Turkic languages, n.i.e.",1315,455,10,1875
203+
Non-Official & Non-Aboriginal languages,Turkish,32815,18955,690,50770
204+
Non-Official & Non-Aboriginal languages,Ukrainian,102485,28250,1210,132115
205+
Non-Official & Non-Aboriginal languages,"Uralic languages, n.i.e.",10,5,0,25
206+
Non-Official & Non-Aboriginal languages,Urdu,210815,128785,1495,322220
207+
Non-Official & Non-Aboriginal languages,Uyghur,1035,610,20,1390
208+
Non-Official & Non-Aboriginal languages,Uzbek,1720,995,15,2465
209+
Non-Official & Non-Aboriginal languages,Vietnamese,156430,104245,8075,198895
210+
Non-Official & Non-Aboriginal languages,Vlaams (Flemish),3895,355,35,4400
211+
Aboriginal languages,"Wakashan languages, n.i.e.",10,0,0,25
212+
Non-Official & Non-Aboriginal languages,Waray-Waray,1110,310,0,1395
213+
Non-Official & Non-Aboriginal languages,Welsh,1075,95,0,1695
214+
Non-Official & Non-Aboriginal languages,Wolof,3990,1385,10,8240
215+
Aboriginal languages,Woods Cree,1840,800,75,2665
216+
Non-Official & Non-Aboriginal languages,Wu (Shanghainese),12915,7650,105,16530
217+
Non-Official & Non-Aboriginal languages,Yiddish,13555,7085,895,20985
218+
Non-Official & Non-Aboriginal languages,Yoruba,9080,2615,15,22415

0 commit comments

Comments
 (0)