-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathindex.html
More file actions
563 lines (527 loc) · 40.6 KB
/
index.html
File metadata and controls
563 lines (527 loc) · 40.6 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>Victor Antoniassi | Data Engineer & Analytics Engineer Portfolio</title>
<script src="https://cdn.tailwindcss.com"></script>
<link rel="preconnect" href="https://fonts.googleapis.com">
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
<link href="https://fonts.googleapis.com/css2?family=JetBrains+Mono:ital,wght@0,400;0,700;1,400&display=swap" rel="stylesheet">
<link rel="stylesheet" href="https://cdn.jsdelivr.net/gh/devicons/devicon@latest/devicon.min.css">
<style>
body {
font-family: 'JetBrains Mono', monospace;
}
</style>
</head>
<body class="bg-[#11111b] text-[#cdd6f4] antialiased">
<main class="container mx-auto max-w-4xl px-4 py-12 md:py-20">
<header class="flex flex-col md:flex-row md:items-center justify-between mb-12">
<div>
<h1 class="text-4xl md:text-5xl font-bold text-[#f5c2e7]">Data Engineering Portfolio</h1>
<p class="text-xl text-[#a6adc8] mt-2">Data Engineering, BI & Analytics Projects</p>
<div class="flex flex-wrap gap-4 mt-4">
<a href="https://www.linkedin.com/in/victorantoniassi/" target="_blank" rel="noopener noreferrer" class="flex items-center text-[#89b4fa] hover:text-[#b4befe] transition-colors" title="LinkedIn">
<svg xmlns="http://www.w3.org/2000/svg" class="h-6 w-6 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M4 4m0 2a2 2 0 0 1 2 -2h12a2 2 0 0 1 2 2v12a2 2 0 0 1 -2 2h-12a2 2 0 0 1 -2 -2z"></path>
<path d="M8 11l0 5"></path>
<path d="M8 8l0 .01"></path>
<path d="M12 16l0 -5"></path>
<path d="M16 16v-3a2 2 0 0 0 -4 0"></path>
</svg>
LinkedIn
</a>
<a href="https://github.com/victor-antoniassi" target="_blank" rel="noopener noreferrer" class="flex items-center text-[#89b4fa] hover:text-[#b4befe] transition-colors" title="GitHub">
<svg xmlns="http://www.w3.org/2000/svg" class="h-6 w-6 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M9 19c-4.3 1.4 -4.3 -2.5 -6 -3m12 5v-3.5c0 -1 .1 -1.4 -.5 -2c2.8 -.3 5.5 -1.4 5.5 -6a4.6 4.6 0 0 0 -1.3 -3.2a4.2 4.2 0 0 0 -.1 -3.2s-1.1 -.3 -3.5 1.3a12.3 12.3 0 0 0 -6.2 0c-2.4 -1.6 -3.5 -1.3 -3.5 -1.3a4.2 4.2 0 0 0 -.1 3.2a4.6 4.6 0 0 0 -1.3 3.2c0 4.6 2.7 5.7 5.5 6c-.6 .6 -.6 1.2 -.5 2v3.5"></path>
</svg>
GitHub
</a>
<a href="mailto:victor@antoniassi.xyz" class="flex items-center text-[#89b4fa] hover:text-[#b4befe] transition-colors" title="Email">
<svg xmlns="http://www.w3.org/2000/svg" class="h-6 w-6 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M3 7a2 2 0 0 1 2 -2h14a2 2 0 0 1 2 2v10a2 2 0 0 1 -2 2h-14a2 2 0 0 1 -2 -2v-10z"></path>
<path d="M3 7l9 6l9 -6"></path>
</svg>
Email
</a>
<a href="https://drive.google.com/file/d/1JynaV5-jUpg5EHnsM75rKxR3jR0IbR8B" target="_blank" rel="noopener noreferrer" class="flex items-center text-[#89b4fa] hover:text-[#b4befe] transition-colors" title="Resume">
<svg xmlns="http://www.w3.org/2000/svg" class="h-6 w-6 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M14 3v4a1 1 0 0 0 1 1h4"></path>
<path d="M17 21h-10a2 2 0 0 1 -2 -2v-14a2 2 0 0 1 2 -2h7l5 5v11a2 2 0 0 1 -2 2z"></path>
<path d="M9 9l1 0"></path>
<path d="M9 13l6 0"></path>
<path d="M9 17l6 0"></path>
</svg>
Resume
</a>
</div>
</div>
</header>
<section class="bg-[#181825] p-8 rounded-md shadow-md mb-12">
<h2 class="text-3xl font-bold text-[#f5c2e7] mb-4 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-8 w-8 mr-3 text-[#f5c2e7]" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M12 12m-9 0a9 9 0 1 0 18 0a9 9 0 1 0 -18 0"></path>
<path d="M12 10m-3 0a3 3 0 1 0 6 0a3 3 0 1 0 -6 0"></path>
<path d="M6.168 18.849a4 4 0 0 1 3.832 -2.849h4a4 4 0 0 1 3.832 2.849"></path>
</svg>
About
</h2>
<p class="text-[#cdd6f4] leading-relaxed">
I'm Victor, a Data/Analytics Engineer specializing in building scalable data pipelines and lakehouse solutions. I've implemented Medallion Architecture in Databricks, orchestrated ETL/ELT pipelines with dbt and Airflow, and delivered data products that empower business teams.
<br><br>
My tech stack includes <strong class="text-[#89b4fa]">Python, PySpark, SQL, dbt, Azure, and Databricks</strong>. This portfolio highlights some of my side projects and technical explorations.
</p>
</section>
<section class="bg-[#181825] p-8 rounded-md shadow-md mb-12">
<h2 class="text-3xl font-bold text-[#f5c2e7] mb-4 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-8 w-8 mr-3 text-[#f5c2e7]" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M4 13a8 8 0 0 1 7 7a6 6 0 0 0 3 -5a9 9 0 0 0 6 -8a3 3 0 0 0 -3 -3a9 9 0 0 0 -8 6a6 6 0 0 0 -5 3"></path>
<path d="M7 14a6 6 0 0 1 -3 6a6 6 0 0 1 -6 -3"></path>
<path d="M15 9m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
</svg>
Latest Project
</h2>
<a href="#project-postgres-cdc" class="text-2xl font-bold text-[#89b4fa] hover:underline">
Postgres to Databricks CDC Pipeline
</a>
<p class="text-[#cdd6f4] leading-relaxed mt-4">
A high-performance Data Ingestion Project built with the Python dlt library. It is designed to move data from PostgreSQL to Databricks using CDC (Change Data Capture) for efficient synchronization. Orchestrated natively by Databricks Lakeflow Jobs, this project serves as a robust blueprint for enterprise data replication.
</p>
</section>
<section class="mb-12">
<h2 class="text-3xl font-bold text-[#f5c2e7] mb-6 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-8 w-8 mr-3 text-[#f5c2e7]" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M3 7m0 2a2 2 0 0 1 2 -2h14a2 2 0 0 1 2 2v9a2 2 0 0 1 -2 2h-14a2 2 0 0 1 -2 -2z"></path>
<path d="M8 7v-2a2 2 0 0 1 2 -2h4a2 2 0 0 1 2 2v2"></path>
<path d="M12 12l0 .01"></path>
<path d="M3 13a20 20 0 0 0 18 0"></path>
</svg>
Technical Assessment Projects
</h2>
<p class="text-[#a6adc8] mb-6">Projects developed as part of technical assessment processes, demonstrating comprehensive problem-solving abilities and technical skills.</p>
<div class="space-y-8">
<article class="bg-[#181825] p-6 rounded-md shadow-md">
<header class="mb-4">
<h3 class="text-2xl font-bold text-[#89b4fa] hover:underline">
<a href="https://github.com/victor-antoniassi/junior_data_analyst_test_01" target="_blank">1. Video Game Sales</a>
</h3>
<p class="text-sm text-[#a6adc8] mt-1 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-4 w-4 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M4 5m0 2a2 2 0 0 1 2 -2h12a2 2 0 0 1 2 2v12a2 2 0 0 1 -2 2h-12a2 2 0 0 1 -2 -2z"></path>
<path d="M16 3l0 4"></path>
<path d="M8 3l0 4"></path>
<path d="M4 11l16 0"></path>
<path d="M8 15h2v2h-2z"></path>
</svg>
Data Analyst position, September 2024
</p>
</header>
<p class="text-[#cdd6f4] mb-4">A project that analyzes video game sales data to evaluate gaming partnership opportunities.</p>
<div class="mb-4">
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M3.5 5.5l1.5 1.5l2.5 -2.5"></path>
<path d="M3.5 11.5l1.5 1.5l2.5 -2.5"></path>
<path d="M3.5 17.5l1.5 1.5l2.5 -2.5"></path>
<path d="M11 6l9 0"></path>
<path d="M11 12l9 0"></path>
<path d="M11 18l9 0"></path>
</svg>
Features
</h4>
<ul class="list-disc list-inside text-[#cdd6f4] text-sm space-y-1">
<li>Data extraction automation</li>
<li>Data preparation and cleaning</li>
<li>Regional sales analysis</li>
<li>Genre market share calculation</li>
<li>Platform performance tracking</li>
</ul>
</div>
<div class="mb-4">
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M7 10l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M17 4l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M21 10l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M10 7l-4 4l4 4l4 -4l-4 -4z"></path>
</svg>
Tech Stack
</h4>
<div class="flex flex-wrap gap-2">
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-python-plain text-lg align-middle mr-1.5"></i>Python
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-duckdb-plain text-lg align-middle mr-1.5"></i>DuckDB
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-prefect-plain text-lg align-middle mr-1.5"></i>Prefect
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-pandas-plain text-lg align-middle mr-1.5"></i>Pandas
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">wget</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-jupyter-plain text-lg align-middle mr-1.5"></i>Jupyter
</span>
</div>
</div>
<div>
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M5 5m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M19 5m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M5 19m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M19 19m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M5 7l0 10"></path>
<path d="M19 7l0 10"></path>
<path d="M7 5l10 0"></path>
<path d="M7 19l10 0"></path>
<path d="M9 12l0 2.5m2 0l0 2.5m2 0l0 -2.5m-2 -2.5l0 -2.5m-2 0l-2 0m6 0l2 0"></path>
</svg>
Skills Applied
</h4>
<div class="flex flex-wrap gap-2">
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">Data/file extraction</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">Data preparation</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">SQL analysis</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">Data workflow orchestration</span>
</div>
</div>
</article>
<article class="bg-[#181825] p-6 rounded-md shadow-md">
<header class="mb-4">
<h3 class="text-2xl font-bold text-[#89b4fa] hover:underline">
<a href="https://github.com/victor-antoniassi/junior_analytics_engineer_test_01" target="_blank">2. School Supplies Market</a>
</h3>
<p class="text-sm text-[#a6adc8] mt-1 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-4 w-4 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M4 5m0 2a2 2 0 0 1 2 -2h12a2 2 0 0 1 2 2v12a2 2 0 0 1 -2 2h-12a2 2 0 0 1 -2 -2z"></path>
<path d="M16 3l0 4"></path>
<path d="M8 3l0 4"></path>
<path d="M4 11l16 0"></path>
<path d="M8 15h2v2h-2z"></path>
</svg>
Analytics Engineer position, March 2024
</p>
</header>
<p class="text-[#cdd6f4] mb-4">A data preparation project focusing on standardizing and integrating e-commerce school supplies sales data for planning purposes.</p>
<div class="mb-4">
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M3.5 5.5l1.5 1.5l2.5 -2.5"></path>
<path d="M3.5 11.5l1.5 1.5l2.5 -2.5"></path>
<path d="M3.5 17.5l1.5 1.5l2.5 -2.5"></path>
<path d="M11 6l9 0"></path>
<path d="M11 12l9 0"></path>
<path d="M11 18l9 0"></path>
</svg>
Features
</h4>
<ul class="list-disc list-inside text-[#cdd6f4] text-sm space-y-1">
<li>Automated header validation system</li>
<li>Data quality analysis and standardization</li>
<li>SQLite database implementation</li>
</ul>
</div>
<div class="mb-4">
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M7 10l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M17 4l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M21 10l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M10 7l-4 4l4 4l4 -4l-4 -4z"></path>
</svg>
Tech Stack
</h4>
<div class="flex flex-wrap gap-2">
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-python-plain text-lg align-middle mr-1.5"></i>Python
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-sqlite-plain text-lg align-middle mr-1.5"></i>SQLite
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-pandas-plain text-lg align-middle mr-1.5"></i>Pandas
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-google-plain text-lg align-middle mr-1.5"></i>Google Sheets
</span>
</div>
</div>
<div>
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M5 5m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M19 5m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M5 19m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M19 19m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M5 7l0 10"></path>
<path d="M19 7l0 10"></path>
<path d="M7 5l10 0"></path>
<path d="M7 19l10 0"></path>
<path d="M9 12l0 2.5m2 0l0 2.5m2 0l0 -2.5m-2 -2.5l0 -2.5m-2 0l-2 0m6 0l2 0"></path>
</svg>
Skills Applied
</h4>
<div class="flex flex-wrap gap-2">
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">Data preparation and cleaning</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">Database operations</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">ETL processes</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">Business analytics</span>
</div>
</div>
</article>
</div>
</section>
<section class="mb-12">
<h2 class="text-3xl font-bold text-[#f5c2e7] mb-6 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-8 w-8 mr-3 text-[#f5c2e7]" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M15 12h.01"></path>
<path d="M12 12h.01"></path>
<path d="M9 12h.01"></path>
<path d="M6 19a2 2 0 0 1 -2 -2v-4l-1 -1l1 -1v-4a2 2 0 0 1 2 -2"></path>
<path d="M18 19a2 2 0 0 0 2 -2v-4l1 -1l-1 -1v-4a2 2 0 0 0 -2 -2"></path>
</svg>
Code Snippets & Practice Projects
</h2>
<p class="text-[#a6adc8] mb-6">Smaller-scale projects and code examples showcasing specific technical skills and tools implementation.</p>
<div class="space-y-8">
<article class="bg-[#181825] p-6 rounded-md shadow-md">
<header class="mb-4">
<h3 class="text-2xl font-bold text-[#89b4fa] hover:underline">
<a href="https://github.com/victor-antoniassi/coinmarketcap_api_to_duckdb" target="_blank">1. Cryptocurrencies Quotes</a>
</h3>
</header>
<p class="text-[#cdd6f4] mb-4">An EL (Extract, Load) pipeline that fetches market data (price, volume, market cap) for BTC, ETH, and LTC from CoinMarketCap API and stores it in DuckDB.</p>
<div class="mb-4">
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M3.5 5.5l1.5 1.5l2.5 -2.5"></path>
<path d="M3.5 11.5l1.5 1.5l2.5 -2.5"></path>
<path d="M3.5 17.5l1.5 1.5l2.5 -2.5"></path>
<path d="M11 6l9 0"></path>
<path d="M11 12l9 0"></path>
<path d="M11 18l9 0"></path>
</svg>
Features
</h4>
<ul class="list-disc list-inside text-[#cdd6f4] text-sm space-y-1">
<li>Automated data extraction from CoinMarketCap API</li>
<li>Error handling and logging system</li>
<li>Data storage in DuckDB database</li>
</ul>
</div>
<div class="mb-4">
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M7 10l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M17 4l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M21 10l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M10 7l-4 4l4 4l4 -4l-4 -4z"></path>
</svg>
Tech Stack
</h4>
<div class="flex flex-wrap gap-2">
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-python-plain text-lg align-middle mr-1.5"></i>Python
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">dlt</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-duckdb-plain text-lg align-middle mr-1.5"></i>DuckDB
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">CoinMarketCap API</span>
</div>
</div>
<div>
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M5 5m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M19 5m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M5 19m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M19 19m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M5 7l0 10"></path>
<path d="M19 7l0 10"></path>
<path d="M7 5l10 0"></path>
<path d="M7 19l10 0"></path>
<path d="M9 12l0 2.5m2 0l0 2.5m2 0l0 -2.5m-2 -2.5l0 -2.5m-2 0l-2 0m6 0l2 0"></path>
</svg>
Skills Applied
</h4>
<div class="flex flex-wrap gap-2">
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">API integration</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">Data pipeline development</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">SQL querying</span>
</div>
</div>
</article>
<article class="bg-[#181825] p-6 rounded-md shadow-md">
<header class="mb-4">
<h3 class="text-2xl font-bold text-[#89b4fa] hover:underline">
<a href="https://github.com/victor-antoniassi/day-1_sales_data_generator" target="_blank">2. Chinook Sales Simulator</a>
</h3>
</header>
<p class="text-[#cdd6f4] mb-4">Turns the static Chinook dataset into a living, chaotic OLTP simulator. It generates not just new sales (INSERTs), but also simulates data corrections (UPDATEs) and cancellations (DELETEs), creating a real-world data source for testing advanced pipelines (CDC, SCD Type 2).</p>
<div class="mb-4">
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M3.5 5.5l1.5 1.5l2.5 -2.5"></path>
<path d="M3.5 11.5l1.5 1.5l2.5 -2.5"></path>
<path d="M3.5 17.5l1.5 1.5l2.5 -2.5"></path>
<path d="M11 6l9 0"></path>
<path d="M11 12l9 0"></path>
<path d="M11 18l9 0"></path>
</svg>
Features
</h4>
<ul class="list-disc list-inside text-[#cdd6f4] text-sm space-y-1">
<li>Simulates the full data lifecycle: INSERT, UPDATE, and DELETE</li>
<li>Models UPDATEs/DELETEs as late-arriving changes within a 90-day window</li>
<li>Ensures ACID compliance (all-or-nothing) for each D-1 batch</li>
<li>Includes a verification script to audit simulation logs against the DB state</li>
</ul>
</div>
<div class="mb-4">
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M7 10l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M17 4l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M21 10l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M10 7l-4 4l4 4l4 -4l-4 -4z"></path>
</svg>
Tech Stack
</h4>
<div class="flex flex-wrap gap-2">
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-python-plain text-lg align-middle mr-1.5"></i>Python
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-postgresql-plain text-lg align-middle mr-1.5"></i>PostgreSQL
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">Neon</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">uv</span>
</div>
</div>
<div>
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M5 5m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M19 5m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M5 19m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M19 19m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M5 7l0 10"></path>
<path d="M19 7l0 10"></path>
<path d="M7 5l10 0"></path>
<path d="M7 19l10 0"></path>
<path d="M9 12l0 2.5m2 0l0 2.5m2 0l0 -2.5m-2 -2.5l0 -2.5m-2 0l-2 0m6 0l2 0"></path>
</svg>
Skills Applied
</h4>
<div class="flex flex-wrap gap-2">
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">Data Generation</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">SQL Functions</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">System Automation</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">CLI Integration</span>
</div>
</div>
</article>
<article id="project-postgres-cdc" class="bg-[#181825] p-6 rounded-md shadow-md">
<header class="mb-4">
<h3 class="text-2xl font-bold text-[#89b4fa] hover:underline">
<a href="https://github.com/victor-antoniassi/postgres-to-databricks-cdc/" target="_blank">3. Postgres to Databricks CDC Pipeline</a>
</h3>
</header>
<p class="text-[#cdd6f4] mb-4">A high-performance Data Ingestion Project built with the Python dlt library, moving data from PostgreSQL to Databricks using CDC for efficient synchronization.</p>
<div class="mb-4">
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M3.5 5.5l1.5 1.5l2.5 -2.5"></path>
<path d="M3.5 11.5l1.5 1.5l2.5 -2.5"></path>
<path d="M3.5 17.5l1.5 1.5l2.5 -2.5"></path>
<path d="M11 6l9 0"></path>
<path d="M11 12l9 0"></path>
<path d="M11 18l9 0"></path>
</svg>
Features
</h4>
<ul class="list-disc list-inside text-[#cdd6f4] text-sm space-y-1">
<li>High-performance ingestion using Python dlt</li>
<li>Change Data Capture (CDC) synchronization</li>
<li>PostgreSQL to Databricks replication</li>
<li>Orchestration via Databricks Lakeflow Jobs</li>
</ul>
</div>
<div class="mb-4">
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M7 10l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M17 4l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M21 10l-4 4l4 4l4 -4l-4 -4z"></path>
<path d="M10 7l-4 4l4 4l4 -4l-4 -4z"></path>
</svg>
Tech Stack
</h4>
<div class="flex flex-wrap gap-2">
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-python-plain text-lg align-middle mr-1.5"></i>Python
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">dlt</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">
<i class="devicon-postgresql-plain text-lg align-middle mr-1.5"></i>PostgreSQL
</span>
<span class="flex items-center bg-[#89b4fa]/10 text-[#89b4fa] text-xs font-bold px-3 py-1 rounded-sm">Databricks</span>
</div>
</div>
<div>
<h4 class="font-bold text-[#f5c2e7] mb-2 flex items-center">
<svg xmlns="http://www.w3.org/2000/svg" class="h-5 w-5 mr-2" width="24" height="24" viewBox="0 0 24 24" stroke-width="2" stroke="currentColor" fill="none" stroke-linecap="round" stroke-linejoin="round">
<path stroke="none" d="M0 0h24v24H0z" fill="none"></path>
<path d="M5 5m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M19 5m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M5 19m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M19 19m-1 0a1 1 0 1 0 2 0a1 1 0 1 0 -2 0"></path>
<path d="M5 7l0 10"></path>
<path d="M19 7l0 10"></path>
<path d="M7 5l10 0"></path>
<path d="M7 19l10 0"></path>
<path d="M9 12l0 2.5m2 0l0 2.5m2 0l0 -2.5m-2 -2.5l0 -2.5m-2 0l-2 0m6 0l2 0"></path>
</svg>
Skills Applied
</h4>
<div class="flex flex-wrap gap-2">
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">CDC / Data Replication</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">Data Ingestion</span>
<span class="bg-[#a6e3a1]/10 text-[#a6e3a1] text-xs font-bold px-3 py-1 rounded-sm">Lakeflow Orchestration</span>
</div>
</div>
</article>
</div>
</section>
</main>
</body>
</html>