Skip to content

tkorba1/databricks_assigment

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Databricks Assignment

Project Description

This project involves processing and transforming data using PySpark. The data is read from a Parquet file, transformed using window functions, and then saved as a table in Parquet format.

Execution

solution/run.py - main program solution/DataProcessor.py - class for data processing solution/quick_and_dirty - databricks notebook for quick solution

tests - folder with tests

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages