The script in main.py creates a datacompy comparison report between two hypothetical sets of data. It's intended for use in a testing/dev environment and for demo purposes only.
- Navigate and Initialize the poetry project & install dependencies
cd data_comparison_demo
poetry init
poetry install- Run the script
poetry shell
python main.py- View the results that can be found in the reports folder.
- Only general errors are being caught.
- The project is not dockerized.
- Storage optimizations (.parquet VS .CSV files).
- Handle dynamic file's being read in.
- Additional automations.