Data Engineering & Automation, 2024
Data Cleaning Application
A Python tool that cleans CSV and Excel datasets: backs up and removes duplicates, handles missing values and exports clean data.
The problem
The same cleaning steps are repeated at the start of every analysis. Automating them saves time and keeps duplicates recoverable.
What it does
- Validates input format (CSV or Excel) before processing.
- Saves duplicate rows to a separate backup file before removing them.
- Fills numeric gaps with the column mean; drops rows missing non-numeric values.
- Tested on datasets of more than 10,000 rows.
Built with
- Python
- Pandas
- NumPy
- openpyxl