Data Download¶

Contains classes and methods to create the input file structure and download the required data The program parses from the download_config.py file Currently leverages gdown library (https://pypi.org/project/gdown/) to download large files from Google drive Main Function parses from the download_config.py file and downloads the input, output and support files for the corresponding case study and then places them in a pre-specified file structure to be used for model training, deployment and data study

class dlmfg.core.data_download.DataDownload(base_url, download_type, download_flag=0)[source]¶

Data Download Class

Parameters

base_url (str (required)) – consists of the base URL of the server file location
download_type (str (required)) – Type of download, currently Google drive is used host the data files
download_flag (int) – used to store the number of downloads done using one instance of the Data Download class, can be used to ensure Quality Checks on the downloaded data

google_drive_downloader(file_id, output)[source]¶

google_drive_downloader combines object initialization with the file ID to download to the desired output file

Parameters

file_id (str (required)) – Server file ID of the file to be downloaded
output (str (required)) – output path of the downloaded file