import pytz
import os
from datetime import datetime
now = datetime.now(tz=pytz.timezone("Asia/Jakarta"))
now = now.strftime("%Y%m%d.%H%M")
os.environ["DATASET_VERSION"] = now
print("Updating dataset on Kaggle with version: {}".format(now))
Updating dataset on Kaggle with version: 20220817.1301
%%bash
python last_retrieved_trending.py
2022-08-17 06:01:38,790 __main__ [INFO] trending data: ./data/trending.csv
2022-08-17 06:01:45,029 __main__ [INFO] Loaded data: ./data/trending.csv
2022-08-17 06:01:49,494 __main__ [INFO] Last 5 retrieval dates: 20220812, 20220813, 20220814, 20220815, 20220816
sys:1: DtypeWarning: Columns (0,5) have mixed types.Specify dtype option on import or set low_memory=False.
%%bash
python main.py
2022-08-17 06:01:50,435 main [INFO] Start retrieving indonesia youtube trending videos
2022-08-17 06:01:52,089 main [INFO] Got total 200 trending videos
2022-08-17 06:01:58,364 main [INFO] Done saving 200 trending videos (./data/trending.csv). Total videos: 99951
sys:1: DtypeWarning: Columns (0,5) have mixed types.Specify dtype option on import or set low_memory=False.
%%bash
kaggle datasets version -p ./data -m "$DATASET_VERSION"
Warning: Your Kaggle API key is readable by other users on this system! To fix this, you can run 'chmod 600 ./kaggle.json'
Starting upload for file trending.csv
100%|██████████| 240M/240M [01:45<00:00, 2.39MB/s]
Upload successful: trending.csv (240MB)
Starting upload for file category.json
100%|██████████| 7.67k/7.67k [00:00<00:00, 17.3kB/s]
Upload successful: category.json (8KB)
Dataset version is being created. Please check progress at https://www.kaggle.com/syahrulhamdani/indonesias-trending-youtube-video-statistics