import pytz
import os
from datetime import datetime
now = datetime.now(tz=pytz.timezone("Asia/Jakarta"))
now = now.strftime("%Y%m%d.%H%M")
os.environ["DATASET_VERSION"] = now
print("Updating dataset on Kaggle with version: {}".format(now))
Updating dataset on Kaggle with version: 20220813.1301
%%bash
python last_retrieved_trending.py
2022-08-13 06:01:36,230 __main__ [INFO] trending data: ./data/trending.csv
2022-08-13 06:01:40,774 __main__ [INFO] Loaded data: ./data/trending.csv
2022-08-13 06:01:44,657 __main__ [INFO] Last 5 retrieval dates: 20220808, 20220809, 20220810, 20220811, 20220812
sys:1: DtypeWarning: Columns (0,5) have mixed types.Specify dtype option on import or set low_memory=False.
%%bash
python main.py
2022-08-13 06:01:45,831 main [INFO] Start retrieving indonesia youtube trending videos
2022-08-13 06:01:47,306 main [INFO] Got total 200 trending videos
2022-08-13 06:01:51,283 main [INFO] Done saving 200 trending videos (./data/trending.csv). Total videos: 99151
sys:1: DtypeWarning: Columns (0,5) have mixed types.Specify dtype option on import or set low_memory=False.
%%bash
kaggle datasets version -p ./data -m "$DATASET_VERSION"
Warning: Your Kaggle API key is readable by other users on this system! To fix this, you can run 'chmod 600 ./kaggle.json'
Starting upload for file trending.csv
100%|██████████| 238M/238M [00:02<00:00, 106MB/s]
Upload successful: trending.csv (238MB)
Starting upload for file category.json
100%|██████████| 7.67k/7.67k [00:00<00:00, 16.9kB/s]
Upload successful: category.json (8KB)
Dataset version is being created. Please check progress at https://www.kaggle.com/syahrulhamdani/indonesias-trending-youtube-video-statistics