import pytz
import os
from datetime import datetime
now = datetime.now(tz=pytz.timezone("Asia/Jakarta"))
now = now.strftime("%Y%m%d.%H%M")
os.environ["DATASET_VERSION"] = now
print("Updating dataset on Kaggle with version: {}".format(now))
Updating dataset on Kaggle with version: 20230901.1616
%%bash
python last_retrieved_trending.py
2023-09-01 09:16:42,517 __main__ [INFO] trending data: ./data/trending.csv
sys:1: DtypeWarning: Columns (0,5) have mixed types.Specify dtype option on import or set low_memory=False.
2023-09-01 09:16:46,197 __main__ [INFO] Loaded data: ./data/trending.csv
2023-09-01 09:16:48,098 __main__ [INFO] Last 5 retrieval dates: 20230827, 20230828, 20230829, 20230830, 20230831
%%bash
python main.py
2023-09-01 09:16:48,635 main [INFO] Start retrieving indonesia youtube trending videos
2023-09-01 09:16:49,918 main [INFO] Got total 200 trending videos
sys:1: DtypeWarning: Columns (0,5) have mixed types.Specify dtype option on import or set low_memory=False.
2023-09-01 09:16:53,213 main [INFO] Done saving 200 trending videos (./data/trending.csv). Total videos: 172347
%%bash
kaggle datasets version -p ./data -m "$DATASET_VERSION"
Warning: Your Kaggle API key is readable by other users on this system! To fix this, you can run 'chmod 600 ./kaggle.json'
Starting upload for file trending.csv
Warning: Looks like you're using an outdated API Version, please consider updating (server 1.5.15 / client 1.5.12)
100%|██████████| 407M/407M [00:04<00:00, 106MB/s]
Upload successful: trending.csv (407MB)
Starting upload for file category.json
100%|██████████| 7.67k/7.67k [00:00<00:00, 13.3kB/s]
Upload successful: category.json (8KB)
Dataset version is being created. Please check progress at https://www.kaggle.com/syahrulhamdani/indonesias-trending-youtube-video-statistics