import pytz
import os
from datetime import datetime
now = datetime.now(tz=pytz.timezone("Asia/Jakarta"))
now = now.strftime("%Y%m%d.%H%M")
os.environ["DATASET_VERSION"] = now
print("Updating dataset on Kaggle with version: {}".format(now))
Updating dataset on Kaggle with version: 20221127.1300
%%bash
python last_retrieved_trending.py
2022-11-27 06:00:53,903 __main__ [INFO] trending data: ./data/trending.csv
sys:1: DtypeWarning: Columns (0,5) have mixed types.Specify dtype option on import or set low_memory=False.
2022-11-27 06:00:57,474 __main__ [INFO] Loaded data: ./data/trending.csv
2022-11-27 06:00:59,142 __main__ [INFO] Last 5 retrieval dates: 20221122, 20221123, 20221124, 20221125, 20221126
%%bash
python main.py
2022-11-27 06:00:59,697 main [INFO] Start retrieving indonesia youtube trending videos
2022-11-27 06:01:00,935 main [INFO] Got total 200 trending videos
sys:1: DtypeWarning: Columns (0,5) have mixed types.Specify dtype option on import or set low_memory=False.
2022-11-27 06:01:04,047 main [INFO] Done saving 200 trending videos (./data/trending.csv). Total videos: 120351
%%bash
kaggle datasets version -p ./data -m "$DATASET_VERSION"
Warning: Your Kaggle API key is readable by other users on this system! To fix this, you can run 'chmod 600 ./kaggle.json'
Starting upload for file trending.csv
100%|██████████| 291M/291M [00:03<00:00, 83.3MB/s]
Upload successful: trending.csv (291MB)
Starting upload for file category.json
100%|██████████| 7.67k/7.67k [00:00<00:00, 11.9kB/s]
Upload successful: category.json (8KB)
Dataset version is being created. Please check progress at https://www.kaggle.com/syahrulhamdani/indonesias-trending-youtube-video-statistics