Feature #3613
Extension: Personal functionality - scrape non-yt page and store in GCS bucket
Start date:
06/17/2024
Due date:
% Done:
90%
Estimated time:
1.20 h
Description
If config.js has "Personal" set to true and 'Scrape_Content' set to true, and it is not a Youtube page, scrape the entire page and store the txt file as yyyymmhhmmss in <env>-scraped-content, where <env> is "edutestdev", "edutestqa" or "prod" in the following format:
URL: <url>
Content: <content>
Updated by Ram Kordale 5 months ago
- Subject changed from Extension: Premium functionality - scrape non-yt page and store in GCS bucket to Extension: Personal functionality - scrape non-yt page and store in GCS bucket
- Description updated (diff)
Updated by Shubham Boke 5 months ago
- Status changed from In Progress to Resolved
- % Done changed from 70 to 90
Updated by Shubham Boke 5 months ago
- Status changed from Resolved to Review
- Assignee changed from Shubham Boke to Dewakar Chaubey
Updated by Ayanava Karmakar 5 months ago
- Assignee changed from Dewakar Chaubey to Ayanava Karmakar