Project

General

Profile

Feature #3613

Updated by Ram Kordale 5 months ago

If config.js has "Personal" set to true and 'Scrape_Content' set to true, and it is not a Youtube page, scrape the entire page and store the txt file as yyyymmhhmmss in <env>-scraped-content, where <env> is "edutestdev", "edutestqa" or "prod" in the following format: 

 URL: <url> 
 Content: <content>

Back