The bot is missing interactives and live blog content

[harrisj]

Hey there. I used some of the code in my NYT Haiku bot and I've noticed you'll need a few tweaks to get more content.

For interactives, you need to make two changes

The regexp: '^https?://www.nytimes.com/(interactive/)?202'
The p_tags finder should look like p_tags = list(soup.find("article", {"id": "interactive"}).find_all('p'))

For live blog posts, you need to run through each post and each tag in it

p_tags = []
for post in list(soup.find_all("div", {"class": "live-blog-post"})):
    p_tags += post.find_all('p')

[MaxBittker]

thanks jacob :)

in your opinion, do you think spiritually, it makes sense to put the live blog content on the bot ? i'm already not sure if I should have crosswords

[harrisj]

I don’t have a good answer but it also means missing a lot of election coverage for instance or other live blogs for news events.

…

On Mar 5, 2021, 5:54 PM -0500, Max Bittker ***@***.***>, wrote: thanks jacob :) in your opinion, do you think spiritually, it makes sense to put the live blog content on the bot ? i'm already not sure if I should have crosswords — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or unsubscribe.