Things to try

[mlkorra]

Data

• What is the max limit of titles that PRAW can scrape?
• We can try scraping titles of latest 'hot' posts as well, it can help the model to learn new distribution in data (most top posts are quite old)
• Get data from more subreddits - (depends on the scrap limit)

Models

• Try Different Models like sentence transformers?

[daspartho]

• We're hitting the max limit for the number of top titles PRAW can scrape for each sub (1K), but there are third-party services like pushshift that aggregate that data themselves.
• Although 'hot' posts can be tried, their quality is a concern.
• Increasing the sub count would be simple (there is no scrape limit); right now, we're scraping only the first page of redditlist.com (top 125 subs).
• There is certainly room for experimentation with various models.

[mlkorra]

Can you elaborate on the 'quality' part? I am not aware of it

• Increasing the sub count would be simple (there is no scrape limit); right now, we're scraping only the first page of redditlist.com (top 125 subs).
• There is certainly room for experimentation with various models.

Sounds good

[daspartho]

Can you elaborate on the 'quality' part? I am not aware of it

Hot posts may include posts that are unrelated to subs but are new enough to surface.

[daspartho]

The second point of Limitations and Bias

Some subreddits have a specific format for their post title, like r/todayilearned where post title starts with "TIL" so the model becomes biased towards "TIL" --> r/todayilearned. This can be removed by cleaning the dataset of these specific terms.

Is this a viable option? WYT

[mlkorra]

Yes,that would be interesting to try.

[daspartho]

What I'm wondering is, if we remove these specific terms, will the post still be accurate to its subreddit?

Consider this r/explainlikeimfive post:
ELI5: NASA Engineers just communicated with Voyager 1 which is 21 BILLION kilometers away (and out of our solar system) and it communicated back. How is this possible? (post link)

if we remove "ELI5", the post sounds more like it belongs in r/askscience.

[mlkorra]

We can list the things to experiment with concretely and feel free to assign ourselves to the tasks.

• How shall we scale the data ? use 250,500,1000 subreddits?

  • Also,i think it depends on the resources reqd for finetuning the model (GPU,time taken)
  • What was the case while using 125 subreddits?

• Data cleaning part you mentioned (TIL Bias)

• What do you think about refining the data,which means instead of using all the subreddits ,filter those which are too generic and vague (like ask_reddit,gif etc)

• w.r.t modelling,first we can try sentence transformers on the current data and go ahead based on the results (idk haven't much worked on sentence transformers)

• I know you might have started the project as fun project, but what do you think would be the ideal use case of the project ?

  • Suggest subreddit based on the title, helps user to find the right subreddit to post their content is one I can think off

[daspartho]

How shall we scale the data? use 250,500,1000 subreddits?

Yes, that sounds good!

What was the case while using 125 subreddits?

It currently takes about half an hour on collab free tier GPU for 125 subs.
Also, there is room for experimentation with the hyperparameters, which will vary the training time.

[daspartho]

what do you think would be the ideal use case of the project?

There were some really good suggestions on the Reddit post.

I'll list them below:

• a bot that suggests (as a comment) if a post should belong to a different subreddit. (reddit link)
• an app that posts automatically to recommended subreddits. (reddit link)
• predict how many upvotes a post might get on a sub or a better phrasing of the title. (reddit link)
• detect posts that don't fit the sub and point it out to the mods. (reddit link)
• suggest subs to crosspost to. (reddit link)
• propose the best subreddit for the post. (reddit link)
• subs moderators use this with their moderator bots to redirect a post to the correct sub. (reddit link)

[daspartho]

What do you think about refining the data,which means instead of using all the subreddits ,filter those which are too generic and vague (like ask_reddit,gif etc)

This could be done; I don't have a strong opinion on this, WYT?

[daspartho]

Updated the model with sub count increase from 125 to 250.