Duplicate stories

Skip a news item when the same story was already posted from another feed, even with a differently worded headline.

Updated 2 views

Big stories appear in many feeds at once. Without a rule, your site could post the same news two or three times, each copy from a different source. Duplicate Stories stops that.

How it works

Before a news item is downloaded or sent to AI, AI AutoPost compares its original headline with the original headlines of the posts made recently, across all campaigns and feeds.

Two headlines are the same story when they share enough meaningful words — names, places and topic words. Small words such as "the", "of", "का", "में" do not count.

Example — these two are the same story, so the second one is skipped:

  • Kash Patel, Alexis Wilkins relationship timeline
  • FBI Director Kash Patel engaged to longtime girlfriend Alexis Wilkins

These two are different stories, so both are posted:

  • India vs Australia: Kohli hits century
  • India vs Australia: Australia win toss

A skipped item uses no credit: it is skipped before the image download and the AI request. It is also remembered, so the campaign does not try it again.

The settings

Go to AI AutoPost → Settings → Duplicate Stories.

Setting What it does Default
Skip a news item when the same story was already posted Turns the rule on or off On
Compare with posts from the last 12, 24, 48 or 72 hours 24 hours
How strict Strict — 2 shared words, Normal — 3, Relaxed — 4. At least half of the shorter headline must match Normal

Click Save Duplicate Rule.

Seeing what was skipped

Open AI AutoPost → Log. A skipped item shows a line like:

Skipped "FBI Director Kash Patel engaged…" — same story as post #797 "…" (shared words: kash, patel, alexis, wilkins)

Tip: If two different stories are skipped too often, choose Relaxed. If the same story still appears twice, choose Strict or a longer time.

Good to know

  • The rule works on headlines in English and Hindi. It cannot match a Hindi headline with an English one.
  • It compares with posts made by AI AutoPost from version 1.5.8 on.
  • The SEO Engine has its own duplicate check after the article is written. See SEO Settings.

Feedback

Was this topic helpful?

Rate this topic

★★★★★

No ratings yet

Log in to rate this topic.

Questions & comments (0)

No comments yet. Have a question about this topic? Ask it here.