Как определить CMS у 53 тысяч сайтов за один обход. И почему картина всё равно смещена

1 September 2026 at 13:36

Задача была прикладная: мы переносим интернет-магазины на свой движок и хотели понять, сколько в зоне .ru магазинов на каждой платформе и как их находить. Готовые сервисы вроде BuiltWith продают выгрузки по подписке, но нам нужен был воспроизводимый обход, который можно гонять когда угодно и по своим правилам.

Написали свой пробер, обошли 53 305 доменов и получили распределение платформ. Заодно собрали коллекцию ловушек, на каждой из которых успели ошибиться. Про них и статья - цифры без описания граблей мало чего стоят.

NYT > Top Stories
Shein’s Lackluster Debut Shows a Fast-Fashion Model Left Behind 1 September 2026 at 11:30

Shein’s Lackluster Debut Shows a Fast-Fashion Model Left Behind

NYT > Top Stories

By: Sui-Lee Wee

1 September 2026 at 11:30

Squeezed by new trade rules, shrinking market share and labor concerns, Shein’s share decline in Hong Kong on Tuesday is a sign investors have moved on.

A Shein display in a department store in Angers in western France in February.

TechCrunch
FTC accuses Amazon of running a ‘secret ad surcharge scheme’ in new lawsuit 31 August 2026 at 23:20

FTC accuses Amazon of running a ‘secret ad surcharge scheme’ in new lawsuit

TechCrunch

By: Lauren Forristal

31 August 2026 at 23:20

Amazon is facing a new lawsuit from the FTC and 22 states for allegedly secretly charging businesses more for advertising.

NYT > Top Stories
FTC and 22 States Sue Amazon Over Advertising Practices 1 September 2026 at 00:44

FTC and 22 States Sue Amazon Over Advertising Practices

NYT > Top Stories

By: Karen Weise

1 September 2026 at 00:44

Regulators say the e-commerce giant forced more than a million advertisers to pay more than they should have. The company denies the claims.

The Federal Trade Commission and the states said Amazon misled brands and sellers into paying more for ads; the company is denying the accusations.

The Guardian
US trade regulator and 22 states accuse Amazon of taking $20bn with secret surcharges 31 August 2026 at 22:41

US trade regulator and 22 states accuse Amazon of taking $20bn with secret surcharges

The Guardian

By: Dara Kerr and Blake Montgomery

31 August 2026 at 22:41

FTC alleges in lawsuit that online retailer ‘secretly and systematically overcharged’ advertisers for years

The US’s main trade regulator and 22 states sued Amazon on Monday, alleging the online retailer “secretly and systematically overcharged” advertisers on Amazon.com.

The Federal Trade Commission (FTC) said these practices led to higher costs for customers on items like groceries and other essential goods that are sold on Amazon.