В этой статье разберем, почему модель вообще не видит дальше обученного окна, как это чинится различными методами масштабирования (RoPE, NTK-aware, YaRN, LongRoPE/LongRoPE2) и как масштабирование влияет на скорость и точность генерации.
В конце пройдемся по конкретным моделям от самых хайповых на текущих момент Qwen 3.8-27B и Qwen3.8-Flash-Next с их миллионом токенов до небольших Qwen 3.5 (4B/9B), Gemma 4 E2B/E4B, Ornith 1.0, LFM2/LFM2.5 и MiniCPM5-1B и посмотрим, что для них работает, а что нет.
Three vessels and a helicopter deployed to monitor four ships travelling through the North Sea to the Channel
The Royal Navy spent three days tracking Russian vessels as they passed through UK waters, it has emerged.
The “intense” 72-hour operation took place last week, with radars used to monitor four ships that made their way from the North Sea through to the Channel.
Three vessels and a helicopter deployed to monitor four ships travelling through the North Sea to the Channel
The Royal Navy spent three days tracking Russian vessels as they passed through UK waters, it has emerged.
The “intense” 72-hour operation took place last week, with radars used to monitor four ships that made their way from the North Sea through to the Channel.
Ukrainian prosecutors open investigation into why munitions were stored so close to residential buildings
At least 37 people have been killed after a Russian drone struck a warehouse near Kyiv’s western suburbs that was storing “explosive objects”.
The attack damaged at least 50 residential buildings, including a care home for elderly and disabled people, and sparked a huge fire and explosions in the Bucha district of the Kyiv region. The regional governor, Tymur Tkachenko, said a further 42 people, including four children, had been injured in the strike.
Grammy award-winning American artist selected as 13th person to submit written work to Oslo-based project
The next manuscript by the American artist Laurie Anderson will remain unseen for 88 years, as she becomes the 13th figure to contribute to the Future Library project.
Anderson joins Margaret Atwood, Han Kang, Ocean Vuong and other prominent authors who have written secret manuscripts, which have been locked away until 2114.
Ukrainian prosecutors open investigation into why munitions were stored so close to residential buildings
At least 37 people have been killed after a Russian drone struck a warehouse near Kyiv’s western suburbs that was storing “explosive objects”.
The attack damaged at least 50 residential buildings, including a care home for elderly and disabled people, and sparked a huge fire and explosions in the Bucha district of the Kyiv region. The regional governor, Tymur Tkachenko, said a further 42 people, including four children, had been injured in the strike.
Grammy award-winning American artist selected as 13th person to submit written work to Oslo-based project
The next manuscript by the American artist Laurie Anderson will remain unseen for 88 years, as she becomes the 13th figure to contribute to the Future Library project.
Anderson joins Margaret Atwood, Han Kang, Ocean Vuong and other prominent authors who have written secret manuscripts, which have been locked away until 2114.
‘At a time when Russia is trying to spread gloom and darkness … it is important to create something beautiful,’ says combat medic Tetiana as she weds army captain Oleksandr
In the bright early afternoon sun of Kramatorsk’s central and now ironically named Peace Square, Tetiana, in her bridal dress, and Oleksandr, in his military uniform, are holding up their phones at the ready. It is a public holiday, 35 years since Ukraine’s declaration of independence, and a popular day for a wedding, though the open-air location is not obviously ideal.
Three days earlier, Kramatorsk, perhaps Vladimir Putin’s principal target, was formally designated part of the combat zone, the front inching towards the city as Russia closes in on the parts of the Donetsk region it does not control. It is quiet at 2pm though; the ceremony brief. There are no guests other than the Guardian team.
Tetiana and Oleksandr pose for a wedding photo on Mount Karachun, near Sloviansk, the scene of fierce fighting in 2014.
Country holds a knife-edge referendum that cuts across political divides on taking step closer to Brussels after Trump threats towards Greenland
For a long time, the prospect of becoming the third generation to run his family farm was an exciting one, says Davíð Clausen Pétursson.
Icelandic farmers were starting to get higher prices for their meat and milk, debt was no longer an occupational prerequisite and innovation was on the rise.
As one of Europe’s biggest consumers of gas the UK may be particularly exposed to heightened price volatility
Europe is on course to enter the cooler months with gas stores at their lowest level in 13 years, which has triggered “winter panic” among energy traders, experts have warned.
The EU’s gas stocks were 63% full in the last week of August, well below the 80% average for late August over recent years and among the lowest levels ever recorded for this time of year.
The former prime minister Gordon Brown has said it is inevitable that Ireland will become united at some point in the future, in a wide-ranging interview with the Guardian.
While he added that any union would necessarily be “a long process” and based on mutual agreement, Brown’s comments are notable both because of his vehement opposition to Scottish independence, but also because of his involvement in government in efforts to bring peace to Northern Ireland.
As one of Europe’s biggest consumers of gas the UK may be particularly exposed to heightened price volatility
Europe is on course to enter the cooler months with gas stores at their lowest level in 13 years, which has triggered “winter panic” among energy traders, experts have warned.
The EU’s gas stocks were 63% full in the last week of August, well below the 80% average for late August over recent years and among the lowest levels ever recorded for this time of year.
The former prime minister Gordon Brown has said it is inevitable that Ireland will become united at some point in the future, in a wide-ranging interview with the Guardian.
While he added that any union would necessarily be “a long process” and based on mutual agreement, Brown’s comments are notable both because of his vehement opposition to Scottish independence, but also because of his involvement in government in efforts to bring peace to Northern Ireland.
Architect of Srebrenica genocide is dead but those scarred by his atrocities say his ideology is still shockingly pervasive
To most of the world, he was and will always be the “Butcher of Bosnia”, a grim epithet but one that still fails to fully convey the evil and horror inflicted on its people by Gen Ratko Mladić, who died in prison on Thursday.
As commander of the Bosnian Serb forces, Mladić was responsible for the killing of an estimated 100,000 men, women and children during the savage breakup of Yugoslavia in the 1990s. He was most notoriously the architect of ethnic cleansing and the genocide at Srebrenica in which at least 8,000 Bosnian Muslim men and boys were slaughtered.
Login
