Rendered at 16:07:00 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
advael 20 hours ago [-]
Category narrowing to this degree really has diluted the term "SOTA" quite a lot
You mean it's state of the art for this subset of benchmarks you're targeting? No? Well surely it's state of the art for models of a certain size category? Huh, what about models that are available for local inference? O, state of the art for open models of a certain size made in the US specifically. Uh. Neat!
gpm 19 hours ago [-]
Playing games like this also makes it very easy to accidentally say things that aren't true, like in the headline of the article...
> Introducing Ripple-65B Preview, a Frontier Open-Weight Model
It's not "frontier", it's not "frontier" even in the category of open-weight models (though usually that phrasing would mean frontier over all, and also open weight)... it's only "frontier" in the small sub-category of US made open-weight models.
GuB-42 18 hours ago [-]
It is technically frontier, if by "frontier" we mean the Pareto frontier.
Being at the Pareto frontier means that you can't get something better on one aspect without compromising on some other aspect. The trick is that it is easy to be at the Pareto frontier by having enough dimensions.
Here, we have 4: score, number of parameters, origin (US) and open-weight. You can get a better score or a lower number of parameters, but you have to compromise on at least one of the other aspects. That's a pretty weak frontier if you ask me.
derefr 18 hours ago [-]
“Origin” isn’t part of the Pareto frontier because it’s not a quantitative dimension.
(You could say that “ability to be trusted by US government/military users” is quantifiable, but I would argue that by that metric, this model falls behind non-US-originated open-weight models that have more eyes on them!)
Routine8502 16 hours ago [-]
Discrete dimensions can exist in Pareto considerations. Not that I'm too fond of this game, but given that "Origin" is definitely part of the calculus of model deployment, it makes sense to consider it in a Pareto calculation.
bastawhiz 16 hours ago [-]
It's just a different pareto frontier because you're filtering out items that don't fit your criteria. "Model was made by Anthropic" would be an equivalent dimension. You would never plot this, you're just reducing the subset of models you're comparing.
By that logic, any model is a frontier model. My GPT-2 clone is a frontier model when you compare it against models that were trained on my homelab.
kennywinker 12 hours ago [-]
Which you're welcome to do and then people are welcome to disagree that is an important frontier to consider.
getcrunk 16 hours ago [-]
Ahh I run into this issue all the time with ai when applying any sort of dimensional reasoning abstractly it always implicits continuous
yorwba 19 hours ago [-]
AFAIK the currently biggest US open-weight model is Inkling, which they include in the comparison, so at least their claim is not limited to a size category. Still they score 0.42 percentage points higher than the second-best model on their chosen benchmark, so it's hardly a meaningful lead.
quixoticelixer- 18 hours ago [-]
Fourth most popular comedy folk rock duo
hkt 17 hours ago [-]
..in New Zealand!
drob518 2 hours ago [-]
Exactly my thought. It all struck me as roughly “Best of all open weight models designed in a leap year and released on Thursdays.”
dominotw 38 minutes ago [-]
First one eyed dude with tatoo on left nut to climb everest.
msy 7 hours ago [-]
It's like the Baseball World Series of Frontier models.
It's SOTA in the same way Tesla are SOTA EVs - the best you're permitted to buy in the USA.
frinxor 19 hours ago [-]
The US bit got me as well.
I guess it makes sense - there is a segmentation where users may want to run on domestic "frontier LLMs."
twelvechairs 17 hours ago [-]
Why should US or China matter if its open weights? Its going to matter a whole lot more whether you are running it locally or where your provider is surely.
[Edit i think the preferred combination for those who actually want some data security at the moment and arent at the scale of self hosting llms is chinese open weight models served in germany or France where theres some better data privacy/security]
aftbit 11 hours ago [-]
There are a number of reasons that you might not want to build your inference stack on a Chinese origin model even if you're running it entirely in house.
For one, you might not trust that the weights do not contain ideological biases (e.g. ask DeepSeek about tibet) or that the methods used to impose these biases may not have contaminated the model in some other way.
For another, you might not trust that the code the model generates won't be backdoored or attempt to leak information through your sandboxes.
For a third, you may not want to build your stack on a partner who you feel is a supply chain risk, who might become unaligned with your interests.
By far the biggest though, is that many industries will be forbidden from doing so by the government in an attempt to protect the US model industry (and thus create the demand for some model like this one).
I'm always excited to see new entrants to this open-models race, no matter why they're running.
dragonwriter 10 hours ago [-]
There are zero reasons to have any less concerns about ideological biases, side effects of the mechanisms used to implement ideological biases, or code backdoors in a US model, and a supplier of open (as opposed to hosted) model weights is not an active ongoing partner with whom the idea of supply chain risk from possible future divergence of interests is coherent, so that concern is either invalid or, if the “partner” is the model itself, simply a restatement of the ideological bias in the model weights concerns which, again, is not diminished by the model having a US origin.
And your speculation about future protectionist regulation is just that, not an actual fact.
spockz 7 hours ago [-]
I think the only point being is that if you see US as homogeneous and you are from the US then it’s okay to use an US model because it’s values will be signed with yours. But that is pretty weak anyway.
dragonwriter 33 minutes ago [-]
If you see the US as homogenous and you are from the US, you have much bigger problems than your choice of open LLMs.
vrganj 2 hours ago [-]
Every model has ideological biases, such is the nature of ideology.
The question is only whether they overlap with your own.
walrus01 7 hours ago [-]
> For another, you might not trust that the code the model generates won't be backdoored or attempt to leak information through your sandboxes.
I don't disagree with you on the severity of the concerns, but given the vast amounts of code that must have been generated in the past six months by the likes of GLM5.2, GLM5.3, deepseek v4 flash 0731 and newer, qwen 3.5-122, 3.6 and 3.8 series models, I would like to see any concrete examples of it building backdoors/intentional vulnerabilities/phone-home-to-china or similar unprompted. If it's been doing this and anyone with even a modicum of a clue has been watching it, surely someone has caught a model doing this? At least once?
Surely a model doing something like writing intentionally obfuscated code that obscures its actual purpose from a code reviewer, in the service of something malicious/backdoor-like, would have been seen and noticed by now.
mcnewcp 13 hours ago [-]
I wish it didn't matter to me, but it does. I work in government and we self host. No matter how much I explain to them that by hosting weights on our own hardware, it doesn't matter where they came from, they still refuse to let me deploy anything from China.
dragonwriter 10 hours ago [-]
> Why should US or China matter if its open weights?
Weights aren’t source that can be inspected for nefarious tricks that would impact use, so, to the extent that there is a dinension of trust associated with nation of origin, being open weights doesn’t obviate the concern (I would argue, though, that there is very little reason to for nation of origin to be a significant factor in trust alone, though a finer grained consideration of origin might be sensible.)
lynx97 7 hours ago [-]
> Why should US or China matter if its open weights?
Well, you might want to know what propaganda/censorship you are subjected to. Case in point, a regional government in Austria just learnt that their AI doesn't know about the Tiananmen Square massacre.
mettamage 8 hours ago [-]
I’m SOTA on being exactly who I am.
Yep, you’re right. Quite easy to dilute the term.
visarga 20 hours ago [-]
No, the term is well defined. It means being on the Pareto curve of performance vs size, such as: https://tinyurl.com/26sw35fw
advael 19 hours ago [-]
Irrelevant. A term can be well-defined and used correctly while also being diluted. In this case, I am pointing out that it's diluted by narrowing the category in which the claim is being made. I have no doubt that in this narrowed category, the term is being used correctly. This has no bearing on the fact that by narrowing the category in that way, this claim is made remarkably less impressive or interesting to many people hearing it, including myself
vikramkr 15 hours ago [-]
Terms can have multiple definitions and language is descriptive not prescriptive. If you intend to communicate that you mean "Pareto frontier" in the current context you need to include the word "pareto." If you don't then "frontier" will be understood as referring to mythos/astra/opus 5.5 tier models in intelligence (max capability regardless of tradeoffs). It doesn't matter that the second definition in the dictionary is the one you want to convey (charitably assuming you're not trying to mislead given the value of the hype of being able to call your model a frontier model) if your audience understands what you're saying to mean the first definiton.
XnoiVeX 12 hours ago [-]
Frontier and SOTA usually mean that something is on the edge of what's possible. The bleeding edge.
O_H_E 20 hours ago [-]
well yes but the y axis heavily depends on the benchmark you choose
bastawhiz 16 hours ago [-]
Is it really on the pareto curve if you get to define arbitrary conditions for what other models are plotted on the curve?
epolanski 19 hours ago [-]
By...whom? An ISO standard? Highly cited scientific literature?
A tinyurl pic linked by randoms over the internet?
swiftcoder 19 hours ago [-]
For sure, but unfortunately, there's a non-zero chance the state department at some point makes the "US" part of this mandatory for a bunch of companies.
dev_l1x_be 19 hours ago [-]
State of the AI-Apocalypse.
cyanydeez 17 hours ago [-]
It means ot was released recently.
It was already meaningless when US labs used it.
It means new.
stewartpark 20 hours ago [-]
It's great to see another competitive open weight model. Congratulations!
But as is, it's probably hard to become popular amongst hobbyists and local model enthusiasts like Qwen's 27B class models or MOE models because it's a 65B dense model and inference will be prohibitively slow on consumer grade hardware, and seems like the goal/mission of the company behind this model is to automate chip design.
So if I have to assume and connect the dots, this is for the companies who want to use AI in air-gapped environments for chip design so that they protect their IPs (not leaking to third party AI labs/hostile parties) and can afford lots of server grade inference hardware for a quick unlock with the big dense model.
Neat!
0x00cl 17 hours ago [-]
Maybe is a bit more niche, but I'm pretty sure there is plenty of people who have enough RAM to run dense models like this one, I don't know how slow is slow but people are willing to sacrifice speed if it means they get a good model running locally.
Look at "SC117/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF" on HuggingFace, It says it has 3.5M downloads this month and its offering a model that is 2-bit and 3-bit quantized (66GB - 83.9GB).
If this gets quantized to 4-bit (Q4_0) which usually there is very little loss in intelligence compared to the base model, then the model will probably be around 40GB, and looking that people are downloading a model that is at least 20GB bigger, then it might allow even more people to run a bigger model.
But it will only be popular among hobbyist if its as good as it claims to be.
sorenjan 17 hours ago [-]
Qwen 3.8 Flash Next is a mixture of experts model though. It has 6B active parameters per token, so you can cache large parts of the model in RAM and move it in and out of VRAM as needed. If you do that with a dense model it gets much slower.
Tade0 16 hours ago [-]
Experts are not typically moved between VRAM and system RAM during inference, as it would be too slow.
What happens instead is that the "dense" parts of the model like e.g. the router are put into VRAM and the remainder of VRAM is occupied by the KV cache and whatever experts still fit.
The rest - usually just the experts - reside in RAM, but it's bo big deal.
Additionally, some models utilise an n-gram table, of which only one row is read per token, so it can actually be stored on disk without issue. Example:
> and the remainder of VRAM is occupied by the KV cache and whatever experts still fit.
Those days engines try to optimize "whatever experts" part and can use remaining VRAM as cache, moving hot experts to GPU during inference (but less used experts keep executing on CPU, yea).
I was not aware of that, so I downloaded the latest release (which includes but doesn't document this flag), but performance unfortunately tanked in my case.
Even If I set the fit target to a value which without the cache would leave that VRAM unused, I get about a third of my usual token rate.
entrope 15 hours ago [-]
> Experts are not typically moved between VRAM and system RAM during inference, as it would be too slow.
For some definition of "typical", sure, but it depends on what performance trade someone is willing to accept. Strata LLM is geared around streaming weights as needed. It lets me run DeepSeek-4.1-Flash 1031, heavily quantized (ISTA-DASLab's 2.25 bpw quant), on a single Radeon R9700 plus 256 GB host RAM. 500 tps prefill and 30 tps decode isn't great, but it's a large fraction of what I get with Qwen3.8-27B quantized to fit entirely in VRAM for short prompts, it's faster past about 80k context, and DS4.1F can use a 1M-token context. It takes forever to fill that, or even to refill if the KV cache doesn't match, but it works.
Tade0 6 hours ago [-]
I've tried llama.cpp's new --moe-cache-mib flag and it lowers performance to about a third of what it is without the flag.
And no wonder really - PCIe 4.0 x16 has a one direction bandwidth of around 31.5GB/s - much slower than system RAM - in my case about a third the speed and I think it's no coincidence that I'm getting this exact rate of slowdown.
julianlam 15 hours ago [-]
Something doesn't seem right. Vanilla llama.cpp can hit 50 t/s on an R9700. Q6 (albeit with limited context of 64k, more if kv cache is quantized) fits entirely on the card.
stewartpark 17 hours ago [-]
I hear what you're saying - there are people who will use it even at 0.1 tokens/s and run tasks over night or over multiple days if it is good. but Qwen3.8 Flash Next is a MoE model (6B active) so the memory bandwidth/compute required to calculate each token is very different from a 65B (meaning, 65B all active) dense model!
deepsquirrelnet 15 hours ago [-]
> it's a 65B dense model and inference will be prohibitively slow on consumer grade hardware
Times are changing and with MTP and DFLASH, dense models are back in style. For qwen 3.8 27b, you can get great token generation rates with MTP and for quality, it's much better than a MoE of comparable size.
stewartpark 13 hours ago [-]
That helps, yes. But speculative decoding that requires a secondary/draft model means a trade off (smaller KV pool), so often times the only option left is MTP unless you have lots of VRAM. And as you already know, these options (MTP, DFlash, DSpark, etc) are also available for MoE models, too. If it's 3tk/s instead of 1tk/s, we can say it helps but not sure how many people would be excited about that. I'd be more excited about 150tk/s instead of 50tk/s!
59nadir 19 hours ago [-]
Is it competitive overall or just competitive when compared to "U.S. Open-Weight models that are otherwise pretty decent at agentic coding"? The latter does not imply the former.
regularfry 19 hours ago [-]
What'll be interesting is how it performs relative to Qwen3.8 27b when quantised to the same size. Which, of course, is a comparison they don't want to do.
40four 19 hours ago [-]
Well, obviously. These newer American models aren’t competing with Qwen yet. They are competing for American businesses and organizations that can’t/won’t use Chinese models.
They are playing catch-up, but I’m happy to see new players to the game, and it will be interesting to watch how they develop
wmf 20 hours ago [-]
Congratulations I guess but it's a pretty bad look to not even mention those other open weight models.
karmakaze 20 hours ago [-]
What's funnier is that after cherry picking models for comparison, they further cherry picked Inking for size comparison instead of better and smaller Beam 1.0
The bar chart also shows Nemotron 3 Ultra instead of smaller and better Nemotron 3.5 Super.
Neywiny 4 hours ago [-]
3 ultra vs 3.5 super is a big discussion. But in mine and others' experiences, 3.5 super is a lot worse than 3 ultra.
tedivm 20 hours ago [-]
We've always been at war with eurasia.
Seriously though, it's just easier to pretend that China doesn't exist when they're stomping us this badly.
stewartpark 19 hours ago [-]
I think it's because the primary users of this model won't even look at "those other open weight models" as options. This is the right chart to present to those who would consider this model. (e.g. US Gov't agencies, chip design industry, etc etc)
flatline 20 hours ago [-]
Right? These are not likely to be meaningful points of comparison to anyone but the authors.
wmf 20 hours ago [-]
Maybe Palantir will use it or something. There probably is a market for US models but I don't know how large it will be.
Onawa 20 hours ago [-]
US Gov won't let Chinese models be hosted on any internal infra, not even supposed to use them for local AI. So there is absolutely a market for US-made or non-Chinese models there.
DaSHacka 12 hours ago [-]
Do you have a source for this? Genuinely curious, I've seen reports online of MIC contractors already using it extensively on-prem. In fact, one of the issues they bring up is how there is no official guidance right now, so no one really knows what to do.
Onawa 3 hours ago [-]
I don't have a source unfortunately, this is mostly internal directives from my work within NIH. I've had many conversations with security officers and IT about my plans to use local models for various projects, and hackles were always raised in regards to Chinese models.
I also did a short stint with an IT operations company, and we were told Chinese models were a no-go as well from our deployments on DoD hardware.
schleck8 19 hours ago [-]
Because Chinese models heavily rely on distillation and regularly behave strangely in public benchmarks (where they score much better than in private evaluations), even if many world class researchers are Chinese. It's difficult to quantify to what extend labs like Moonshot would be competitive if they could not distill from OpenAI, now that Anthropic mostly blocks it
It would also be pretty difficult to quantify to what extent labs like Anthropic would be competitive if they could not distill from human knowledge.
petcat 19 hours ago [-]
Do those other models usually mention all the competition? I haven't noticed
bluejay2387 19 hours ago [-]
There are several situations where some of us are explicitly prohibited from using models from companies not under the jurisdiction of the United States. It doesn't mean these models are competitive when looked at from a global view but it is also not an irrelevant differentiation.
Computer0 18 hours ago [-]
It's the same positioning Mistral makes.
2001zhaozhao 20 hours ago [-]
This model scores 80.5 on Terminal Bench 2.1
For reference Qwen 3.8 Flash Next (which is bigger than this model but probably cheaper to run due to MoE) scores 84.3, and Qwen 3.8-27B scores 73.0.
I think this model could be competitive, depending on how much it was benchmaxxed compared to Qwen?
pcwelder 8 hours ago [-]
The hosted GMI cloud model on openrouter does not invoke confidence. Ignoring 131k context length limit the tool call failure rate is not acceptable.
When asked to call 'submit_html' tool for our bench it wrote the whole page as plain reply text, then called submit_html with "This is the complete submit trigger." 4/8 tools failed.
antoineMoPa 18 hours ago [-]
I trained a tiny LLM earlier this year, it's fits under 10mb and it's completely useless, can I call it SOTA for my neighborhood?
kennywinker 12 hours ago [-]
State of the Area
syntaxing 20 hours ago [-]
When a post doesn’t mention Qwen for comparison, you know the performance isn’t going to be great.
ethan-boneh 20 hours ago [-]
I mean Qwen 3.8 27B hits 73% on TB2.1 and 42.2% on DeepSWE....
a11r 18 hours ago [-]
I understand the desire to look the best in some self defined category. But not showing any comparison against the actual leaders in open weight renders all of the benchmarking completely information-less for the actual end users (who care about real performance comparison against the real field).
mark_l_watson 14 hours ago [-]
Oh, I thought this was from the company recursive.com who released the very good for its size model Flint.
I think we will find the market is going to move into omni multi-modal models: text, moe, agentic tasks, voice, images, and video all in one LLM.
namjh 11 hours ago [-]
New model is always a good news!
However, the chart comparing the score-by-parameters with existing models is misleading, because the others are all MoE, and this model is not. The article describes it as an architectural decision to optimize against NVIDIA cards(which sounds reasonable, as US labs are relatively easy to gain access to these high-performance chips) but the chart should've been adjusted to reflect the difference, say, by using the heuristic that `effective param size ≈ sqrt(total param size * activiated param size` on MoEs.
soohamr 13 hours ago [-]
Wasn't ricursive's sthick to automate EDA and chip design with LLMs? Why are they releasing open weight agentic coding models and benchmarking on everything but EDA and chip design?
ggcr 10 hours ago [-]
I was also surprised to not find any benchmark for RTL in the model card. Wonder how it would score on - say, CVDP
nghiemphucminh7 12 hours ago [-]
[flagged]
thesnarkitecht 19 hours ago [-]
Speaking as someone who has High-Memory Mac Studios, it is great that there is finally a model that will run at usable speeds with high quality. In my experience, the sweet spot for Mac Clusters is around 200GB of weights, which this is far under. Congratulations to the recursive team for building an open model that will actually run!
Tepix 17 hours ago [-]
It will be slow on Macs, it's a dense model.
RandyOrion 13 hours ago [-]
Nice to see another open weight model.
I cannot evaluate how valuable this model is based on the performance table alone because the comparison is kind of narrow. Waiting for third-party benchmarks to provide more information.
I do not have the hardware to run it properly without super-heavy quantization (about q2). Besides, the architecture is not optimized for local usage (sliding window attention also requires KV cache). I think I will just move on.
Kimi is not open weight. Go look at the license. It has a bunch of usage restrictions. (The same is true for qwen flash-next and larger).
Ripple-65B preview is apache-2.0, so actually open weight.
zhiyan 12 hours ago [-]
Looking forward to a "SOTA model from my basement". Make the category narrow enough, anybody can claim SOTA.
mrinterweb 18 hours ago [-]
Not comparing to Qwen3.8 27B gives cherry-picked benchmark comparison energy. Still, Ripple-65B outscores Qwen3.8 27B, according to the reported benchmarks.
piscoi 4 hours ago [-]
Kutia giza kwenye gem
jszymborski 20 hours ago [-]
Would love a 27B model. Wonder if we'll get a distillation.
Showing a terminal bench 2.1 score at the top is very misleading when terminalbench 4.0 is the current metric as a very quick glance for anything we care about for 30B to 180B size possible to locally-host models.
RGS1811 20 hours ago [-]
The comparison chart is befuddling.
kylehotchkiss 16 hours ago [-]
Ouh this is the size of model I want to see more of (just got a 98gb m5u studio)
kylehotchkiss 16 hours ago [-]
Ouh that fits right on a base M5U Studio! Excited to try it.
cyberax 18 hours ago [-]
So the model is "meh" at best, but the cost of the training is interesting. So we can extrapolate that in 3 years the cost will be below $5m for a model like this.
It's very well within the capabilities of any reasonable organization, maybe even crowd-funded.
ltbarcly3 17 hours ago [-]
What is this thing where model comparisons blatantly pick other crap models and show themselves at the top left (cheap and effective)? Put all the open models, or put all the cheap models, or whatever, but just cherry picking is egregious.
thriftyfig 1 hours ago [-]
[flagged]
oxcartctl 4 hours ago [-]
[dead]
RemingtonDavies 13 hours ago [-]
[dead]
johnnyApplePRNG 20 hours ago [-]
[flagged]
teo-mateo 18 hours ago [-]
"get out of my feed" what a nasty attitude.
6thbit 20 hours ago [-]
I'm sorry but what is "U.S." implying here?
Is this sponsored by the us gov? did it only train on US data? does it only work on the US?
conception 20 hours ago [-]
It's a US group that made it, in the same vein that OpenAI and Anthropic have US models.
petcat 20 hours ago [-]
It means that it's an American AI lab behind it.
mirekrusin 19 hours ago [-]
...hiring Chinese people to do it.
kennywinker 12 hours ago [-]
Why is the race of the people working there an issue?
I understand why some people want to differentiate between models from chinese companies and us companies and eu companies etc, because that is about control over the company. The us or chinese gov could, for example, make it difficult for canadians using a model under their control. Even with open weight, these could be weaponized to some degree. Arguably that gov control can also manifest in the model's behaviour, but since I'm mostly using them for agentic coding not political advice I don't really care about that.
But the race of the workers making this stuff... I'm not less concerned about a model made by americans working for a chinese lab than a model made by chinese people working for a chinese lab. If the race of the people building the model matters to you, why?
mirekrusin 8 hours ago [-]
You are the one talking about it in terms of a problem, I think it's funny.
kennywinker 58 minutes ago [-]
In the absence of a clear reason to bring up race, the reader is left to assume the worst
petcat 18 hours ago [-]
Looks like all their engineering jobs are in Palo Alto?
You mean it's state of the art for this subset of benchmarks you're targeting? No? Well surely it's state of the art for models of a certain size category? Huh, what about models that are available for local inference? O, state of the art for open models of a certain size made in the US specifically. Uh. Neat!
> Introducing Ripple-65B Preview, a Frontier Open-Weight Model
It's not "frontier", it's not "frontier" even in the category of open-weight models (though usually that phrasing would mean frontier over all, and also open weight)... it's only "frontier" in the small sub-category of US made open-weight models.
Being at the Pareto frontier means that you can't get something better on one aspect without compromising on some other aspect. The trick is that it is easy to be at the Pareto frontier by having enough dimensions.
Here, we have 4: score, number of parameters, origin (US) and open-weight. You can get a better score or a lower number of parameters, but you have to compromise on at least one of the other aspects. That's a pretty weak frontier if you ask me.
(You could say that “ability to be trusted by US government/military users” is quantifiable, but I would argue that by that metric, this model falls behind non-US-originated open-weight models that have more eyes on them!)
By that logic, any model is a frontier model. My GPT-2 clone is a frontier model when you compare it against models that were trained on my homelab.
I guess it makes sense - there is a segmentation where users may want to run on domestic "frontier LLMs."
[Edit i think the preferred combination for those who actually want some data security at the moment and arent at the scale of self hosting llms is chinese open weight models served in germany or France where theres some better data privacy/security]
For one, you might not trust that the weights do not contain ideological biases (e.g. ask DeepSeek about tibet) or that the methods used to impose these biases may not have contaminated the model in some other way.
For another, you might not trust that the code the model generates won't be backdoored or attempt to leak information through your sandboxes.
For a third, you may not want to build your stack on a partner who you feel is a supply chain risk, who might become unaligned with your interests.
By far the biggest though, is that many industries will be forbidden from doing so by the government in an attempt to protect the US model industry (and thus create the demand for some model like this one).
I'm always excited to see new entrants to this open-models race, no matter why they're running.
And your speculation about future protectionist regulation is just that, not an actual fact.
The question is only whether they overlap with your own.
I don't disagree with you on the severity of the concerns, but given the vast amounts of code that must have been generated in the past six months by the likes of GLM5.2, GLM5.3, deepseek v4 flash 0731 and newer, qwen 3.5-122, 3.6 and 3.8 series models, I would like to see any concrete examples of it building backdoors/intentional vulnerabilities/phone-home-to-china or similar unprompted. If it's been doing this and anyone with even a modicum of a clue has been watching it, surely someone has caught a model doing this? At least once?
Surely a model doing something like writing intentionally obfuscated code that obscures its actual purpose from a code reviewer, in the service of something malicious/backdoor-like, would have been seen and noticed by now.
Weights aren’t source that can be inspected for nefarious tricks that would impact use, so, to the extent that there is a dinension of trust associated with nation of origin, being open weights doesn’t obviate the concern (I would argue, though, that there is very little reason to for nation of origin to be a significant factor in trust alone, though a finer grained consideration of origin might be sensible.)
Well, you might want to know what propaganda/censorship you are subjected to. Case in point, a regional government in Austria just learnt that their AI doesn't know about the Tiananmen Square massacre.
Yep, you’re right. Quite easy to dilute the term.
A tinyurl pic linked by randoms over the internet?
It was already meaningless when US labs used it.
It means new.
But as is, it's probably hard to become popular amongst hobbyists and local model enthusiasts like Qwen's 27B class models or MOE models because it's a 65B dense model and inference will be prohibitively slow on consumer grade hardware, and seems like the goal/mission of the company behind this model is to automate chip design.
So if I have to assume and connect the dots, this is for the companies who want to use AI in air-gapped environments for chip design so that they protect their IPs (not leaking to third party AI labs/hostile parties) and can afford lots of server grade inference hardware for a quick unlock with the big dense model.
Neat!
Look at "SC117/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF" on HuggingFace, It says it has 3.5M downloads this month and its offering a model that is 2-bit and 3-bit quantized (66GB - 83.9GB).
If this gets quantized to 4-bit (Q4_0) which usually there is very little loss in intelligence compared to the base model, then the model will probably be around 40GB, and looking that people are downloading a model that is at least 20GB bigger, then it might allow even more people to run a bigger model.
But it will only be popular among hobbyist if its as good as it claims to be.
What happens instead is that the "dense" parts of the model like e.g. the router are put into VRAM and the remainder of VRAM is occupied by the KV cache and whatever experts still fit.
The rest - usually just the experts - reside in RAM, but it's bo big deal.
Additionally, some models utilise an n-gram table, of which only one row is read per token, so it can actually be stored on disk without issue. Example:
https://huggingface.co/ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RC...
Those days engines try to optimize "whatever experts" part and can use remaining VRAM as cache, moving hot experts to GPU during inference (but less used experts keep executing on CPU, yea).
e.g. llama.cpp recently added flag for that: https://github.com/ggml-org/llama.cpp/pull/29887
Even If I set the fit target to a value which without the cache would leave that VRAM unused, I get about a third of my usual token rate.
For some definition of "typical", sure, but it depends on what performance trade someone is willing to accept. Strata LLM is geared around streaming weights as needed. It lets me run DeepSeek-4.1-Flash 1031, heavily quantized (ISTA-DASLab's 2.25 bpw quant), on a single Radeon R9700 plus 256 GB host RAM. 500 tps prefill and 30 tps decode isn't great, but it's a large fraction of what I get with Qwen3.8-27B quantized to fit entirely in VRAM for short prompts, it's faster past about 80k context, and DS4.1F can use a 1M-token context. It takes forever to fill that, or even to refill if the KV cache doesn't match, but it works.
And no wonder really - PCIe 4.0 x16 has a one direction bandwidth of around 31.5GB/s - much slower than system RAM - in my case about a third the speed and I think it's no coincidence that I'm getting this exact rate of slowdown.
Times are changing and with MTP and DFLASH, dense models are back in style. For qwen 3.8 27b, you can get great token generation rates with MTP and for quality, it's much better than a MoE of comparable size.
They are playing catch-up, but I’m happy to see new players to the game, and it will be interesting to watch how they develop
The bar chart also shows Nemotron 3 Ultra instead of smaller and better Nemotron 3.5 Super.
Seriously though, it's just easier to pretend that China doesn't exist when they're stomping us this badly.
I also did a short stint with an IT operations company, and we were told Chinese models were a no-go as well from our deployments on DoD hardware.
https://www.theinformation.com/articles/openais-astra-model-...
For reference Qwen 3.8 Flash Next (which is bigger than this model but probably cheaper to run due to MoE) scores 84.3, and Qwen 3.8-27B scores 73.0.
I think this model could be competitive, depending on how much it was benchmaxxed compared to Qwen?
When asked to call 'submit_html' tool for our bench it wrote the whole page as plain reply text, then called submit_html with "This is the complete submit trigger." 4/8 tools failed.
I am looking at the HF model page https://huggingface.co/ricursiveAI/Ripple-65B-Preview and it looks like I need to wait a day for an Apple Silicon version.
I think we will find the market is going to move into omni multi-modal models: text, moe, agentic tasks, voice, images, and video all in one LLM.
However, the chart comparing the score-by-parameters with existing models is misleading, because the others are all MoE, and this model is not. The article describes it as an architectural decision to optimize against NVIDIA cards(which sounds reasonable, as US labs are relatively easy to gain access to these high-performance chips) but the chart should've been adjusted to reflect the difference, say, by using the heuristic that `effective param size ≈ sqrt(total param size * activiated param size` on MoEs.
I cannot evaluate how valuable this model is based on the performance table alone because the comparison is kind of narrow. Waiting for third-party benchmarks to provide more information.
I do not have the hardware to run it properly without super-heavy quantization (about q2). Besides, the architecture is not optimized for local usage (sliding window attention also requires KV cache). I think I will just move on.
Ripple-65B preview is apache-2.0, so actually open weight.
It's very well within the capabilities of any reasonable organization, maybe even crowd-funded.
Is this sponsored by the us gov? did it only train on US data? does it only work on the US?
I understand why some people want to differentiate between models from chinese companies and us companies and eu companies etc, because that is about control over the company. The us or chinese gov could, for example, make it difficult for canadians using a model under their control. Even with open weight, these could be weaponized to some degree. Arguably that gov control can also manifest in the model's behaviour, but since I'm mostly using them for agentic coding not political advice I don't really care about that.
But the race of the workers making this stuff... I'm not less concerned about a model made by americans working for a chinese lab than a model made by chinese people working for a chinese lab. If the race of the people building the model matters to you, why?