AMD Ryzen AI Halo – $4k AI Dev Kit

(lttlabs.com)

161 points | by LabsLucas 3 hours ago

39 comments

  • lhl 3 hours ago
    The one thing that's new/worth pointing out are the https://developer.amd.com/playbooks/ (https://github.com/amd/playbooks) - this is AMD's answer to Nvidia's playbooks (https://build.nvidia.com/spark / https://github.com/NVIDIA/dgx-spark-playbooks ) - I think it's great that they're actually taking this more seriously.

    Hardware is the exact same as what used to be available for $2K last year (and is still $1K cheaper from Chinese OEMs).

    LTT Lab's LLM testing is getting more sophisticated, which is great - I think it's worth noting that ROCm/Vulkan versions and llama.cpp build versions are going to have some big differences for numbers.

    For those wanting to get the most out of their Strix Halos, there's both kernel tweaks and utilities like ryzenadj that can help you get the most out of it. ( http://strixhalo.wiki/ has most of that documented). Also, if you're running for coding or agentic work, if you model supports MTP, that's mature and should give you a decent (30%?) decode boost.

  • SwellJoe 4 minutes ago
    I have a Strix Halo device, and like it, but at this price, might as well buy the Nvidia-based ASUS GX 10, if you're buying it for AI. CUDA remains the stronger ecosystem. The AMD is a better desktop machine, as it has a better CPU, but the Nvidia will be a little faster and a little better supported for inference and training workloads. You can almost always do the same things with ROCm, but you're going to work a little more.

    Though, I will say that Nvidia ships a dogshit custom Ubuntu on their hardware that's hard to deal with. Nvidia is not good at software. I keep thinking they'll get better at it, but I've been dealing with their Jetson line for a couple of years now, and it still sucks. Still a clumsy custom Ubuntu, and it's not as easy as simply installing a different Linux version as it's a complicated image-based thing and no UEFI. At least, I assume they ship Ubuntu on the big devices; I've only dealt with the little embedded Jetson machines. The AMD stuff, being a regular x86_64 PC, you can install pretty much any Linux. I immediately put Fedora on mine.

  • Havoc 1 minute ago
    Tough sell. High price, uncompetitive mem throughput
  • kamranjon 3 hours ago
    In case it saves anyone some time (from the article): "The AMD Ryzen AI Max+ 395(Strix Halo) processor has been available since Spring 2025 and the Halo doesn’t offer anything new on that front."

    It has the same 256 GB/s memory bandwidth limit as every board previously, not sure why this is even being released right now as if it's some new fangled thing - you can go get a Framework Desktop for roughly the same price or a GMKtec EVO-X2 for a bit cheaper.

    • hparadiz 1 hour ago
      It's being released right now because it's massively profitable and in high demand and has actually gone up in price over the past year so obviously AMD wants to cash in on that instead of selling these units to PC manufacturers at a lower price.
    • ekholm_e 1 hour ago
      This. I bought Framework Desktop in November 2025 with almost these exact specs for ~$2.5k
      • ahmadyan 30 minutes ago
        Same spec Framework costs $4k+ today, this is actually cheaper (albeit not as upgradable as framework).
    • aurareturn 24 minutes ago
      A year ago, you could have bought this computer for $2000. Basically double the price now.
  • Tenoke 2 hours ago
    I really want a 128gb+ machine but it's brutal to be at only 256 GB/s for $4k (especially with the drawbacks of both ARM and AMD).

    I fear that by the time the RTX Spark comes out it'd have to be $6k, and by the time a 128gb or more machine with 700+ GB/s comes out it'd be at $10k, way out of most consumers' hands.

    Edit: capitalized gb/s to GB/s.

    • dabinat 2 hours ago
      A Mac Studio is a much better buy in terms of memory bandwidth, but impossible to buy in a 128 GB configuration. Honestly there aren’t great options right now and it’s probably better to wait for the market to be less insane.
      • hadlock 8 minutes ago
        Apple rumor mill is suggesting that we may see M5 Mac Studio announced in September at that event. Apple just increased their pricing across the board, so I'm not holding my breath that they will be reasonably priced. They also cancelled development of their M6 in favor of the future M7 which I suspect will be a major, AI-focused upgrade compared to the M4->M5 upgrade
      • Tenoke 2 hours ago
        I looked for one and it's impossible to find, let alone at a reasonable price + it does suffer from being harder to train/use less common models and workflows (e.g. arbitrary comfyui ones). Spark at least doesnt have that drawback, while AMD has both drawbacks.

        Waiting for the market to be less insane is somewhat akin to waiting for the s&p500 to drop a decent amount so you can buy in.

        • sarjann 48 minutes ago
          No, equities naturally trend up with economic growth. RAM is up because of a supply shock, as new capacity comes on prices will drop, it’s a commodity.
          • Tenoke 20 minutes ago
            Yes, in the very long term, but in the medium term where the listed capacities even matter we are not close to that. Really, the cost per gb of vram on flagships hasnt went down since 1080ti and thats not accouting for the recent increases which will likely last for years.
        • mathisfun123 54 minutes ago
          > Waiting for the market to be less insane is somewhat akin to waiting for the s&p500 to drop a decent amount so you can buy in.

          lol this is so wrong it's funny - equities go up in price, commodity goods go down in price. the two markets are literally diametrically opposed.

          • matt_heimer 41 minutes ago
            I'd have a better portfolio right now if I invested in RAM instead of equities.
      • andy99 1 hour ago
        Late last year I was debating a Framework desktop vs waiting for a M5 studio. I went with the former in December 2025, glad I did now as everything has gone up in price and if I had put off the decision I’d probably still be putting it off.
    • Neywiny 2 hours ago
      To be clear though that's GB/s. Which is 2 terabits/sec
      • trvz 1 hour ago
        And 4000 USD is over 1.2 million Hungarian forints.
        • MaxikCZ 47 minutes ago
          yea but 4000 USD dont get confused for Hungarian forints just because one says 4000 usd instead.
    • StableAlkyne 2 hours ago
      [dead]
  • Catloafdev 3 hours ago
    These devices were great when they were cheaper than the DGX Spark.

    But when they cost the same price (unless the Spark has shot up too), there's no reason to buy this over a Spark.

    The Spark is literally a faster version of this, with better software support.

    Edit: And I say that as an owner of a Ryzen AI Max 395 device.

    • kcb 2 hours ago
      Ability to run any OS is a pretty nice benefit versus the spark.
      • bigyabai 2 hours ago
        As far as I know, you can use other OSes once the Spark's firmware is updated with LVFS.

        You'll need a custom-built distro image, but that goes for like 90% of ARM hardware on Linux.

    • seemaze 2 hours ago
      I dropped a Framework mainboard in rack mount case and use it as a speedy low power x86 homelab as well as an inference server.
    • grubbs 3 hours ago
      Cheapest I've been able to get a DGX Spark FE is now around $4700 just FYI. This is from multiple vendors in higher-ed.
      • Catloafdev 2 hours ago
        Ah ya then that's a bit of a gap.

        For anyone considering these devices, the only reason I would recommend against them is if you plan on getting multiple to link together - the DGX Spark has a much, much faster interconnect bandwidth ceiling than the AMD devices do.

        Otherwise, they're great!

      • frugalmail 54 minutes ago
        I'm looking at Amazon and I see $4k GB10 devices right now (not an affiliate link) https://www.amazon.com/ASUS-Supercomputer-Superchip-Supports...
        • grubbs 8 minutes ago
          Yea I mentioned the FE version which is 4TB NVME. The one you linked is 1TB NVME.
    • icedchai 2 hours ago
      Yep, the only reason I bought mine (in late 2025, before hardware prices went totally crazy) was because it was half the price of a Spark. I spent a while fiddling around with the right Linux kernel, kernel firmware, ROCm installs, etc.
    • cyanydeez 2 hours ago
      yeah, if only there wasn't some global hegemony that immediately drove up the price of all memory everywhere...
      • tracker1 2 hours ago
        That's the rub... this platform was supposed to be around $1200-1400 maxed out, but now it's $4k, which is insane.
  • c7b 41 minutes ago
    This is just a little under the price of NVidia's DGX Spark with CUDA or a Mac with 128GB and twice the memory bandwidth. The point of Strix Halo used to be that it was half the price of those way more capable machines. You'd be crazy to buy the AMD chip at this price. But the hardware market is generally crazy right now, so I'm sure this will sell as well, unfortunately.
    • adrian_b 11 minutes ago
      Only the top variants of M5 Max have more than twice the memory bandwidth of AMD, but those are much more expensive, i.e. over $10,000.

      M5 Pro has as slightly higher memory bandwidth, but currently it is available only with up to 64 GB of DRAM. Even with this small memory, it is more expensive than either AMD or NVIDIA, especially when you do not want a puny SSD, but a normal-sized SSD, i.e. big enough to put there an LLM if you want to compute a quantization yourself (i.e. more than $5600 with a 4 TB SSD & 64 GB DRAM).

      If you want to do LLM inference, I do not see Apple as a competitive solution, as their price is much, much higher, while also having limited expansion for SSDs, where you need a lot of space if you want to store a few LLMs.

      The only thing that is correct is that the AMD Strix Halo system used to be much cheaper than NVIDIA, but now it has the same price. The CPU of Strix Halo is better than that of NVIDIA, but the NVIDIA GPU is likely to be better than the AMD GPU and CUDA is guaranteed to work fine.

    • xandrius 38 minutes ago
      Personally, I'm totally ok to have a competitor to Nvidia, regardless of whether they are under the price or not.
      • c7b 31 minutes ago
        But ideally they would be competitive, right? If your goal is LLM or Diffusion inference or - god forbid - training, you're going to get way better performance on DGX Spark. The difference is more stark than 250 vs 273 GB/s bandwidth delta would suggest.

        Now I think it's totally fine to have a less capable offering, and the Strix Halo is still a mighty capable machine for inference on mid-size MoEs. At 2k it was a tinkerer's dream. But the performance difference should be reflected in the price. This is roughly a doubling of the price compared to less than a year ago without adding any notable features, it's appalling.

    • tencentshill 19 minutes ago
      The Nvidia DGX are sitting on the shelf unsold at $4.5k.
    • p1esk 37 minutes ago
      where do you see "twice the memory bandwidth"?
      • c7b 25 minutes ago
        The M4 Max with 128GB RAM has 546GB/s memory bandwidth [0], compared to Strix Halo's 250 (on the label, I've yet to see a benchmark that tops 220). It's not available at 128GB RAM anymore, at least in my shop, but when it was not so long ago it was about 4,7k, or a little over twice the price of a cheaper Strix Halo PC (around 2,2k a few months ago).

        [0] https://en.wikipedia.org/wiki/Apple_M4

      • ahmadyan 33 minutes ago
        He is making things up. It is the same bandwidth as DGX Spark (256 GB/s vs 273 GB/s) and far behind M3 Ultra (~819 GB/s)
        • c7b 13 minutes ago
          You're the one making things up. An M3 Ultra with 128GB RAM doesn't exist, the M3 Max has 410GB/s bandwidth [0]. I was of course talking about the M4 Max with 546GB/s, which was closer to twice the price of a Strix Halo mini PC in a typical configuration when it was still available. And memory bandwidth isn't everything, NVidia's lead in software is substantial, look up any tests comparing them side-by-side.

          [0] https://en.wikipedia.org/wiki/Apple_M3 [1] https://en.wikipedia.org/wiki/Apple_M4

  • codedokode 2 hours ago
    32 Gb DDR4 RAM module has a bandwidth of 25 Gb/s and costs $160. If you buy 8 of these, you get 256 Gb RAM with 200 Gb/s bandwidth at $1280. And if you buy 16 x 16 Gb modules (each at $60) then you can get 400 Gb/s of bandwidth for $960.

    The only problem, you need 8 or 16 memory controllers. Memory controllers are not that expensive: Intel Core i3-14100F has 2 channel controller and costs $110, so we can estimate that 16-channel controller should cost not more than $880, and 8-channel controller should cost $440.

    So isn't it better to make a cheap CPU with 16 DRAM controllers instead of this $4K gear having only 128 Gb? Or maybe 2 CPUs each having 8 RAM channels?

    DDR5 costs 2 times more ($360 for 32 Gb) while not even having 2 times the bandwidth so it is not worth buying. It is more reasonable to make more RAM channels and stuff them with DDR4.

    • wmf 1 hour ago
      If you want Epyc go for it. The motherboards can be quite expensive though.
    • codedokode 1 hour ago
      So what I am trying to say, industry took a wrong turn. Instead of moving to over-priced DDR5, they should just make even cheapest CPUs support 8/16 DDR4 channels. Because a 32Gb DDR5-4800 module costs $360, and two 32Gb DDR4-3200 modules cost $320, so you get twice more size, more bandwidth and it costs you less. DDR5 is just a rip off.
      • bradfa 1 hour ago
        Each memory controller interface is a not-insignificant number of PCB traces. Increasing the number of memory controllers may dramatically increase the number of PCB layers (or may not, it really depends on the CPU pinout) but it definitely will increase the number of pins on the CPU socket.

        This is one of the main reasons (the other is the number of PCIe lanes) why high end desktop and server CPUs have like double the number of pins and so much bigger sockets as compared to consumer desktop CPUs.

        • codedokode 25 minutes ago
          Then what's about using 4-8 cheapest motherboards with 64Gb DDR4 and a cheap CPU, and connecting them via PCIE x16 sockets?

          And as for DRAM channels, typical cheap motherboard has 2 channels and 4 slots, it should not be super difficult to add 2 more channels.

          • icedchai 8 minutes ago
            Don't you need a new CPU to support more channels? It doesn't sound like a cheap, trivial change to upgrade my Ryzen to a Threadripper.
      • icedchai 1 hour ago
        In the alternate reality where this happened, wouldn't the price of DDR4 still be sky high? We'll ignore any costs for CPU, chip set, and motherboard redesign. You're just pushing the demand somewhere else.
        • codedokode 27 minutes ago
          > any costs for CPU, chip set, and motherboard redesign.

          Yes they spent those costs to switch from DDR4 to over-priced DDR5 and I suggested the cost could be spent on adding more DDR4 channels instead.

      • tbrownaw 1 hour ago
        > just make even cheapest CPUs support 8/16 DDR4 channels

        Isn't adding pins kind of expensive?

        • arnitdo 1 hour ago
          Well to be honest, there are a lot of NOOP pins on CPUs, but using them basically means fabbing a new die altogether, which is basically making a whole new CPU altogether.
          • bronson 39 minutes ago
            This is an odd comment. Pins are seriously expensive. Companies don't just throw them in for fun. Usually they're necessary for signal integrity or packaging constraints.
  • __rito__ 42 minutes ago
    I was in Gray Scott School for HPC last week, and even in scientific usage, CPU-only cases, AMD is still a pain point. Many tools and libraries don't have first class AMD support or any support at all.

    It loses to Intel in CPU, and NVIDIA in GPU, in case of scientific libraries and HPC-worthy libs, tools.

    I think people who want an "AI Dev Kit" will lean towards Intel + NVIDIA setup.

    I am not a fan of Intel, but their MKL, MPI, etc. are not paralleled. Same goes for CUDA with NVIDIA.

  • aunty_helen 2 hours ago
    256gbs memory bandwidth is about 1/4 that of a 3090. It would be a better buy with half the memory at 4x the speed.
    • wolttam 2 hours ago
      Are you sure about that? High memory speed is great for dense models, or when serving at high concurrency.

      However for local single-user setups, it's often better to have access to more capable/bigger MoE models at reasonable speeds and lower concurrences, which is enabled by these platforms.

      • roadside_picnic 2 hours ago
        If you're using a MoE model, then why do you care about the larger RAM offered by these devices? That's the main problem with low bandwidth devices: they limit the effective ram you can make use.

        I do (and have historically done) quite a work with both local LLMs and local diffusion models. I have an M3 Max MBP at 400 GB/s and also a desktop with a RTX 4090 with 1,008 GB/s

        While the M3 Max MBP can serve up MoE reasonably fast (~60 token/sec)the RTX 4090 is an entirely different experience (~170 token/sec). I also do a fair bit of experimentation and am currently running a custom decoder that requires expensive look-ahead, but I'm still able to get a usable 25 token/s on the RTX.

        The raison d'etre for the DGX spark is not practical home inference, but rather offering the same fundamental architecture as data center cards for a affordable CUDA prototyping. If you want to build software to run on H100s, you probably can't justify buying (and running) a single card. The DGX spark solves this by having the same fundamental setup as what those cards have.

        That makes these non-NVIDIA DGX-like devices confusing to me. The entire benefit of the DGX series is the NVIDIA architecture itself.

        Anyone interested in home LLMs should decide whether a Mac or a dedicated GPU is the more sensible path based on their budget and other computer use. Each has their own benefits.

        • wolttam 1 hour ago
          I run DSv4 Flash at home on 2 DGX Sparks and am pretty sure there is no more cost effective way for me to do so. I'm not interested in running smaller models.
          • roadside_picnic 26 minutes ago
            What's the tokens/sec you're getting on that setup (genuinely curious because it's a setup I haven't actually run myself)?
    • StableAlkyne 1 hour ago
      Any performance gains caused by the internal bandwidth of the card will evaporate once you spill into system RAM, because now your bottleneck is probably a slow PCI lane.

      And if your jobs do fit onto a 24GB card, then you are not the target user for the "AI mini PC" niche that these guys are trying to carve out

    • muyuu 2 hours ago
      it depends

      it allows you to run smaller models much better

      imo 3090s make the most sense if you can buy at least 2x ideally 4x but of course we're talking about a completely different budget at that point

    • cyanydeez 2 hours ago
      what matters is how much memory it has; with the new MTP models, Qwen3.6 with 35B MOE, it's pumping out tokens up to ~80k context with little slow down.

      It's great to get lots of tokens, but being able to handle and extent context is why it'll continue to be a great machine compared to any of the small graphics cards.

  • onraglanroad 3 minutes ago
    I think I might be tempted to wait for the Butlerian market crash and pick up stuff from the firesale.

    Depends how long this market can remain utterly loony though.

  • ahmedehab_01 2 hours ago
    Why do all similar products have a hard limit on the 128 GB VRAM part? For that price, I hoped to get at least 224 GB VRAM
    • wmf 2 hours ago
      The 495 is going to support 192 GB. It depends on the memory bus.

      128 bit: 96 GB?

      256 bit: 192 GB

      512 bit: 384 GB?

      1024 bit: 768 GB?

    • croes 2 hours ago
      • jauntywundrkind 2 hours ago
        From the replies,

        > A shame, really, as the Ryzen 7640U, 7840U, 7840HS, and 7940HS all support 256GB of RAM.

        To be fair, those platforms support dual dimms per channel, which Strix Halo would not, at least not at it's high speeds.

        But reciprocally Gorgon Halo 400 just launched and it supports... 192GB. And is the exact same APU.

        Memory chips did finally have their first big doubling per chip semi recently (available last February), with 48 & 64GB dimms becoming available. There is some reasonable lag here, that Strix Halo & Gorgon Halonuse lpddr5x, which perhaps had some lag, that 32GB (x4) was the best available. But now with Gorgon Halo being 192GB capable but not 256GB, it sure feels looks & seems like this is just bad spirited fuckery from AMD. https://forum.level1techs.com/t/where-are-the-ddr5-unbuffere...

        • wmf 2 hours ago
          I assume they validated certain DRAM chips when the 395 first came out and they're just not going to validate any more. So newer DRAM is validated for the 495. We can't compare DDR5 and LPDDR5 since they are completely different; if 256 GB DDR5 is possible that doesn't mean anything.
    • HDThoreaun 1 hour ago
      All the gpu makers make all their profit selling datacenter products. They don’t want consumer/home lab stuff with lower margins to replace their data center products so they handicap the vram in those products to make them less enticing for datacenter use.
  • robotswantdata 3 hours ago
    Was “only” $2k in its previous form but even in this updated box the mem bandwidth is woefully inadequate. There’s a few models with space for a dedicated GPU for hybrid inference but imo not worth it. Save your money for a Xeon or EPYC build
  • dwroberts 1 hour ago
    Seems not really worth it? About the same cost as DGX, same amount of memory and yet the bandwidth is actually slightly lower. And also the DGX is CUDA being an Nvidia device which is a big compatibility advantage

    For this to be compelling it would need to be eg 256GB minimum or something

  • ManlyBread 16 minutes ago
    wow only $4k for an unupgradeable computer that will never be able to run anything that uses CUDA
  • devld 1 hour ago
    15 square cm box? Wow. Are there similar size, but less powered (and cheaper) workstations? I need a box that can build chromium reasonably fast and I would rather have something portable like this than a PC tower, but this is an overkill at $4k.
    • wmf 46 minutes ago
      Look at Minisforum; they have a bunch of different models.
  • nightski 3 hours ago
    I recently bought a few sparks from Micro Center for the exact same price and it comes with ConnectX-7 200Gbps inter-connectivity. Not sure how AMD feels it can charge exactly the same for less.
    • vlian2088 3 hours ago
      it's 2026.07 and 128 GB of VRAM costs a firstborn.
      • nightski 2 hours ago
        The spark also has 128GB VRAM (same type) and by recently I mean I bought them last week for $3999 each.
        • cyanydeez 2 hours ago
          yeah, so $500 spread https://www.microcenter.com/product/699008/nvidia-dgx-spark is what the current price appears to be.

          The differences are basically, sparks require ARM and sparks allow interconnects; so if you do have dreams of electric sheep to chain them together, you're not gonna get the AMD halo units.

          But if you just want to putz around with a dev machine and do other things, not sure you'd want a spark.

          • nightski 40 minutes ago
            They had it on sale last week for $3999, it will likely happen again. Also if you are willing to buy ASUS/Acer/MSI you can get them cheaper, in the same range as well. Those units are identical (mainboard/ram/chipset/connectivity), they only tend to differ in SSD being offered.
      • codedokode 1 hour ago
        Please note that 8 x 16 Gb DDR4 modules cost $480, and have a bandwidth of 200 Gb/s, the only problem you need 8 DRAM controllers.
        • nicce 1 hour ago
          > the only problem you need 8 DRAM controllers.

          Which is a huge problem? Even using 2x memory controllers in typical consumer motherboard can make system very unstable.

  • ndom91 2 hours ago
    Wow the prices on these have really come up.. Got my Framework desktop mainboard (Just the motherboard + CPU + soldered 128gb RAM) in Dec 2025 for ~1900 EUR
    • kccqzy 2 hours ago
      Indeed December 2025 was the best time to buy.
  • paxys 1 hour ago
    I was considering getting an AI Max+ machine last year when the price was around $2K. Crazy to see the same specs now going for double the price.
  • htrp 3 hours ago
    Does this have the same memory bandwidth problems as the spark?
    • winterphoenix96 3 hours ago
      Yes. And the same not-enough-memory problems too
    • Schiendelman 3 hours ago
      What's the Spark's memory bandwidth?
      • jtbaker 3 hours ago
        273 GB/s. Same ballpark as M4 Pro and Strix Halo.
        • Schiendelman 3 hours ago
          Ah yeah, bummer. It's fine for building something that you know needs to run faster in the next generation.
  • woodrowbarlow 2 hours ago
    i wish there was a system like strix halo, but with enough lanes for a dedicated PCIe 5.0 x16 slot so you can have the best of both worlds: large sparse models on CPU with unified memory, dense models on GPU with real tensors and higher bandwidth memory.
    • bronson 32 minutes ago
      AMEN! 100% agree.

      Plus a reasonably inexpensive super low-latency interconnect.

  • syntaxing 3 hours ago
    I have another strix halo that I got for half the price (before this price increase world wide). AMD making lemonade is one of the best reasons to get a strix halo. Lemonade + qwen3.6 35B MTP @ Q8_0 + anythingLLM (in docker) replaced 90%+ of my AI usage. And it’s fully local! Setting everything up took less than 3 hours total, including installing the OS

    https://lemonade-server.ai/

  • PHr15 2 hours ago
    Even a two-year-old Mac Studio outperforms this kit. A used unit with sufficient memory currently seems to offer the best price-to-performance ratio

    "The Apple Silicon Mac Studios outperform the AMD Ryzen AI Max+ 395 machines"

    • Grombobulous 40 minutes ago
      I imagine there may be users who can’t use macOS, or maybe they want the ability to upgrade storage.

      The framework desktop even has a usable PCIe 4x slot available if you put the board in a different case. They sell the 128GB board on its own for $3150.

    • bronson 35 minutes ago
      And how much can you buy a 128GB Mac Studio for now? Go look. I think you'll be shocked.
    • LabsLucas 53 minutes ago
      Comically, the 512 GB M3 Ultra Mac Studio that we tested isn't even available for purchase any more. The highest you can purchase from Apple is 96 GB.
    • jeffbee 2 hours ago
      A 2-year-old Mac Studio 128GB also sells for more.
  • daft_pink 2 hours ago
    It would be really nice if they included clustering support like a blueprint on how to buy several of these and cluster them to run the really large models in the best way possible.
  • glimshe 3 hours ago
    How much are we going to pay for "AI kits" once the DRAM shortage is over? Will we be able to run a local model equivalent to the current AI frontier in sub $1000 hardware, even if dedicated, in 5 years?
    • url00 3 hours ago
      Yeeeeep. There is no moat at the moment. AI companies are trying to dig one as fast as they possibly can. Either through passing laws to prevent local inference ("It's too dangerous! We need to control it") or by creating/limiting possible integrations (locking down OS/hardware, APIs/MCPs that only work with Claude/ChatGPT, etc).
      • yomismoaqui 2 hours ago
        Good luck trying to enforce those laws outside of the USA. And in the future China will be happy to sell local inference hardware at competitive prices.

        Open, cheap & good enough will win the race.

    • moelf 3 hours ago
      frontier to laptop runnable open weight so far seems to be ~2 years latency, so maybe there's some hope
      • tracker1 2 hours ago
        For that matter, just getting Chinese DRAM into the market could cool pricing down a lot to oppose the cartel.
        • wmf 2 hours ago
          No it won't because Chinese DRAM manufacturers have relatively low capacity and it's already being used. And in an auction, prices from different suppliers converge.
    • tracker1 2 hours ago
      When this hardware was announced, it was expected to be in the $1200-1400 range new... so, maybe. The real question is will the powers that be let this bubble burst, and how painful will the fallout be... I have a feeling it will be worse than 2001-2002.
  • snarfy 2 hours ago
    I want to play with openclaw for continuous workflows without burning my cloud credits. Do I want this?
    • jdiaz97 2 hours ago
      no, you openclaw is too vibecoded, use Hermes
  • musha68k 2 hours ago
    I had hoped this was about Medusa Halo, but unfortunately, it's about 2025 technology. It's the same as Framework Desktop was at the end of last summer, which would have been a slightly silly but fun buy at $2k... I'd hope Mark Cerny / Sony launch PS6 sooner rather than later, as together with the upcoming LPDDR6 standard, it should trickle down to us in the local LLM mud eventually?
    • re-thc 2 hours ago
      > I hope Mark Cerny launches his PS6 sooner rather than later

      With the current RAM and SSD prices... I rather a bit later.

      • musha68k 2 hours ago
        True, this is the new reality though. My main gripe with Strix Halo is memory bandwidth and compute performance. Gaming performance sits squarely in base PS5 territory just as is the case with Steam Machine AFAIR; yet due to economies of scale "cheap" 2020 era PS5 still has higher memory bandwidth by quite a bit last time I checked.

        PS6 "undertaker of physical media" will supposedly be priced >$1k: https://youtu.be/-F1JS-4Abjo

  • khurs 3 hours ago
    Are the likes of Dell and Lenovo not going to be annoyed that AMD are cutting them out?

    As traditionally AMD was a supplier of parts.

    • tracker1 2 hours ago
      Both Dell and Lenovo have tended to favor Intel first... even more recently on business laptops.
    • benoau 3 hours ago
      Do they care that Microsoft is selling the Surface, or that Intel used to sell the NUC?
      • khurs 3 hours ago
        Intel = Fair as they sell both Intel and AMD so no loyalty on either side.

        Microsoft = yes, they care enormously, as Surface has taken away many sales. Albeit they sold some ChromeBooks

  • danielrmay 2 hours ago
    Perhaps if less spending went towards their private aviation interests LTT labs could review a piece of hardware that was released _this_ year, or maybe extend their narrow testing process to cover real-world use metrics like TTFT. Not to mention the lack of real value-perf comparison to CUDA
  • alexdns 3 hours ago
    Bosgame is $2799 does the same thing if you plan to run only 1 of them
    • mhitza 3 hours ago
      The repeated claim that all these different forms are not directly comparable is a very strange aspect.

      Only thing that separates them is the build quality and the extra 20W of boost the framework desktop and this variant support.

      They have a note on the thermals but no measurement of noise. Doesn't matter if it's stricly a whoosh or a whine, only if they bother people in the same room. And the small ones like Bosgame get a consistent complaint about the noise in in-depth youtube videos.

      • alexdns 11 minutes ago
        The framework has a noisy PSU , the bosgame is noisy However you can fix both - the bosgame leaves you a large margin to do so
  • m0llusk 51 minutes ago
    Seems like having a big and clunky external power supply enables a smaller profile for the rest of the unit while making installation a bit more complex. How exactly is this thing going to be installed for use? Wouldn't it be easier to just have a bigger box with more shielding and heat dissipation?
    • wmf 42 minutes ago
      External power supplies make UL certification cheaper; that's the reason. I hate power bricks but I have so many on my desk that one more makes no difference. The Beelink version has an internal PSU BTW.
  • frugalmail 1 hour ago
    When this was half the price of the DGX Spark, it made sense. But same price is a ridiculous premium for inferior performance but the ability to run Windows.
  • Scroll_Swe 1 hour ago
    So... I dont want to ruin gaming more but why not get a gaming PC? Figured this out 15 years ago if its good for gaming, put some more RAM in and boom you have a workstation...
    • Grombobulous 37 minutes ago
      The shortcoming is the memory speed/bandwisth.

      With a desktop your system memory is slow and your fast graphics memory is limited in size.

      To me it seems like the best bang for your buck in the BYO desktop PC space is to get a board with dual PCIe slots then find some old generation 24GB GPUs like RTX 3090.

      But you’re not getting access to more than 48GB of fast memory without something similar to this or a Mac Studio.

      • Scroll_Swe 26 minutes ago
        Interesting thank you, almost reminds me of a PS2 then, super fast memory but not very good "traditional" GPU
    • frugalmail 49 minutes ago
      The biggest problem is that if you want to run large (continuous memory) models, gaming graphics cards aren't sufficient, and if you manage to get graphics cards that you can chain it becomes a lot more expensive (and better performance) than these machines and GB10 machines.
  • zuzululu 51 minutes ago
    what can you realistically do with this ? $4k is a lot of money to spend on something like this without really being sure what models can reliably run
  • cat_plus_plus 2 hours ago
    Drastically slower than Macs and NVIDIA unified memory boxes while not being any cheaper.
  • anticorporate 3 hours ago
    [dead]
  • pettijohn 3 hours ago
    [dead]
    • alex43578 3 hours ago
      Is that price still available?
      • pettijohn 33 minutes ago
        I think I got lucky -- look for "revival" series on their web site. I happened to see it one time and pulled the trigger.
  • mikelitoris 1 hour ago
    I love(!) how these dev!kits are for devs in silicon valley making 300k+ a year and not any other dev in any other part of the world.

    Satire if you can’t tell…

  • azinman2 48 minutes ago
    The Mac beats it in all benchmarks, is probably more energy efficient, can add more ram, and is more cost efficient (?)… plus you get a Mac. This doesn’t even give you cuda. I’m not sure who this is for.
    • wmf 47 minutes ago
      The 128 GB Mac Studio is no longer sold and when they bring it back I predict it will be more expensive.
    • bigyabai 44 minutes ago
      This is for people that want an x86 machine instead of an ARM machine stranded on macOS.