Here is an example of the performance drop that happens as context size grows:
-
**General rule: look at benchmarks with the specific model and context size you're interested in.** The [[AI section|AI/AI-Capabilities-Overview]] of our wiki has links to some community-generated benchmarks, but if you can't find your specific model, ask in [our Discord](https://discord.gg/pnPRyucNrG) for someone to test it for you. This is important - don't give in to hype only to be disappointed later.
+
**General rule: look at benchmarks with the specific model and context size you're interested in.** The [[AI section|AI/AI_Capabilities_Overview]] of our wiki has links to some community-generated benchmarks, but if you can't find your specific model, ask in [our Discord](https://discord.gg/pnPRyucNrG) for someone to test it for you. This is important - don't give in to hype only to be disappointed later.
So far, we've just been talking about text models, which Strix Halo handles relatively well, but it's important to note that **image and video generation is just slow** (and sometimes entirely broken!). Most pipelines are optimized for CUDA, and while AMD (ROCm, Vulkan) support has been getting better, software support and optimization is still a big issue.
@@ 24,7 24,7 @@
What about other, non-AI related tasks? Well, it's great! If we're talking about the top-of-the-line AI Max+ 395, in terms of raw CPU performance it could even be compared to the Ryzen 9 9950X (being roughly just 5% slower), which is really impressive. The iGPU is also the best one available on the market so far. Depending on the power limit, the 8060S performance lies somewhere between desktop versions of RTX 3060 and 4060, leaning closer to the latter and in some cases even beating it.
-
All of that, along with a huge amount of RAM, also makes the platform very interesting for running VMs and acting as a home server. However, note that [[GPU passthrough|Guides/VM-iGPU-Passthrough]] on consumer AMD cards is very lacking and plagued with problems.
+
All of that, along with a huge amount of RAM, also makes the platform very interesting for running VMs and acting as a home server. However, note that [[GPU passthrough|Guides/VM_iGPU_Passthrough]] on consumer AMD cards is very lacking and plagued with problems.
#### All at Once
@@ 32,7 32,7 @@
## Choosing the Right Configuration
-
There are four main types of Strix Halo-based devices: mini PCs, AIOs, laptops, and handhelds. Laptops and handhelds are typically power and cooling limited, so their performance is generally lower. However, the difference between 55W and 120W power limits isn't that massive ([[5-35% depending on the task|Guides/Power-Modes-and-Performance]]). This guide is mostly centered on mini PCs since this seems to be the most popular option.
+
There are four main types of Strix Halo-based devices: mini PCs, AIOs, laptops, and handhelds. Laptops and handhelds are typically power and cooling limited, so their performance is generally lower. However, the difference between 55W and 120W power limits isn't that massive ([[5-35% depending on the task|Guides/Power_Modes_and_Performance]]). This guide is mostly centered on mini PCs since this seems to be the most popular option.
There are several different models of Strix Halo APUs available:
@@ 44,21 44,21 @@
## What Mini PC to Buy
-
About 90% of Chinese PCs (GMKtec, Bosgame, FEVM, Corsair, NIMO, etc.) are built on the same [[platform made by Sixunited|Hardware/Boards/Sixunited-AXB35]]. It's nothing to write home about, but performance-wise (which I think is the most important thing) it will be roughly the same as anything else, so it's a valid option if you want to go the cheapest route. Things to look out for: import taxes, warranty, support (or the lack thereof). Also note that the BIOS on these systems is extremely limited and getting updates is an adventure in itself.
+
About 90% of Chinese PCs (GMKtec, Bosgame, FEVM, Corsair, NIMO, etc.) are built on the same [[platform made by Sixunited|Hardware/Boards/Sixunited_AXB35]]. It's nothing to write home about, but performance-wise (which I think is the most important thing) it will be roughly the same as anything else, so it's a valid option if you want to go the cheapest route. Things to look out for: import taxes, warranty, support (or the lack thereof). Also note that the BIOS on these systems is extremely limited and getting updates is an adventure in itself.
**When sourcing from Chinese manufacturers, consider purchasing through established marketplaces** like Amazon, AliExpress, Taobao, JD (depending on where you're located and what options are available) as these platforms typically offer stronger buyer protection policies, streamlined return processes, and dispute resolution mechanisms in case of defective products or shipping issues, which are not that uncommon in that case.
-
Based on the survey data, **[[GMKtec EVO-X2|Hardware/PCs/GMKtec-EVO-X2]]** and **[[Bosgame M5|Hardware/PCs/Bosgame-M5]]** seem to be the most popular Chinese options, with most buyers being satisfied with their purchases. GMKtec appears slightly more reliable, while some Bosgame units had minor issues like stuck power buttons.
+
Based on the survey data, **[[GMKtec EVO-X2|Hardware/PCs/GMKtec_EVO-X2]]** and **[[Bosgame M5|Hardware/PCs/Bosgame_M5]]** seem to be the most popular Chinese options, with most buyers being satisfied with their purchases. GMKtec appears slightly more reliable, while some Bosgame units had minor issues like stuck power buttons.
-
**[[Corsair AI Workstation 300|Hardware/PCs/Corsair-AI-Workstation-300]]** is also a decent one. It's a stock Sixunited's PC, but brand reputation likely force them to have a better quality control and support.
+
**[[Corsair AI Workstation 300|Hardware/PCs/Corsair_AI_Workstation_300]]** is also a decent one. It's a stock Sixunited's PC, but brand reputation likely force them to have a better quality control and support.
-
**[[Beelink GTR9Pro|Hardware/PCs/Beelink-GTR9-Pro]]** is a very interesting system in Mac Mini style which is unfortunately plagued by major stability problems which no one was able to solve for over 3 months already. **Avoid unless something changes on that front.**
+
**[[Beelink GTR9Pro|Hardware/PCs/Beelink_GTR9_Pro]]** is a very interesting system in Mac Mini style which is unfortunately plagued by major stability problems which no one was able to solve for over 3 months already. **Avoid unless something changes on that front.**
-
**[[Minisforum MS-S1 MAX|Hardware/PCs/Minisforum-MS-S1-MAX]]** seems decent and also has a PCIe slot for expandability, along with two 10G Ethernets. Early feedback suggests good build quality and premium feel, however some people report problems with the network interfaces on Linux and sub-optimal fan curves, both problems could likely be fixed in software later.
+
**[[Minisforum MS-S1 MAX|Hardware/PCs/Minisforum_MS-S1_MAX]]** seems decent and also has a PCIe slot for expandability, along with two 10G Ethernets. Early feedback suggests good build quality and premium feel, however some people report problems with the network interfaces on Linux and sub-optimal fan curves, both problems could likely be fixed in software later.
-
**[[HP Z2 Mini G1a|Hardware/PCs/HP-Z2-Mini-G1a]]** is still the only option from big Western manufacturers. They claim there's an ECC memory option, but I've never seen anyone with actual ECC modules (only ECC-link). It boosts up to 160W (although going beyond 120W leads to very questionable gains) and is noisier than Sixunited's cooling, which is hard to imagine. Pricing is all over the place, if someone could find it for an adequate price (sub $2500), then it could be recommended because with HP you at least get some level of support. Also features the PRO version of the APU, with the only real difference being DASH support.
+
**[[HP Z2 Mini G1a|Hardware/PCs/HP_Z2_Mini_G1a]]** is still the only option from big Western manufacturers. They claim there's an ECC memory option, but I've never seen anyone with actual ECC modules (only ECC-link). It boosts up to 160W (although going beyond 120W leads to very questionable gains) and is noisier than Sixunited's cooling, which is hard to imagine. Pricing is all over the place, if someone could find it for an adequate price (sub $2500), then it could be recommended because with HP you at least get some level of support. Also features the PRO version of the APU, with the only real difference being DASH support.
-
**[[Framework Desktop|Hardware/PCs/Framework-Desktop]]** is the crown jewel of them all - pretty good in all possible measurements, except for size. It can be recommended as a guaranteed plug-and-play device with decent support and a huge community. However, it's also a bit pricey and availability sucks. Some users experienced longer wait times (over a month), and there were occasional PSU fan noise issues.
+
**[[Framework Desktop|Hardware/PCs/Framework_Desktop]]** is the crown jewel of them all - pretty good in all possible measurements, except for size. It can be recommended as a guaranteed plug-and-play device with decent support and a huge community. However, it's also a bit pricey and availability sucks. Some users experienced longer wait times (over a month), and there were occasional PSU fan noise issues.
You can also check out [the spreadsheet that aims to compare all possible options](https://docs.google.com/spreadsheets/d/1QOvILBE7BZHICVWJ1ylmlO3jIMig1HYW6gIeZ1jhQXE/edit?gid=0#gid=0) (could be a bit outdated).
@@ 72,7 72,7 @@
## DIY Way
-
It is possible to buy just the board and build your own PC with it, but you'll basically be limited to the [[Framework's one|Hardware/Boards/Framework-Desktop-Mainboard]]. There are other options from [[Sixunited|Hardware/Boards/Sixunited-STHT1]] and [[MeeGoPad|Hardware/Boards/MeeGoPad-100AM]], but they seem to be hard to get and no owners were encountered in the wild just yet. If anything could be concluded from the quality of descriptions and brand reputation - avoid.
+
It is possible to buy just the board and build your own PC with it, but you'll basically be limited to the [[Framework's one|Hardware/Boards/Framework_Desktop_Mainboard]]. There are other options from [[Sixunited|Hardware/Boards/Sixunited_STHT1]] and [[MeeGoPad|Hardware/Boards/MeeGoPad_100AM]], but they seem to be hard to get and no owners were encountered in the wild just yet. If anything could be concluded from the quality of descriptions and brand reputation - avoid.