Description

Previous Build - https://pcpartpicker.com/b/k4pG3C

This is the completed form of Radeon-V which standed Radeon-Virtualized.

This build is called Radeon-eXtended Virtualization. Made for Virtualization and other heavy core usage workloads

Let me start with the specs.

  • 4x Opteron 6276 @ 3GHz OC

  • 256GB of DDR3-1066MHz RAM.

  • 4x Dynatron A13/R27 Cooler

  • 2x R9 Fury X Crossfire

  • 480GB Sandisk Ultra II

  • Modified Rosewill RISE Case

  • Lepa G1600-MA

Previous Radeon-V build could only hit 2.8GHz maximum (2.7GHz maximum with Virtualization on) with that airflow configuration, and frankly it was way too loud for normal usage.

So I got bigger 3U coolers intended for workstations and upped memory from measly 64GB to 256GB of DDR3. and rearranged Fury X radiators so that hot air would escape the system at much faster rate.

This allowed me to break through 3GHz barrier with Virtualization on, which was not possible.

It is fully stable after 10 hour torture loop and CPU-Z validation - https://valid.x86.fr/i811gx

I broke World record for the highest non-ES Quad Opteron 6276 with all of its memory channels loaded with High density Quad Rank 16GB modules, clocking from base of 2.3GHz to 3GHz on all 64 cores. Basically 30% Frequency increase across all cores.

I still feel that these Opterons have headroom left, so I will try and hit 3.1-3.2GHz in following weeks

Comments

  • 24 months ago
  • 7 points

WOAH

Nice world record

hopefully you can create a world record for most

+1

on a post

  • 24 months ago
  • 3 points

He already made a record for largest amount of RAM sticks in a single PC.

[comment deleted by staff]
  • 24 months ago
  • 2 points

I have never seen this much ram. holy crap +1

  • 24 months ago
  • 1 point

Hello sir, of course there's no need to call out Trick-or-Treat, you immediately get the chocolate bars and the +1's.

On another note, you wrote in your Radeon V description: "This computer can game, but it's primary function is to do as many things as possible while focusing on heavy FP32 Compute and HPC via Opteron Cores"... Could you explain what FP32 compute and HPC are, in layman terms? Excuse the noob question but curiosity strikes!

  • 24 months ago
  • 1 point

HPC is general term for High Performance Computing - which requires high floating precision performance (usually FP32/FP64) to be crucial to its calculation time. These things usually include simulation and cryptography.

FP32 is floating point 32-bit, 232 digits are calculated, hence that why you see lower FP64 TFlops because it is not just twice FP32, but rather much more complex to calculate.

  • 24 months ago
  • 1 point

this is nuts... 64c/128t with 256gb of mem... thats more than my ssd ._., you can create a 120gb ramdisk like damn - also i saw a comment where you hate the generic i7 and x80ti sli so, would you rate my build

  • 24 months ago
  • 2 points

you have a good build, it's just that I prefer to use server hardware and push it to the limit and was tired of seeing generic builds all the time.

  • 24 months ago
  • 1 point

legit i woke up this morning, and I was like, wow that Opteron build is insane I wish I had it, this is legit the first build that I've ever contemplated on a long period of time, another +1 for the longevity factor

  • 24 months ago
  • 1 point

PS idk if its ok to give it out but your product ID for something is in one of the pictures

  • 18 months ago
  • 1 point

It is nothing to be worried about. It's your product key you don't want people knowing/seeing.

  • 23 months ago
  • 1 point

I prefer to use server hardware and push it to the limit and was tired of seeing generic builds all the time

I love that mentality. "Unconventional" is way more fun than "best"!

  • 23 months ago
  • 2 points

4 CPU overclocking, now that's a rare configuration that only few people will experience.

  • 24 months ago
  • 1 point

Sooooo.....would it be possible to get a pic of task manager showing all those cores and threads? Because I feel like that would be pretty satisfying.

  • 24 months ago
  • 1 point
  • 24 months ago
  • 1 point

Fantastic! Thanks!

  • 24 months ago
  • 1 point

AMAZING!!!!

  • 24 months ago
  • 1 point

Now time for the liquid-nitrogen loop with a radiator that's a yard long and a five gallon reservoir.

please, don't actually do that.

this is insanity. +16, one for each core.

  • 24 months ago
  • 1 point

Now that is one crazy amount of "horsepower" you got there! +1

I can't really tell from the pictures if you have occupied all the fan mounts but I think you could reach your overclocking goal with some extra airflow in there.

  • 23 months ago
  • 1 point

Holy $h!t 256gbs of ram and 64 frickin cores damn son is this in Guinness book of world records? +1 for each core

And where did you get the mobo?

  • 23 months ago
  • 1 point

WOAOH! Quad Opteron...!

+1 Pure Awesomeness.

  • 23 months ago
  • 1 point

Opteron chipsets aren't supposed to support Crossfire, so did you have to perform black magic with the drivers to get that working, or did Supermicro do the black magic for you (PLX switch)? Or are you still asking yourself why it's working properly?

Those chipsets also aren't supposed to support conventional overclocking from what I've read, so did you apply the 30% increase to the BCLK? If so, I'm baffled it's stable enough for heavy FP32 computing without melting the VRMs.

Lastly, did you have to modify the PSU/cables to work for all those CPU power headers, seeing as it's not strictly a server PSU?

(This machine has me very curious. You should be proud of your work.)

  • 23 months ago
  • 2 points

Glad you asked this question. I have to tell you something though, there is no PLX switch, but rather this thing is a dual Northbridge System, which means there are 2 PCIe hubs that is connected via HyperTransport 3.1. The Chipsets respectively are based off of 800-series AMD Chipsets, SR5690 and SR5670 mirror 890FX and 870 Chipsets but validated for server and has link crossbars for multi-CPU systems.

Since the 800-series chipsets support Crossfire Natively, I guess the drivers detect that these are indeed based off 800-series chipset so Crossfire is supported regardless. However what confuses me the most is that the each Fury X is linked to different Chipsets respectively, so I don't know how that works out.

As for overclocking, I applied VRM heatsinks first, then went from 200MHz BCLK to 231MHz BCLK, with .075V increase across all the CPUs. They were rated for 115W, and now runs at 145W-160W per CPU.

There is a reason I specifically went for Lepa G1600-MA, it is one of the best 1600W models available, and it has 2 8 pin EPS + 1 4 pin EPS which can be doubled for an 8 pin, for stabilizing power. The power circuit construction on this board is quite interesting, the lower cut-down versions of these boards have only 2 EPS connectors, which led me to conclude that the third CPU power header is actually for stabilization rather then regular power supply to the CPUs. So the configuration is like this from PSU to the board, 2 EPS go to CPU EPS 1, 2 of the board as they will get the main power from there, CPU EPS 3 gets a split 4-pin EPS from PSU because the job of CPU EPS 3 is to stabilize requiring less load.

  • 24 months ago
  • 0 points

+1

[comment deleted by staff]
  • 24 months ago
  • 1 point

"This computer can game, but it's primary function is to do as many things as possible while focusing on heavy FP32 Compute and HPC via Opteron Cores"- his last edition of this beast.

this came from the last version found here- https://pcpartpicker.com/b/k4pG3C

[comment deleted by staff]
  • 24 months ago
  • 1 point

R9 Fury X drivers are stable as they have been out for a long time, Vega drivers are still in development and I have encountered some bugs while operating.

nVidia cards unless they are Quadro or Tesla, I will refuse to use it because their proprietary drivers are pain in the *** to work with while in Virtualization.

R9 Fury X Compute performance is still fine, and their short PCB length + watercooling loop helps with isolating heat out of the case from rest of CPU heat.

[comment deleted by staff]
  • 24 months ago
  • 1 point

unfortunately, while there are other CPUs out right now, the fact that 256GB of DDR4 would cost me around 3 Grand is just unacceptable.

Newer GPUs I will get, such as Vega 64 or Vega FE, but for now Fury Xs do fine as compute modules and virtualization.

[comment deleted by staff]