Ampere® and LINBIT® collaborated on some exciting benchmarking of Ampere’s Altra® Max Platform using LINBIT SDS to manage and replicate some seriously fast Samsung PM1733a SSD drives and are ready to start sharing our results.
The exhaustive hardware and software configurations, as well as the testing methods used along with their results can be found in the LINBIT SDS Benchmarking on Ampere Altra Max Platform technical report. This blog is intended as a summary, sharing the highlights found in the full report.
Reference Architecture Highlights
Ampere Altra Max (128 cores) AArch64 processors are complete system-on-chip (SOC) solutions built for large-scale, and high-performance storage. In addition to incorporating many high-performance cores, Ampere’s innovative architecture delivers predictable high performance, linear scaling, and high energy efficiency. More importantly, the high I/O bandwidth provides direct connections to multiple PCle devices like NVMe and SSD drives, which are essential for I/O intensive applications, such as transactional databases, engineering simulations, or multi-media applications.
Samsung’s PCIe® Gen 4-enabled PM1733 SSD will have double the throughput capabilities of current Gen3 SSDs, giving it the highest performance of any SSD on the market today. The NVMe SSDs come in two form factors, 2.5-inch and HHHL, with capacities ranging from 0.8TB to 30.72TB to suit the diverse needs of OEMs worldwide. The drives also ensure endurance of one or three drive writes per day (DWPD) over a five-year period.
LINBIT SDS delivers ultra-fast resilient block storage for private and cloud infrastructure. Using LINBIT SDS with Ampere Altra processors enables you to use commodity hardware with open source software to create high-performance storage clusters. With native integration with Kubernetes, LINSTOR® and DRBD® – the key software components of LINBIT SDS – make building, running, and controlling highly available block storage much simpler when providing persistent storage for Kubernetes environments.
The reference architecture used Kubernetes with LINBIT SDS to orchestrate the benchmarking jobs as well as the storage, with Ubuntu Jammy (22.04) as the Linux operating system. For hardware, three 2U Mt. Collins servers each with a single Ampere Altra Max Platform processor were used. Each of the three Ampere systems were equipped with eight Samsung PM1733a SSD drives. The three systems were interconnected using two separate Mellanox ConnectX-6 100GbE networks – one network for management and Kubernetes cluster networking, and one for DRBD’s replication.
Benchmarking Results
The results from the benchmarking were very impressive, especially considering only three nodes were used in the reference architecture. All tests were run with LINSTOR synchronously replicating to one other peer within the cluster using DRBD. Measured performance varied slightly between test runs, likely due to differences in the placement of Kubernetes pods and LINSTOR volume replicas. For this reason, we’re reporting the range among the tests run, along with the best results from among those tests.
Performance Test
Unit of Measurement
Best Measured Value
Ranges Recorded
Random 4KB Read
IOPS
25,504,950
19.91M – 25.50M
Random 4KB Write
IOPS
3,164,295
2.74M – 3.16M
Random 4KB RW (70/30)
IOPS
7,894,716
7.45M – 7.89M
Sequential 128KB Read
GiB/s
103.53
101.95 – 103.53
Sequential 128KB Write
GiB/s
17.61
16.53 – 17.61
The small footprint of this reference architecture, both in terms of physical cluster size as well as power consumption, when compared to the measured performance delivers a remarkably high performance to rack unit (U or RU) ratio. The Ampere server platform used was the 2U Mt. Collins platform, requiring only 6Us of rack space for the entire system. Reducing server count and power consumption while increasing performance reduces the total cost of ownership (TCO) when considering the direct and indirect monetary and environmental costs of your next product or service.
LINBIT and Ampere are continuing to work together to fully analyze the results and implications of our testing and partnership. Expect updates to this blog, as well as the full documentation, and more as our partnership matures.
Matt Kereczman is a Solutions Architect at LINBIT with a long history of Linux System Administration and Linux System Engineering. Matt is a cornerstone in LINBIT's technical team, and plays an important role in making LINBIT and LINBIT's customer's solutions great. Matt was President of the GNU/Linux Club at Northampton Area Community College prior to graduating with Honors from Pennsylvania College of Technology with a BS in Information Security. Open Source Software and Hardware are at the core of most of Matt's hobbies.
LINBIT is committed to protecting and respecting your privacy, and we’ll only use your personal information to administer your account and to provide the products and services you requested from us. From time to time, we would like to contact you about our products and services, as well as other content that may be of interest to you. If you consent to us contacting you for this purpose, please tick above to say how you would like us to contact you.
You can unsubscribe from these communications at any time. For more information on how to unsubscribe, our privacy practices, and how we are committed to protecting and respecting your privacy, please review our Privacy Policy.
By clicking submit below, you consent to allow LINBIT to store and process the personal information submitted above to provide you the content requested.
Talk to us
LINBIT is committed to protecting and respecting your privacy, and we’ll only use your personal information to administer your account and to provide the products and services you requested from us. From time to time, we would like to contact you about our products and services, as well as other content that may be of interest to you. If you consent to us contacting you for this purpose, please tick above to say how you would like us to contact you.
You can unsubscribe from these communications at any time. For more information on how to unsubscribe, our privacy practices, and how we are committed to protecting and respecting your privacy, please review our Privacy Policy.
By clicking submit below, you consent to allow LINBIT to store and process the personal information submitted above to provide you the content requested.
By completing payment, you agree to allow your credit card to be charged the amount indicated above for access to LINBIT certified binaries.