pg_ycsb is the new kid in town, improving on pgbench and already being used by some of the PostgreSQL hackers.benchmarksql is yet another TPC-C test that was used to validate the changes to B-Tree page splits.TPC-C tests based on oltpbench as alluded in this other pgsql-hackers discussion.HammerDB, also mentioned earlier, is discussed in a recent post on pgsql-hackers list.The AWS Benchmark mentioned above is based on pgbench and sysbench.Google doesn’t provide a guide specific to PostgreSQL, however, the Compute Engine documentation contains a load testing guide for SQL Server based on HammerDB.įollowing is a summary of benchmark tools based on their references are worth being looked at: The AWS Benchmark Procedure for Aurora guide is easy to find, available right on the Amazon Aurora Resources page. The good news is that two of the three players in this test, have included benchmarks in their documentation. I would expect every cloud provider to provide procedures for benchmarking their services, especially when the first cloud experience may not start on the right foot.
However, selecting the right benchmark tool and parameters are important in order to gather meaningful results.
Selecting the Right Benchmark Toolīenchmarking PostgreSQL comes up quite often on performance mailing list, and as stressed countless of times the tests are not intended to validate a configuration for a real life application. I am a firm believer that in today’s IT landscape, organizations working with critical workloads in the cloud would greatly benefit from the services of a specialized PostgreSQL service provider, that can help them navigate the complex world of GUCS and myriads of SlideShare presentations. While managed PostgreSQL services are also available from a plethora of PostgreSQL Hosting Providers, I wanted to focus on the said three cloud computing providers since their environments are where many organizations looking for the advantages of cloud computing choose to run their applications, provided that they have the required know-how on managing PostgreSQL. To Amazon’s credit, out of the three most known utility computing providers - AWS, Google, and Microsoft - AWS is the only major contributor to PostgreSQL development, and the first to offer managed PostgreSQL service (dating back in November 2013). Selecting the PostgreSQL Cloud Services ProvidersĪ while ago I came across the AWS benchmark procedure for Aurora, and thought it would be really cool if I could take that test and run it on other cloud hosting providers.
The first part includes an overview of benchmarking tools, and kickstarts the fun with Amazon Aurora PostgreSQL. This blog starts a multi-series documenting my journey on benchmarking PostgreSQL in the cloud.