Have been wondering for sometime how we can measure the overall response of a known Cloud Foundry PaaS target. What kind of metrics can we use ?
As a first attempt, let’s review the PAT tool as reviewed by Dr. Nic. Look here: https://blog.starkandwayne.com/2014/08/02/ask-pat-how-long-does-it-take-to-push-apps/
and if you are really keen, you can hack your own version of PAT from the Github repo here: https://github.com/cloudfoundry-incubator/pat
My ideas involved a test harness to hit several/many CF targets simultaneously and let it all run for a few days. This would give a larger overview across a wider time span. We could see the highs and lows using some metrics – which times of day are bad/good – which days of the week are good ? Do background tasks on the target CF influence or results ? Are they doing backups while we push our app to them ?
Maybe another test harness to bang our app on each CF target every n seconds/minutes/days ?
Then we could publish those metrics so we all have a better of of which PaaS is rubbish like CloudBees and which ones are sterling like IBM BlueMix and Anynines.com 🙂