Cost down to 60% and greater flexibility

Cost down to 60% and greater flexibility

Repeatable reference architecture deployment for DataSynapse GridServer on GCP

Aside from equities, the client also used DataSynapse GridServer for running HPC workloads for fixed income, FX options, market risk and credit risk. GFT was engaged by Google to develop a deployable reference architecture for running DataSynapse GridServer on GCP.

Flexible

Alter a full GridServer environment at the touch of a button

Faster

Quicker time to market for new HPC projects

Simple

Easily support exceptional workloads

Partner

Tibco

TIBCO Software Inc. is an enterprise data company founded in 1997 in Palo Alto, California. The company’s infrastructure software focuses on real-time communication for business-to-business, business-to-consumer and business-to-employee data transfers, including facilitation of communication between otherwise incompatible software. The company provides middleware, which allows for access to real-time data between multiple systems while predicting users’ needs.

Partner

Google Cloud

Google Cloud Platform (GCP) delivers enterprise-grade solutions that leverage Google’s cutting-edge technology.

Challenge

Migration of equities DataSynapse GridServer processing workload to GCP

Aside from equities, the client also used DataSynapse GridServer for running HPC workloads for fixed income, FX options, market risk and credit risk.
GFT was engaged by Google to develop a deployable reference architecture for running DataSynapse GridServer on GCP. The purpose was for the reference architecture to be used in the equities migration and later on for other use cases, including for other GCP clients wishing to migrate their on-premises HPC workloads to GCP.

Engagement

GFT deployed a team consisting of an HPC cloud architect/project manager and two cloud DevOps engineers to the project, which was funded through Google PSF for 2 months

GFT designed a target architecture for the deployable reference architecture and put together a backlog in order to deliver the project in an agile fashion with weekly sprints and “show and tells”.
The backlog included user stories to create a basic DataSynapse GCP deployment; automating the deployment using Terraform, Ansible and Powershell; incorporating networking and security best practices; implementing autoscaling functionality (using both CPU metrics and a custom metric reading the number of upcoming tasks from the GridServer Director); encryption of all data using customer-managed encryption keys (CMEK); integrating all logging and monitoring activity with Stackdriver; implementing DevOps practices to deploy GridLibs using a Jenkins CI/CD pipeline and demonstrating visual analytics of GridServer workloads through TIBCO Spotfire integration.
With some help from TIBCO, Google and the banking client, GFT managed to deliver all user stories in the backlog in the 2-month timeframe..

Benefit

The reference architecture is now available and has been used to migrate the equities workloads to GCP

Fixed Income is also planning to use the reference architecture to migrate. Other areas and GCP clients have also expressed an interest in using the reference architecture.
The main benefits delivered by the reference architecture are the ability to “stand up” and “tear down” a full GridServer environment at the touch of a button, parameterizable engine types and initial engine pool sizes, enabling cost optimization, quicker time to market for new HPC projects and the ability to economically run a full-scale UAT and to easily support exceptional workloads, e.g. VaR re-runs. The reference architecture can be modified to support Amazon Web Services (AWS) & IBM Spectrum Symphony.