One of the key differentiators of the Acquia AgilOne CDP is the scalability of the platform. Scalability is one of Acquia AgilOne’s key architectural tenets, powered by our tech stack’s horizontal scalability and elasticity. This is evident from how large, high-demand enterprise brands deliver relevant and personalized customer experiences via the AgilOne CDP, processing hundreds of millions of customer records, billions of transactions and billions of events daily. One illustration of the AgilOne platform’s scalability is how easily we are able to add enormous volumes of historical data into the platform when onboarding each new enterprise client.
Another key illustration of the AgilOne platform’s scalability is our ability to handle and ingest big spikes of data - as we did during this season’s Black Friday and Cyber Monday holiday’ for our retail clients. Let’s dive further into some interesting aspects of these data spikes.
The AgilOne real-time pipeline ingests real-time events, including web events (browse as well as checkout/transactional events) and email events. We saw huge spikes across brands in these events and transactions, and our platform successfully ingested these data spikes. This success is not just about data ingestion but is also about scalability in all the other modules like campaigns, analytics and machine learning, which all need to operate on these increased volume spikes. Supporting spikes like this is mission critical to our clients’ bottom lines.
Data Points in Web Traffic Volumes: 2019 Black Friday / Cyber Monday
- Multiple brands had spikes of greater than 20 times their regular web traffic volume on Black Friday and again on Cyber Monday; these peaks correlate to the times when they sent large campaigns. AgilOne’s CDP also ingested these spikes in email events, so the campaigns had double the impact on the data ingested into AgilOne.
- One brand had spikes of greater than 30,000 events per minute (compared to their regular volume of less than 1,000) - this was early morning on Black Friday.
- Another brand had sustained spikes over time resulting in greater than 1.3 Million events per hour, and greater than 25M events per day (which was on Black Friday).
- Another brand normally gets 20,000 calls per hour on average. But on Sunday, ahead of Cyber Monday, this brand reached peaks of ~430K calls per hour, i.e., greater than 20 times their average.
- Even some of our European clients saw about 20 times their normal volume consistently throughout the holiday weekend.
- In that week, across brands, we processed more than 350 million web events -- more calls in that week than an average month.