Photobox Group has completed the migration of 10PB of image data to the Amazon Web Services (AWS) cloud five months ahead of schedule using the cloud giant’s Snowball appliances.
The online-only image printing company holds about 5.7 million images, uploaded by customers who use its services to order physical copies of their digital photographs. The images were previously housed in two colocation datacentres in different parts of Europe.
But Photobox wanted a more durable set-up that would also help it deliver a faster website experience to its customers, and make it easier to manage the huge amounts of data it handles, so it decided it was time to move to the AWS public cloud.
Photobox Group CTO Richard Orme told Computer Weekly that the company’s on-premise setup meant its technology teams were spending too much time managing infrastructure and not enough on building projects that could support the organisation’s future growth.
“We were spending a lot of time as a technology function building infrastructure just to keep up with the pace of photos that we were ingesting, or then looking at compression technology used to shrink down the size of the photos without losing any content,” he said.
“So a lot of the effort we were putting in was not necessarily related to growth, it was related to just keeping the organisation going. It was clear that we needed to move our resources into developing new features for customers and developing new products.”
The company first thought that moving the data from its datacentres into the AWS S3 cloud storage service would take about 12 months using the cloud giant’s Snowball mass-data migration appliances.
Introduced in 2015, the Snowball appliance is touted by AWS as a way to eradicate the high data transmission costs that enterprises can sometimes incur when moving data to the cloud. The Snowball system sees the customer upload its data onto the appliance, which is then shipped, via courier, to an Amazon datacentre, where it is transferred directly to the cloud.
“Each Snowball has 100TB of capacity and we used 90 of them,” said Orme. “It’s a staggering amount of data – we hold Europe’s largest consumer photo database.”
But when the project kicked off in January 2018, it ran into some teething problems. Photobox found the Snowball appliances were filling up too quickly, and it was taking longer than expected to transfer the data.
In response, Amazon accelerated the development of a feature it had in the works that would enable thousands of Photobox’s image files to be compressed down into a single file transfer.
Once the files reached Amazon’s datacentre, they were automatically decompressed and uploaded to its servers.
At the same time, the Photobox team was working on storage- and software-level improvements to the in-house system it had created to transfer the data from its infrastructure to the Snowball.
“They changed their product roadmap for us,” said Orme. “They accelerated some development work on the Snowball devices, which meant we were able to get the project not only back on track, but we were actually going faster than we thought we would.”
So much so that the project ended up taking just seven months to complete, which has helped Photobox to secure some “significant cost savings”, said Orme.
“The key to finishing this project successfully was putting the right cross-functional team in place, including engineers and specialists in-house, working very closely with AWS,” he added. “They tackled the early-day issues with such success that we ended up finishing the transfer in July – five months ahead of schedule.”
Using AI to inform the creative process
With the data migration side of the project now complete, Orme and his team are now looking to give Photobox’s customers access to an assistive artificial intelligence (AI) that can help them make the most of its platform.
“We have an AI team that specialises in neural networks and computer vision, so we spent a lot of time originally building models that helped us to understand what’s in the photograph,” said Orme. “That’s something we can get as a commoditised service from Amazon now.
“That now allows our team to say: ‘we can understand the content of the photograph; what is important to us now is to understand the context of photographs’.”
Orme said Photobox’s teams will now be able to analyse previous datasets where customers have built a wedding photobook, for example, and then use AWS AIs to help new customers in a similar way.
“We are in the very early stages of building what we call the emotional intelligent AI, which is helping you with the creative process,” he said. “That is something we wouldn’t necessarily have been able to do if we still had to be focusing our time on extracting the content from the photos.”
The company’s idea is not to exclude consumers from the creative process by using AI, but to provide them with additional support when using the service to compile their photo albums.
“They [customers] come to us with a recipient or an event in mind and a bunch of photos that they want to tell the story with,” said Orme. “Very quickly, their motivation changes when they get into the design process for the book and they suddenly move into this very creative frame of mind.
“We see the job of the AI as supporting them in that, nudging and saying ‘here’s a layout that other customers have used’. It is looking back at the historical dataset and then making suggestions that inspire the customer, helping them tell the story they want to tell.”
Additional reporting by Computer Weekly datacentre editor Caroline Donnelly.
Be the first to comment