Second Spectrum has chosen AWS as its preferred cloud, machine learning (ML), and artificial intelligence (AI) provider. Second Spectrum has also selected AWS media services to help deliver new kinds of live game-watching experiences to fans. Second Spectrum uses AWS’s industry-leading services to help leagues and their media partners deliver analytics, visualizations, and easily searchable video clips during games and matches to enhance the fan experience and provide teams with deeper competitive insights. For example, Second Spectrum leverages AWS to produce and deliver Clippers CourtVision, an augmented reality, livestreaming product for the LA Clippers that displays player tracking information, real-time stats, and explanatory animations for fans watching from desktops and mobile devices.
Second Spectrum’s content-generation service runs on AWS. The process begins when Second Spectrum applies ML and computer vision techniques to its proprietary optical tracking system, which collects 3D spatial data from cameras at live sporting events, and then indexes the video in real time with metadata such as the identity and location of players, and the type of play in progress. Second Spectrum technology then references that real-time information against historical team and player data housed on AWS to rapidly generate stats, analytics, and its proprietary metrics like Quantified Shot Quality (expected effective field goal percentage) and Quantified Shooter Impact (impact of the player compared to league average), and uses AWS’s highly scalable and performant infrastructure to construct 3D visualizations and augmented video to support live broadcasts.
Second Spectrum minimizes latency in its streaming services and offers fans a high-quality viewing experience by using AWS Elemental Live, a service for encoding live video and compressing it for viewing on multiple devices, and AWS Elemental MediaStore, a storage service optimized for media, to allow television producers and sports commentators to quickly access key moments from sports events.