Reddit consolidated its media metadata storage into a new architecture using AWS Aurora Postgres. Previously, the company sourced media metadata from various systems, including directly from AWS S3. The new solution simplifies media metadata retrieval and handles 100k+ requests per second with latency below 5ms (p90).
Reddit consolidated its media metadata storage into a new architecture using AWS Aurora Postgres. Previously, the company sourced media metadata from various systems, including directly from AWS S3. The new solution simplifies media metadata retrieval and handles 100k+ requests per second with latency below 5ms (p90).
The company hosts billions of posts containing different types of media content, such as images, videos, and embedded third-party media. Reddit also observes trends in user behavior and expects more media content to be uploaded in the coming years.
Jianyi Yi, senior software engineer at Reddit, explains what media metadata means for Reddit:
Media metadata provides additional context, organization, and searchability for the media content. There are two main types of media metadata on Reddit. The first type is media data on the post model. For example, when rendering a video post, we need the video thumbnails, playback URLs, bitrates, and various resolutions.
