Making the Most of EBS Volumes with Reattachment

Filed in Algorithms, Technology

Here at Metamarkets, we are always seeking to use our AWS resources more efficiently and reduce human intervention required to address failures. We run some large workloads that utilize a lot of EBS volumes and in some cases spot instances. To facilitate this, we’ve written ER, a system to enable our instances to attach, detach, and create EBS volumes at boot without relying on any external coordinator other than the EC2 API. Pain Point: Kafka Brokers We run a few Kafka clusters where we use EBS volumes that allow us to replace instances without losing days worth of real- time […]

Making the Most of EBS Volumes with Reattachment
Read Post Comments

Managing Changing Data with Dynamic Lookups

Filed in Company, Corporate, Technology

The world’s top media exchanges, buyers and publishers use Metamarkets’ interactive analytics solution to drive their business performance through intuitive access to real-time data. Having the ability to explore and visualize the data puts the power of big data into the hands of the people who need it most. However, the data is only powerful if it’s reliable. As a company evolves, so does its data and its underlying attributes. In many cases these changes are unavoidable, such as company name changing due to a merger or acquisition, account assignments or campaign name changes. Metamarkets’ dynamic lookup solution allows users […]

Managing Changing Data with Dynamic Lookups
Read Post Comments

Distributing Data in Druid at Petabyte Scale

Filed in Algorithms, Corporate, Data Visualization, Druid, R, Technology

At Metamarkets we run one of the largest production Druid clusters out there, so when it comes to scalability, we are almost always the first ones to encounter issues of running Druid at scale. Sometimes, however, performance problems are much simpler, and the downside of a large cluster is that it tends to average out problems that are hiding in plain sight, making them harder to pinpoint. Recently, we started noticing that, despite being able to scale our cluster almost horizontally, performance would not always increase accordingly. While we don’t expect a linear increase in speed, some of the numbers […]

Distributing Data in Druid at Petabyte Scale
Read Post Comments

Behind the Scenes with Metamarkets, Episode 2

Filed in Corporate, Druid, Technology

In the latest episode in our “Behind The Scenes” video series, we sat down with Dr. Charles Allen, a senior software engineer at Metamarkets and one of the leading developers focused on Druid, the open-source database built by the Metamarkets team. Watch the video to hear how Charles first encountered and implemented Druid before coming to Metamarkets, what he sees as the key strengths of the technology, how he’s worked to implement more mutability of data within Druid, and how he’s helping users get maximum utilization of their clusters.

Behind the Scenes with Metamarkets, Episode 2
Read Post Comments

Introducing the Metamarkets API

Filed in Corporate, Technology

At Metamarkets, it’s our mission to put programmatic data at our users’ fingertips so they can instantly see what’s happening within their businesses, discover trends, and take action. We first delivered on this mission with an interactive analytics solution that provides users with self-serve access to trillions of data points through our intuitive, point-and-click dashboards. Our dashboards are now a daily habit for thousands of users spanning publishers, exchanges, and buyers across the programmatic ecosystem. Today, we’re proud to announce that we’re further extending the flexibility and scale of our platform through the Metamarkets API. Our API allows customers’ own […]

Introducing the Metamarkets API
Read Post Comments