Effect of Frequency Governor on Java Benchmarking

Filed in Technology

A very common tool in a programmer’s arsenal is a MacBook Pro (MBP). However, a major OSX drawback for a developer is the lack of easy, fine grain control over kernel behaviors similar to those found in machines kerneled with Linux or raw BSD. In this post, we will explore the effect of the frequency governor on MBPs running with a modern Intel chip. The wall-time query execution speed in Druid will be used as a simple java benchmark. One of the most common tasks during the course of evaluating code is to look at key bottlenecks in execution time. […]

Effect of Frequency Governor on Java Benchmarking
Read Post Comments

Druid Gets Open Source-ier Under the Apache License

Filed in Corporate, Technology

In the process of building a SaaS solution for our clients, we’ve had to invent a handful of technology components that didn’t previously exist. One of these components is Druid, the streaming data store we’ve been operating, scaling, and building for the past three years. Today, Metamarkets runs a multi-thousand core Druid cluster that manages over 10 trillion events and ingests another 50 billion events daily. Since we open sourced Druid in 2012, it’s become an emerging standard for exploratory analytics on massive data sets. Right now, more than a dozen companies use it across multiple business areas (ad tech, […]

Druid Gets Open Source-ier Under the Apache License
Read Post Comments

Introducing Facet, A Revolutionary User Interface for High-Dimensional Data

Filed in Announcement, Company, Corporate, Data Visualization, Technology

In 2011 Metamarkets launched Druid, a streaming datastore capable of processing billions of events in real-time. Today we’re proud to release Facet, an interface designed to put Druid’s full power at every user’s fingertips. We built Facet to overcome the inflexibility of traditional reporting and analytics interfaces. While many systems are adept at telling you what is happening, Facet helps you uncover why it’s happening — quickly, intuitively and without the assistance of an analyst or Business Intelligence expert. One of Facet’s secrets is in how it handles the high-dimensional datasets common to the programmatic marketing space. In this post, I’ll […]

Introducing Facet, A Revolutionary User Interface for High-Dimensional Data
Read Post Comments

Building a Data Pipeline That Handles Billions of Events in Real-Time

Filed in Corporate, Technology

At Metamarkets our goal is to help our clients make sense of large amounts of data in real-time. Our platform ingests tens of billions of new events every day, and currently comprises trillions of aggregated events. Our real-time analytics platform has two separate yet equally important goals: interactivity (real-time queries) and data freshness (real-time ingestion). We’ve written before about how Druid, our open-source datastore, is able to offer fast, interactive queries. In this post, we’re going to focus on the challenges around achieving data freshness. We’ll talk about the batch-oriented pipelines we started with, and how we approached building real-time […]

Building a Data Pipeline That Handles Billions of Events in Real-Time
Read Post Comments

Open Source Leaders Sound Off on The Rise of the Real-Time Data Stack

Filed in Druid, Technology

In February we were honored to speak at the O’Reilly Strata conference about building a robust, flexible, and completely open source data analytics stack. If you couldn’t make it, you can watch the video here. Preparing for our talk got us thinking about all the brilliant folks working on similar problems, so we organized a panel that same night to continue the conversation. The discussion featured key contributors to several open source technologies: Andy Feng (Storm), Eric Tschetter (Druid), Jun Rao (Kafka), and Matei Zaharia (Spark). It was moderated by VentureBeat Staff Writer Jordan Novet and hosted by Zack Bogue […]

Open Source Leaders Sound Off on The Rise of the Real-Time Data Stack
Read Post Comments