Moving Real-Time Data Flow Across Cloud Providers

Filed in Algorithms, Data Science, Druid, Technology

Eventually in the course of data growth, a company needs to make a major migration of data or processes from one physical location to another. This post is the story of how we moved a real-time data flow across cloud providers using Kafka, Samza, and some creative engineering. History Our technology stack for data processing is something we’ve spoken about before. We run a Lambda architecture with the real-time system comprising Kafka and Samza, which terminates in Druid real-time indexing tasks. The batch system is comprised of Spark, which reads and writes from S3. Druid historical nodes use S3 as […]

Moving Real-Time Data Flow Across Cloud Providers
Read Post Comments

The #1 Tip For Winning Over Your Buyers: Streamlining Inventory Discovery

Filed in Data Visualization, Musings, Technology

There’s a ton of uncertainty involved in the process of planning programmatic campaigns. Exchanges want to know that they’ll be able to hit their buyer’s target metrics while staying within a certain budget – but how confident can you possibly be of the end result? The amount of available inventory for a given target audience is constantly changing, and basic reporting processes often take hours or days to deliver feedback on how a campaign is performing. To be sure, you could build models based on historical average prices to get a sense for what your buyer’s campaign inventory might look […]

The #1 Tip For Winning Over Your Buyers: Streamlining Inventory Discovery
Read Post Comments

Going Multi-Cloud with AWS and GCP: Lessons Learned at Scale

Filed in Algorithms, Druid, Industry, Technology

Metamarkets handles a lot of data. The torrent of data that clients send to us surpasses a petabyte a week. At this scale, the ability to failover gracefully, to detect and eliminate brownouts, and to efficiently operate huge quantities of byte-banging machines is necessary. We started and grew Metamarkets in AWS’s us-east region. And the majority of our footprint was in a single availability zone (AZ). As we grew, we started to see the side effects of being restricted to one AZ, then the side effects of being restricted to one region. It’s kind of like inflating a balloon in […]

Going Multi-Cloud with AWS and GCP: Lessons Learned at Scale
Read Post Comments

Transparency Opportunity Blog Series: Overcoming the Inhibiting Factors

Filed in Best Practices, Industry, Musings

Transparency in digital marketing continues to be a dominant theme of 2017 – major brands like P&G and Unilever are backing up their calls to clean up the digital ad ecosystem by reducing their spending and decreasing the number of sites they spend on. It is becoming increasingly urgent for marketers to offer radical transparency in programmatic marketing if they wish to keep up with the brands’ growing demands. This is the third post in our three-part series taking a deeper look at the results of our recent research (see: The Transparency Opportunity) that looks at the perceptions of brands, […]

Transparency Opportunity Blog Series: Overcoming the Inhibiting Factors
Read Post Comments

Survey: Marketers Say Lack of Data Transparency Stunts Programmatic Growth

Filed in Announcement, Company, Technology

Survey: Marketers Say Lack of Data Transparency Stunts Programmatic Growth Brands, Agencies and Publishers Willing to Increase Budgets for More Trustworthy Data SAN FRANCISCO, May 1, 2017 – New research released today indicates that a lack of data transparency is inhibiting the growth of programmatic media buying and that 41 percent of respondents agreed they would not significantly increase their programmatic budgets until there was better transparency around data. In a white paper released today titled “The Transparency Opportunity,” the results of a survey conducted by research firm Industry Index and commissioned by Metamarkets revealed the attitudes of brands, agencies […]

Survey: Marketers Say Lack of Data Transparency Stunts Programmatic Growth
Read Post Comments