engblogs

summaries of the latest blog articles from your favorite tech companies.
SoundCloudSoundCloud

Keeping Counts In Sync

Technical overview of how SoundCloud keeps play counts and creator statistics in sync by stitching real-time and batch data with Stitch on a Lambda Architecture built on Cassandra and Kafka, enabling pre-aggregation, caching, and scalable top lists.

5/11/2018
SoundCloudSoundCloud

Keeping Counts In Sync

Explores SoundCloud’s Stitch-powered Lambda Architecture approach to real-time and batch pre-aggregation of play counts, likes, and other signals across a Kafka-based event pipeline and Cassandra storage to keep counts, top lists, and creator statistics in sync.

5/11/2018
SoundCloudSoundCloud

Keeping Counts In Sync

Tracking play counts in real time to provide creators with accurate and up-to-date statistics on their popular songs and fanbase impact.

5/11/2018
SoundCloudSoundCloud

Running Android UI Test Suites on Firebase Test Lab

How to migrate Android UI test suites from a custom device farm to Firebase Test Lab, using Android Test Orchestrator and Flank to run tests in parallel, improve robustness, and cut build times.

5/4/2018
SoundCloudSoundCloud

Running Android UI Test Suites on Firebase Test Lab

How we migrated Android UI tests from an internal device farm to Firebase Test Lab, enabling massively parallelized test runs with Android Test Orchestrator and Flank to stabilize CI and cut runtimes.

5/4/2018
SoundCloudSoundCloud

Running Android UI Test Suites on Firebase Test Lab

Running Android UI Test Suites on Firebase Test Lab speeds up UI test execution on mobile devices and emulators.

5/4/2018
OpenAIOpenAI

AI safety via debate

Exploring AI safety strategies using debate techniques

5/3/2018
Jane StreetJane Street

Repeatable exploratory programming

A blogpost about using Expect tests for repeatable exploratory programming

4/22/2018
OpenAIOpenAI

Evolved Policy Gradients

Exploring advanced techniques for policy gradients in machine learning models

4/18/2018
OpenAIOpenAI

Gotta Learn Fast: A new benchmark for generalization in RL

Exploring advancements in generalization for Reinforcement Learning through a new benchmark approach.

4/10/2018
OpenAIOpenAI

Retro Contest

Explore the resurgence of vintage development challenges in the modern era.

4/5/2018
Jane StreetJane Street

OCaml all the way down

Exploring the evolution of the software stack at Jane Street from statistical research to strategy execution.

4/4/2018