#FinagleCon: Full Schedule

In a SOA setting such as Twitter, fast-paced development cycles often results in a few functional and/or performance regressions escaping into production. Detecting such regressions manually is not practically feasible in the context of the hundreds of services with tens of endpoints and tens of thousands to metrics each. To this end, we developed a novel tool called Diffy to automatically detect such regressions without relying on service owners to write tests.

Speakers

Puneet Khanduri

Puneet is a Senior Engineer within the Engineering Effectiveness team at Twitter. His work at Twitter focuses on building tools and frameworks that help other engineering teams build more resilient systems. Prior to Twitter, Puneet worked at Oracle Labs where he built a real-time... Read More →

Thursday August 13, 2015 1:30pm - 2:30pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Talk

1:30pm PDT

Finagle at Pinterest

In this talk, we propose to cover the following: 1. Transition from monolithical system to SOA at Pinterest: how finagle helped in making such a transition much less daunting, and share our best practices. 2. ServiceFramework Proxy: a proxy layer on top of service handler to expose per client, per api endpoint metrics, provide support for request logging, rate limiting, etc. to make it easy to monitor service health and diagnose issues. 3. How do we handles service discovery using zookeeper, but avoid treating it as a tier 0 component. 4. Python Finagle Thrift Client: the efforts we put in place to make our python based services seamlessly integrated with finagle services. 5. Genesis: our tool to generate finagle server/client and python thrift client, and dashboard for service health monitoring 6. Future work: Java8 friendly Finagle future

Speakers

Yongsheng Wu

Yongsheng is an early engineer on infrastructure team at Pinterest, where he helped in making the system available, scalable, reliable, and performant. He is currently leading the effort in making it easy to use, build and run services at Pinterest. Before Pinterest, Yongsheng worked... Read More →

Thursday August 13, 2015 1:30pm - 2:30pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Talk

1:30pm PDT

Started from the Bottom Now We're Here

Speakers

Jeffrey Davis

Developer at Sabre

Thursday August 13, 2015 1:30pm - 2:30pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Talk

2:30pm PDT

A Functional Approach to Simplifying Micro Service Orchestration

A micro services architecture encourages building small, understandable components in the hope to make testing and development of new features faster and simpler. This simplification at the service layer pushes the complexity cost to components in the service orchestration layer like authentication, routing, and sessions. In this talk, Andrew Kuhnhausen will highlight a functional, type-safe, and generic programming approach to authentication and sessions for micro services built on top of Finagle and Finch; focus will be on the modularity and extensibility gained by composing Finagle’s primitives with Scala’s type classes, while going through the design of a functional library.

Speakers

Andrew Kuhnhausen

Software Engineer, Domino Data Lab

Andrew Kuhnhausen is a developer at Domino Data LAb in San Francisco. He did his thesis on static analysis of Dalvik byte code for malware detection. When not futzing around with functional programming or distributed computing, you can find him riding his bike and enjoying the fine... Read More →

Thursday August 13, 2015 2:30pm - 3:30pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Talk

2:30pm PDT

Presenting Vizatra

Building visualizations that perform on top of many-TB-scale data warehouses is an ongoing challenge in the analytics space. Most tools either offer a static presentation of a highly optimized view, and are fast, or permit exploration via a hierarchical dimensional model and end up being slow, in large part due to overly generic and/or poorly optimized query builders. In this talk we will present Vizatra, a visualization framework that turns this model on its head in an effort to work as optimally as possible with the underlying database. Vizatra is a stand-alone webapp built on top of Finatra that is simple to configure and deploy. We will discuss specific use cases that drove us to build Yet Another Dashboarding Tool and go in-depth showing how easy it is to build a time-series dashboard with Vizatra's configuration language.

Speakers

Justin Coffey

Justin Coffey is a senior staff devlead at Criteo in charge of the Analytics Infrastructure team. He oversees (and even manages the occasional contribution to) the development of better tools to manage the petabytes of analytic data employed by hundreds of Criteo analysts and engineers... Read More →

Thursday August 13, 2015 2:30pm - 3:30pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Talk

2:30pm PDT

Streaming HTTP with Finatra and AsyncStream

Speakers

Steve Cosenza

Senior Staff Software Engineer, Twitter

@scosenza

Neuman Vong

Twitter

Streaming HTTP with Finatra and AsyncStream pdf

Thursday August 13, 2015 2:30pm - 3:30pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Talk

3:30pm PDT

Buoyant Service Discovery

Service discovery schemes serve an increasingly critical function in microservice applications. However, they can be very difficult to operate safely at scale. This talk will describe the evolution of Twitter’s service discovery ecosystem, focusing on design insights that enabled the system to scale safely. We will present an as-of-yet unreleased cross-platform service discovery system implemented with Finagle.

Speakers

Oliver Gould

CTO, Buoyant

Oliver Gould is a core maintainer of Linkerd, and is the co-founder and CTO of Buoyant, where he leads open source development efforts. Prior to Buoyant, he was a staff infrastructure engineer at Twitter, where he was the tech lead of Observability, Traffic, and Configuration & Coordination... Read More →

Thursday August 13, 2015 3:30pm - 4:30pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Talk

3:30pm PDT

Finagle and Clojure

Finagle is a powerful library for building highly concurrent RPC systems on the JVM. While APIs for Scala and Java are provided it has not been used widely with Clojure. Can we use Finagle from Clojure? Yes, but there are few problems: Scala interop is tricky, monadic Futures (core abstraction to allow asynchronous calls to be chained together) are not idiomatic in Clojure. There is finagle-clojure library that lets Clojure developers build services without requiring messy Scala interop. Utilities are included to run existing libraries in the asynchronous Finagle runtime without blocking and reducing capacity. But there is still a huge room for making services play nicely with the ecosystem (core.async, manifold etc). This session will describe an overview of finagle-clojure, utilities to wrap Finagle services into idiomatic Clojure libraries and some examples from production.

Speakers

Alexey Kachayev

CTO at Attendify. Mostly Clojure engineer, but work also with Scala and Erlang on a regular basis.

Thursday August 13, 2015 3:30pm - 4:30pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Talk

4:30pm PDT

Finagle at SoundCloud

Speakers

Phil Calçado

Director of Core Engineering at SoundCloud

Thursday August 13, 2015 4:30pm - 5:30pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Keynote

5:30pm PDT

Closing remarks

Speakers

Travis Brown

Open source advocate, Twitter, Inc.

Taylor Leese

Core System Libraries manager at Twitter

Thursday August 13, 2015 5:30pm - 5:45pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Welcome

5:45pm PDT

Food and drinks

Thursday August 13, 2015 5:45pm - 6:30pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Meal

6:15pm PDT

Mixer

Thursday August 13, 2015 6:15pm - 7:30pm PDT
Twitter HQ One 10th Street Expansion 875 Stevenson Street, San Francisco, CA

Social