Flight Network in Tableau

Tableau is notoriously good with tabular data but it gets frustrating to use when it comes to representing flight network, which involves spherical calculations that Tableau does not support.

Now, say you are looking into the flight pattern of an Airline and you want give your audience a one-snapshot of the said Airline. Your center-piece will probably be a nice map of the network meshing and this is where it gets tricky: As Tableau represents flight segments as flat lines (as opposed to Great Circle lines), you end up with a mediocre visualization like the following: 

JFK - LHR Flight - Straight Line


In order to have nice curves, I resorted to pre-processing the data and calculating the intermediary points for each segment with a short Julia code snippet (available here).

I chose Julia to evaluate this new tool whose selling point is to be as fast as C and as high-level as R. If you check out my github, you will notice how familiar this language looks. 

The script creates a point every 500 kilometers (~300 miles) for each flight. The final result looks like an actual flight network!


Case in point with VX (Virgin America):



The trick is to approximate a great circle curve by a series of mini-segments. Note that the output is bigger since the data is now at the said mini-segment level.

Good luck!

PS: The data used is from Openflights. I noticed that there are errors in the dataset (such as Jet Blue flying to Dubai that is probably an codeshare-AA flight) so use with caution.

Comments

Post a Comment

Popular posts from this blog

Should you ship this feature?

Image
Introduction During my time at tech companies, one of the hardest tasks for my team is to guide the Product team in their decision to launch a feature. It is both very consequential and also very fraught with pitfalls. Let's take an example to ease into the topic: You worked hard to convince leadership to measure the effect of this cool new feature and you got a nice experiment set up according to the cannons of measurement. After 4 weeks, you are seeing stat sig improvement in your primary metric and not secondary metrics affected negatively. The story is clear as day: you should tell the team to ship it, right?  The problem with shipping features Once the results are out, the focus is put on the outcomes and leadership is incentivized to ship. As a result, little attention is given to cost side of the equation: Tech debt : Does this feature make the system more complex? Does it hinder long term growth by exacting a tax from any new feature? Think about Net Prevent Value of such t
Read more

My new job at Lyft

Image
In October, I joined Lyft as Data Science Manager for Core Mapping. I wish I could have posted this update a while ago but a big event got in the way (yes, we went public) ... While low visibility, Mapping turns out to a big deal for ride-sharing as it has influence on a lot of other services. In a nutshell, Mapping has an impact on pricing, driver dispatch, scheduled rides and customer XP. Also, it is usually the biggest friction point for seamless pickups. Why is Mapping important for ride sharing company ? Mapping has traditionally 4 components: Basemap (representation of the world as a graph), Locations (where are drivers, passengers ?), Routing (optimal paths between locations) and ETA (distance and time between locations). When you open your app, you see the following screen: A lot of information displayed is connected to the work by my team: The surrounding physical world : road segments, (train) stations, POI The pick-up ETA (3min) looks at drivers around t
Read more

Playing around with Vectorization

Image
While I'm on paternity leave, I'm enjoying a bit of time off to write a blog article. Here we go! Vectorization of code is one of the key tenets of performance computing. Unfortunately, these aspects are quite hidden in high-level programming language (Python/R/SQL) and Data Scientists are unaware of the inner workings. As a matter of fact, even Software Engineer at Tech companies rarely go that low.   This post aims at rediscovering them. Let's dive in! Problem Statement: Let's take a simple problem : A social media company wants to send invites to folks that have a 2nd degree connection (i.e. at least 1 friend in common) but are not friends yet. The problem gives you a N x N matrix containing bits (1=friend). How many emails would you send? Context : There are better ways to solve this problem (for instance, by storing the index of the friends as opposed to all bits). Here, we are taking the data format as a constraint. Implementations: 0- Baseline approach We start w
Read more