Pokemon, BigData and Everything. Vincent D. Warmerdam - koaning.io - GoDataDriven

Transcription

1 Pokemon, BigData and Everything

2 Pokemon, BigData and Everything Why econometricians aren't that useful.

3 Who is this guy?

4 My Story I was about to graduate econometrics 4 years. I worked for a business intelligence company. Wore a suit to work everyday and I clicked on a lot of buttons to make powerpoint slides. Such was the life of the post-student enterprise lifestyle. Then my boss asked me for a rather meaningless task... this sort of changed my life from guy-in-suit to an internet meme.

5

6

7 "As much as I love cat videos, who actually downloads them and maintains a stash?"

8

9

10

11

12

13

14

15

16

17 Fast Forward a While

18 I'm also this guy.

19 I'm also this guy.

20 I'm also this guy.

21 I'm also this guy.

22 I'm also this guy. python, javascript, R, dplyr, ggplot, ditto, scala, mongo, html5, bootstrap, git, sublime, d3, leaflet, sawk, pandas, feebas, numpy, scikit, nltk, crebase, juypter, onyx, lodash, mesos, docker, django, flask, neo4j, vulpix, selenium, node-webkit, hadoop, hoopa, impala, spark, azurill, ansible, hadoop, mapreduce.

23 I'm also this guy. python, javascript, R, dplyr, ggplot, ditto, scala, mongo, html5, bootstrap, git, sublime, d3, leaflet, sawk, pandas, feebas, numpy, scikit, nltk, crebase, juypter, onyx, lodash, mesos, docker, django, flask, neo4j, vulpix, selenium, node-webkit, hadoop, hoopa, impala, spark, azurill, ansible, hadoop, mapreduce. Can you recognize which ones are pokemon?

24 Vincent solves data problems, ask him anything. He has a blog about less obvious aspects in the world of data science over at koaning.io and he s known for giving free lectures in data science around Europe. He s especially keen to give one in Lisbon, Ljubljana, Split or Belfast. Feel free to notify Vincent if you ve got a venue in any of these places or other awesome place to visit. He ll actually show up.

25 Long Story Short my name is vincent i do open source data ask me anything

26 Today I'll talk to you guys about what I've been up to. I have mixed feelings about econometrics. I'm sure happy I thought myself programming. I'm very happy I don't wear a suit to work. Explain the difference between my definition of a data scientist and business analyst Talk about how I solve problems.

27 Difference between data analyst/ data scientist. With two examples I'll try to explain why we do not consider econometricians to be unicorns. pokemon world of warcraft if(time) pokemon part 2 (bayesians!)

28 Conclusions It's fashion to call yourself a data scientist. This hype comes from somewhere and this somewhere isn't a click-tool. I'd like to avoid any confusion so I would propose to stick to this sniff test. if(sql + Clicky Clicky) -> Data Analyst if(code + algorithms) -> Data Scientist The alternative is to put pokemon names on my resume.

29 Conclusions In a lot of ways the world has opened up. It's getting very expensive not to use open source software. In this new open jungle, you'll become less and less relevant if you cannot communicate with machines. It's the only way to automate the boring stuff. Even microsoft is trying to remain relevant by switching to open source. Think about that.

30 Conclusions People treat econometricians like they are the magical unicorns of business. The ability to interpret a linear regression does not turn you into Gandalf the White. The new school computer geeks will eat that alive. Calculus, probability theory and linear algebra are everything you need on a theoretical basis. Creativity is much more important.

31 Conclusions It also seems like there are too many people worrying about making moarmoney[tm]. Maybe we should stop making powerpoints and word files for McWaterHouse Deloitte Group and actually start making solutions to problems that matter.

32 Conclusions We enjoy artificial intelligence because we suffer natural stupidity. This doesn't mean that you cannot apply natural intelligence before you attempt to apply fancy models. By the way, there's also a thing such as artificial stupidity.

33 Conclusions If you want to learn about this stuff; life has never been easier. Check udacity, coursera, meetups and conferences. The open jungle is a wild place, but people are nice and don't mind teaching anyone. Especially if you're a women you should feel especially welcome. The gender imbalance in the field is suspicious enough to call it a problem.

34 Conclusions If I'm going to send you home with anything though...

35 "Never let your school get in the way of your education." Mark Twain