Recommended for you

Our recommendation engine has come up with some personalized suggestions for you.

Discover more products

    Is this your street address?

    Card

    ···· ···· ···· 4242
    Test card

    05/18

    Card

    Use a different card?

    Card

    pp paypal

    or pay with

    We do not keep any of your sensitive credit card information on file with us unless you ask us to after this purchase is complete.

    or pay with

    Please confirm your location:
    Your card will be charged .

    Thank you!

      Gumroad Library

      Download from the App Store or text yourself a link to the app

      Download from the App Store or text yourself a link to the app

      Send SMS
      Nevermind

      $40

        Realtime Predictive Analytics with Kafka, PySpark, Spark MLlib and Spark Streaming

        Realtime Predictive Analytics with Kafka, PySpark, Spark MLlib and Spark Streaming

        Preview available at https://vimeo.com/202336113

        This two hour course covers the construction of an entire predictive analytics web application. We use Kafka, PySpark, Spark MLlib and Spark Streaming on the back end and complete the predictive system with a Python/Flask/JQuery front end. This builds on chapters 7 and 8 in the book Agile Data Science 2.0 (O'Reilly, 2017).

        After a brief overview in Lesson Zero, in Lesson One we go over the concepts behind the architecture we'll be building with. In Lesson Two, Project Setup, we'll quickly setup our "big data" environment using a local Vagrant/Virtualbox virtual machine or a boot script for Amazon EC2. In Lesson Three, we use PySpark and Spark MLlib in batch mode with records recording flight delays for the year 2015 to train a classifier model to predict flight delays in terms of four categories: Very Early, Early, Late, Very Late. In Lesson Four, we build a web application front-end to our predictive system, which submit prediction requests to a Kafka queue and polls the server, awaiting a prediction. In Lesson Five, we use Spark MLLib with Spark Streaming to respond to those prediction requests by making predictions and storing them to MongoDB where the web application can access them. In Lesson Six, we demonstrate and analyze the entire system together. It is extremely fun to watch data flow through the system on multiple consoles.

        Once you've completed this course, you will have a base of operations for your own predictive analytics applications. You'll have working code and a working system to start from to alter and build your own applications. In this way, the course will empower you by making you a full-stack app dev in just a few hours!

        Code for the video and screenshots of the application are freely available at http://github.com/rjurney/Agile_Data_Code_2 Look in the ch08 directory.

        Sorry, this item is not available in your location.
        Sold out, please go back and pick another option.

        You have purchased this product previously. You can buy it again by clicking the button above.

        Card

        ···· ···· ···· 4242
        Test card

        05/18

        Card

        Use a different card?

        Card

        pp paypal

        or pay with

        We do not keep any of your sensitive credit card information on file with us unless you ask us to after this purchase is complete.

        or pay with

        Please confirm your location:
        Your card will be charged US$40.

        Your rental will be available for 30 days. Once started, you’ll have 72 hours to watch it as much as you’d like!

        Thank you!

          Gumroad Library

          Download from the App Store or text yourself a link to the app

          Download from the App Store or text yourself a link to the app

          Send SMS
          Nevermind