Making Sense of Big Data

Image from https://examples.pyviz.org/opensky/opensky.html with permission

A few months ago, I wrote an article on my favorite Python Viz tools — HoloViz. Many people are interested in learning more about Dashshader — the big data visualization tool in the HoloViz family. I absolutely love Datashader and love how Datashader creates meaningful visualizations of large datasets very…

Hands-on Tutorials

Photo by Marek Piwnicki on Unsplash

Why do we need variance reduction?

When we do online experiments or A/B testing, we need to ensure our test has high statistical power so that we have a high probability to find the experimental effect if it does exist. What are the factors that might affect power? …

Image from datashader.org with permission

It is surprising to me that many data scientists do not know HoloViz. HoloViz is my favorite Python viz ecosystem, which comprises seven Python libraries — Panel, hvPlot, HoloViews, GeoViews, Datashader, Param, and Colorcet.

Why do I love Holoviz?

HoloViz allows users to build Python visualization and interactive dashboard with super easy and flexible Python…

Hands-on Tutorials

Streaming and Refreshing

Photo by Sasha • Stories on Unsplash

Data scientists use data visualization to communicate data and generate insights. It’s essential for data scientists to know how to create meaningful visualization dashboards, especially real-time dashboards. This article talks about two ways to get your real-time dashboard in Python:

  • First, we use streaming data and create an auto-updated streaming…

Photo by Kelly Sikkema on Unsplash

Check out the slideshow of this article here: https://sophiamyang.github.io/slides_github_pages/.

There are two parts to this article:

  1. How to turn your Jupyter Notebooks into a slideshow and output to an html file.
  2. How to host an html file on Github.

Jupyter Notebook slides

First, let’s create a new environment slideshow, install a Jupyter notebook…

Photo by Raimond Klavins on Unsplash

How do you query BigQuery data? This article talks about 3 ways to query BigQuery data in Python. Hope you find them useful.

Environment

conda install notebook google-cloud-bigquery sqlalchemy pybigquery

Credentials

To authenticate Google Cloud locally, you will need to install Google Cloud SDK and log in/authenticate through the following command line…

Photo by Sarah Kilian on Unsplash

Software testing is essential for software development. It is recommended for software engineers to use test-driven development (TDD), which is a software development process that develops test cases first and then develops the software. For data scientists, it is not always easy and plausible to write tests first. Nevertheless, software…

Sophia Yang

Ph.D. | Senior Data Scientist @ Anaconda | Twitter @ sophiamyang | All views are my own

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store