Data Science Examples

Collection of Python and R code examples for my blog F7L8C9.

Licensed under the MIT License. See file LICENSE.

Python

Virtual Environments and Packages

Some examples need external libraries. Install these with pip.

• pip install <package> to install package
• pip install --upgrade <package> to upgrade installed package
• pip list - to list packages in the current environment
• pip list --outdated - to list outdated packages
• pip show <package> - to get details about a package that is installed in the current environment
• pip uninstall <package> to uninstall package

Create repeatable installations with the following commands.

pip freeze > requirements.txt
pip install -r requirements.txt

File requirements.txt should be checked into source control. See also Installing Python Modules.

Create virtual environments with the venv module.

python -m venv .venv

On Linux bash, activate environment with source .venv/bin/activate.

Or, alternatively with virtualenv.

virtualenv venv

Directory .venv/ should be ignored by source control.

See Pipenv for a more sophisticated virtualenv management tool.

See pyenv to set up and use several Python versions in parallel.

Python Links

• Community forums
• Connexion - OpenAPI support for Flask
• D-Bus
• Flask micro web framework
• OpenAPI Specification 2
• OpenAPI Specification 3
• PEP 8 -- Style Guide for Python Code
• Pyodide - a Python distribution for the browser and Node.js based on WebAssembly
• python-dotenv reads key-value pairs from a .env file and can set them as environment variables.
• Python Packaging Authority
  • PEP 621 – Storing project metadata in pyproject.toml
  • Writing your pyproject.toml - Python Packaging User Guide
• Ruff - Python linter and code formatter, written in Rust.
• RustPython - Python interpreter written in Rust
• SQLite
• Status of Python versions
• Unleash Python SDK - system for feature flags / feature toggles
• UV - Python package manager and installer written in Rust
• Articles
  • Building Microservices with Python , Part I
• Data Science
  • Matplotlib
  • NumPy
  • pandas
  • Project Jupyter
  • scikit-learn
  • SciPy
  • Seaborn data visualization library
  • statsmodels
• Learning
  • Codecademy
  • freeCodeCamp
  • Learn X in Y minutes Where X=Python
  • Python 3 - Rheinwerk Buch
  • W3Schools
• Testing
  • behave - behaviour-driven development, Python style
  • Hypothesis - a library for property-based testing
  • Locust - an open source load testing tool
  • pytest
  • tox

R

R Studio

Run R Studio in Docker with docker run -p 8787:8787 -e PASSWORD=mypwd rocker/rstudio. Choose a sensible password. Open localhost:8787 with your browser and log in with user/password: rstudio/mypwd.

R Links

• ESS - Emacs Speaks Statistics
• R-Bloggers
• renv - package to help you create reproducible environments
• R Language Collective - Stackoverflow
• R Markdown
• The Rocker Project - Docker Containers for the R Environment
• Learning
  • Codecademy
  • Hands-On Programming with R - Book
  • Learn X in Y minutes Where X=R
  • R for Data Science - Book, 2nd edition
  • R Programming - Wikibook
  • W3Schools

Tasks

• Create Python behave example
• Write blog post about linear regression and plotting the results. See blog article