Short Description
Learn how to use Python and Pandas for cleaning and reorganizing huge amounts of data.
What you’ll learn
- Build 10 advanced Python scripts which together make up a data analysis and visualization program.
- Solve six exercises related to processing, analyzing and visualizing US income data with Python.
- Learn the fundamental blocks of the Python programming language such as variables, datatypes, loops, conditionals, functions and more.
- Use Python to batch download files from FTP sites, extract, rename and store remote files locally.
- Import data into Python for analysis and visualization from various sources such as CSV and delimited TXT files.
- Keep the data organized inside Python in easily manageable pandas dataframes.
- Merge large datasets taken from various data file formats.
- Create pivot tables in Python out of large datasets.
- Perform various operations among data columns and rows.
- Query data from Python pandas dataframes.
- Export data from Python into various formats such as TXT, CSV, Excel, HTML and more.
- Use Python to perform various visualizations such as time series, plots, heatmaps, and more.
- Create KML Google Earth files out of CSV files.
Description
Data scientists spend only 20 percent of their time on building machine learning algorithms and 80 percent of their time finding, cleaning, and reorganizing huge amounts of data. That mostly happen because many use graphical tools such as Excel to process their data. However, if you use a programming language such as Python you can drastically reduce the time it takes for processing your data and make them ready for use in your project. This course will show how Python can be used to manage, clean, and organize huge amounts of data.
This course assumes you have basic knowledge of variables, functions, for loops, and conditionals. In the course you will be given access to a million records of raw historical weather data and you will use Python in every single step to deal with that dataset. That includes learning how to use Python to batch download and extract the data files, load thousands of files in Python via pandas, cleaning the data, concatenating and joining data from different sources, converting between fields, aggregating, conditioning, and many more data processing operations. On top of that, you will also learn how to calculate statistics and visualize the final data. The course also covers a series of exercises where you will be given some sample data then practice what you learned by cleaning and reorganizing those data using Python.
This course will teach you Data Science and Time Series in a very practical manner, with every lecture comes a programming video and a corresponding Jupyter notebook that has Python 3 code! Learn in whatever manner is the best for you!
We will start by helping you get Python3, NumPy, matplotlib, Jupyter, Pandas, and Plotly installed on your Windows computer and Raspberry Pi.
We cover a wide variety of topics, including:
- Basics of Scientific Python Ecosystem
- Basics of Pandas
- Basics of NumPy and Matplotlib
- Installation of Python 3 on Windows
- Setting up Raspberry Pi
- Tour of Python 3 environment on Raspberry Pi
- Jupyter installation and basics
- NumPy Ndarrays
- Array Creation Routines
- Basic Visualization with Matplotlib
- Ndarray Manipulation
- Random Array Generation
- Bitwise Operations
- Statistical Functions
- Basics of Matplotlib
- Installation of SciPy and Pandas
- Linear Algebra with NumPy and SciPy
- Data Acquisition with Python 3
- MySQL and Python 3
- Data Acquisition with Pandas
- Dataframes and Series in Pandas
- Visualization with Plotly
- Advanced Matplotlib Visualizations
- Data Processing
Who this course is for:
- Those who come from any technology field that deals with any kind of data.
- Those who want to leverage the power of the Python programming language for handling data.
- Those who need to learn Python basics and want to quickly advance their skills by learning how to perform data cleaning, analysis and visualization with Python – all in one single course.
- Those who want to switch from programming languages such as Java, C, R, Matlab, etc. to Python
Join us on Telegram