Store and Process Project Data and Big Data. From Excel to MySQL and Spark. 📚 8 Lessons
Distributed Data Storage. Quick start guide to MySQL and Spark.
Enrolment validity: 0 day
Login
€119.00€59.00
Description
In this course, we will step by step, using the example of real data, we will go through the main processes related to the topic “Big data and machine learning”.
🎓 In this part we will consider the main options for storing big data.
✔️ In practical lesson we will install the MySQL server on computer and learn how to work and edit MySQL databases. In the fifth lesson we will take one regular exel table and transfer the information from this table to the MySql server.
✔️ Then we will install the spark in order to work with datasets in a distributed manner.Then, to process the distributed data, we export the data from MySQL into spark. And with the help of Jupiter Notebook, we prepare the data for visualization of this data.
✏️ In this course, you will be guided through the basics of using:
Spark
MySQL
Jupyter Notebook
Spark
🔎 Topics covered in this course:
📝 Lecture 2. Big Data Storage. Three ways to store digital data.
What is big data?
What storage options we have today?
Public Cloud and Private Cloud.
Distribute you data
📝 Lecture 3. MySql. SQL. Introduction. How it works?
What is MySQL?
How Does MySQL Work?
Why is MySQL so Popular?
📝 Lecture 4. Installing and Launching MySQL Workbench. How to Get Started with MySQL Workbench
MySQL server setup
Initial settings
Getting Started with MySQL
📝 Lecture 5. Practice. Excel table into MySql. Import Excel data into a MySQL database.
Import Excel data into a MySQL
Create a new MySQL table.
Most Common Queries.
SELECT, DROP, UPDATE query mysql
📝 Lecture 6. Spark. Hadoop. Data’s Distribution. A Storage System for Big Data.
What is Hadoop?
Spark vs MySql
Spark. Analytics engine for big data processing
📝 Lecture 7. Installing and Launching Apache Spark. Download and Get Started.
Installing Apache Spark
updating PATH environment
Getting Started with Spark
Launching Apache Spark
📝 Lecture 8. Practice. Connecting Python To The Spark. Get Started with PySpark and Jupyter Notebook
Installing Anaconda On Windows
Running the Jupyter Notebook
Connecting Jupyter notebook to Spark
📝 Lecture 9. Practice. Connecting MySQL with Spark. Export Data from Mysql to Spark.
Connecting Jupyter notebook to Spark
How to set up PySpark for your Jupyter Notebook
Export Data from Mysql to Spark
Importing Spark Dataframes from MySQL on Jupyter notebooks
What Will I Learn?
What is big data?
What storage options we have today?
Public Cloud and Private Cloud.
Distribute you data
What is MySQL?
How Does MySQL Work?
Why is MySQL so Popular?
MySQL server setup
MySQL initial settings
Getting Started with MySQL
Import Excel data into a MySQL
Create a new MySQL table
Most Common Queries
SELECT, DROP, UPDATE query mysql
What is Hadoop?
Spark vs MySql
Spark. Analytics engine for big data processing
Installing Apache Spark
updating PATH environment
Getting Started with Spark
Launching Apache Spark
Installing Anaconda On Windows
Running the Jupyter Notebook
Connecting Jupyter notebook to Spark
Connecting Jupyter notebook to Spark
How to set up PySpark for your Jupyter Notebook
Export Data from Mysql to Spark
Importing Spark Dataframes from MySQL on Jupyter notebooks
We use cookies in our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of the cookies explicitly. Visit Cookie Settings to know more about the cookies used on our website.
This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.