Reading HTML or Web

Readin HTML using Pandas

!pip install lxml #packages u need

Requirement already satisfied: lxml in /Users/sibbirahmmedsihan/opt/anaconda3/lib/python3.8/site-packages (4.6.1)

In [20]:

!pip install pandas

Requirement already satisfied: pandas in /Users/sibbirahmmedsihan/opt/anaconda3/lib/python3.8/site-packages (1.1.3)
Requirement already satisfied: python-dateutil>=2.7.3 in /Users/sibbirahmmedsihan/opt/anaconda3/lib/python3.8/site-packages (from pandas) (2.8.1)
Requirement already satisfied: pytz>=2017.2 in /Users/sibbirahmmedsihan/opt/anaconda3/lib/python3.8/site-packages (from pandas) (2020.1)
Requirement already satisfied: numpy>=1.15.4 in /Users/sibbirahmmedsihan/opt/anaconda3/lib/python3.8/site-packages (from pandas) (1.19.2)
Requirement already satisfied: six>=1.5 in /Users/sibbirahmmedsihan/opt/anaconda3/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas) (1.15.0)

In [21]:

import pandas as pd

In [22]:

df=pd.read_html('fifa_players.html')

In [5]:

len(df)

Out[5]:

1

In [12]:

data=df[0]

In [15]:

data #this will return the data.

Dropping columns:

newdf=data.drop(columns=['Unnamed: 0', 'Unnamed: 1', 'Unnamed: 7'])

newdf.head()

newdf.to_excel("newexcel.xlsx", index=None) #saving this to an excel

Reading file from an URL:

import requests

In [26]:

htmlurl="https://en.wikipedia.org/wiki/Python_(programming_language)"

In [27]:

r=requests.get(htmlurl)

In [29]:

wikidf=pd.read_html(r.text, header=0)

In [30]:

len(wikidf)

Out[30]:

14

In [35]:

wiki10=wikidf[10]

In [37]:

wiki10.to_excel('wiki10.xlsx', index=None)