Welcome! Are you interested in learning how to gather data from the internet? This website was designed as a trial ground to practice skills covered in Lorae Stojanovic's presentation to the Brookings Data Network on June 20, 2024, "Web Scraping with Python". The presentation includes slides, code to scrape this website, and a GitHub repository encapsulating the entire project, including the webpage that you're currently reading.
The presentation covers foundational topics related to web scraping with Python, such as:
requests package to access static web content via HTTP requestsbeautifulsoup4 packageselenium packagerequests packageFeel free to explore the code accompanying the presentation, which scrapes data from this website using three methods:
Go forth and explore!
Profit per employee is calculated by dividing a company's yearly profit by its number of full-time staff. Data are courtesy of the Visual Capitalist and Companies Market Cap.
| Rank | Company | Industry | Profit per Employee | Market Cap, June 2024 |
|---|---|---|---|---|
| 1 | ConocoPhillips | Energy | $1,970,000 | $127.38 B |
| 2 | Fannie Mae | Financials | $1,510,000 | $5.16 B |
| 3 | Freddie Mac | Financials | $1,190,000 | $22.71 B |
| 4 | Valero | Energy | $1,180,000 | $49.39 B |
| 5 | Occidental Petroleum | Energy | $1,110,000 | $54.31 B |
| 6 | Cheniere Energy | Energy | $921,000 | $36.88 B |
| 7 | ExxonMobil | Energy | $899,000 | $490.67 B |
| 8 | Phillips 66 | Energy | $848,000 | $57.59 B |
| 9 | Marathon Petroleum | Energy | $815,000 | $60.75 B |
| 10 | Chevron | Energy | $809,000 | $280.40 B |
| 11 | PBF Energy | Energy | $798,000 | $5.10 B |
| 12 | Enterprise Products | Energy | $752,000 | $61.45 B |
| 13 | Apple | Tech | $609,000 | $3,245 B |
| 14 | Broadcom | Tech | $575,000 | $839.05 B |
| 15 | HF Sinclair | Energy | $560,000 | $10.01 B |
| 16 | D. R. Horton | Construction | $433,000 | $45.90 B |
| 17 | AIG | Financials | $392,000 | $49.19 B |
| 18 | Lennar | Construction | $384,000 | $40.93 B |
| 19 | Energy Transfer | Energy | $379,000 | $52.18 B |
| 20 | Pfizer | Healthcare | $378,000 | $155.32 B |
| 21 | Netflix | Tech | $351,000 | $295.45 B |
| 22 | Microsoft | Tech | $329,000 | $3,317 B |
| 23 | Alphabet | Tech | $315,000 | $2,170 B |
| 24 | Meta | Tech | $268,000 | $1,266 B |
| 25 | Qualcomm | Tech | $254,000 | $253.43 B |
The following graph contains United States nominal Gross Domestic Product data from Q1 1947 to Q1 2024. Data is courtesy of the Federal Reserve Bank of St. Louis "FRED" service.