Work · Client project
Saudi government tenders: data extraction and an Excel dashboard
Data on more than 760 awarded tenders from the Etimad portal, with every bidder's offer, in a formatted Excel workbook ready for analysis.
The challenge
A business consultant needed data on awarded government tenders from Saudi Arabia's Etimad portal to analyze: the project, the agency, the reference number, every bidder, their financial offers and the winner.
What I built
- Direct data pull: a Python script that calls the data endpoints the portal itself uses instead of driving a browser, so it pulls data faster and keeps the numbers exactly as they are.
- Interruption-proof runs: handles rate limits and resumes where it stopped if a run is interrupted.
- Data cleaning: pandas separates currency from amounts and turns each tender's bidder list into one row per bidder and offer.
- Excel dashboard: a formatted workbook generated automatically, with a dashboard of six charts, including the top 10 winning companies, the highest-spending agencies and the spread of tenders.
Tech
Python with requests to pull the data, pandas to clean and reshape it, and xlsxwriter to generate the workbook and its charts.
Outcome
I delivered the workbook ready for analysis, with over 8,000 bids across more than 760 tenders. The data is public, from the portal.
- Type
- Client project
- Services
- Connecting your systems
- Tech
- Python
- requests
- pandas
- xlsxwriter
The client's review
«من أفضل المستقلين الذين تعاملت معهم من حيث الاحترافية والجودة والاهتمام بالعمل والتواصل. شكراً محمد»Tell me about one process
If a process in your company still runs on spreadsheets and group chats, tell me about it. I'll tell you honestly whether a custom system is worth it.