Skip to content

A resilient crawler + analyzer for US Mineral Exchange listings with a simple CLI.

License

Notifications You must be signed in to change notification settings

therealtplum/usme-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

usme-analyzer

A resilient crawler + analyzer for US Mineral Exchange listings with a simple CLI.

Quickstart

python -m venv .venv && source .venv/bin/activate
pip install -r requirements.txt
python -m usme_analyzer.analyze --pages 3 --states TX NM --min-monthly-cf 200

Or install as a package and use the CLI:

pip install .
usme-analyze --pages 3 --states TX NM --min-monthly-cf 200

Output

Saves a CSV (default: usme_analysis.csv) with columns:

  • listing_id, state, county, net_acres, avg_monthly_net_cash_flow
  • annual_cf_gross, after_tax_annual_cf
  • fv_cf_low, fv_cf_high, fv_nma_low, fv_nma_high, fv_blended
  • yield, years_to_break_even, score

Tuning

Adjust modeling assumptions in usme_analyzer/constants.py:

  • STATE_TAX, NMA_DEFAULTS
  • CF_MULT_LOW/HIGH
  • commodity price/elasticity and oil/gas share

Notes

  • Be considerate: default delay & retries are baked in.
  • Parsing is text-based to avoid brittle selectors; update the regex if USME changes their layout.

About

A resilient crawler + analyzer for US Mineral Exchange listings with a simple CLI.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published