Smart waste management through multimodal AI: Vision, Voice, and Dual-RAG-powered personalized recycling guidance
ReNova transforms waste disposal from a mundane chore into an engaging, rewarding experience. Using cutting-edge AI (CLIP vision, Whisper voice, Llama reasoning), we provide hyper-personalized recycling guidance that adapts to your city's regulations, your past behavior, and real-time recycler availability.
- Saksham Yadav - 7678369133
- Sagar S R - 9482209148
- Samrudh P - 7676296599
- Kushal L - 8660179391
India generates 150,000 tonnes of waste daily, but only 60% is collected and 15% is processed. Key challenges:
- โ Lack of awareness: Citizens don't know how to segregate waste correctly
- โ No standardization: Each municipality has different rules (Patiala โ Mumbai)
- โ No incentives: Why should users bother recycling?
- โ Broken last-mile: Recyclers are hard to find, unverified, offer low rates
- โ Compliance burden: Businesses struggle with waste audit trails for ESG reporting
Result: Recyclables end up in landfills, contaminating soil and water, releasing methane (28x worse than COโ).
ReNova is a multimodal GenAI platform that makes waste management:
โ
Effortless - Scan item โ Get instant guidance (vision AI)
โ
Accessible - Speak your question โ Get answers (voice AI in 12 languages)
โ
Personalized - Learns your behavior, adapts to your location
โ
Rewarding - Gamified tokens redeemable for pickups, discounts
โ
Compliant - Auto-logs waste for ESG/CSR reporting
โ
Connected - Matches users with verified recyclers via smart marketplace
1. USER โ Scan waste (image) or ask question (voice)
2. CLIP โ Identifies material, cleanliness, hazards
3. DualRAG โ GlobalRAG : Retrieves city regulations + user history
PersonalRAG : personal patterns
4. LLM โ Generates personalized disposal advice
5. GEO โ Finds nearest verified recyclers
6. REWARD โ User earns tokens based on material value
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ FRONTEND (React) โ
โ โโโโโโโโโโโโ โโโโโโโโโโโโโ โโโโโโโโโโโโโโ โโโโโโโโโโโ โ
โ โ Camera โ โ Voice โ โ Recycler โ โ Stats โ โ
โ โ Scan โ โ Query โ โ Map โ โ Dashboardโ โ
โ โโโโโโโฌโโโโโ โโโโโโโฌโโโโโโ โโโโโโโโฌโโโโโโ โโโโโโฌโโโโโ โ
โโโโโโโโโโผโโโโโโโโโโโโโโผโโโโโโโโโโโโโโโโโผโโโโโโโโโโโโโโผโโโโโโโ
โ โ โ โ
โโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโ
โ
โโโโโโโโโโโผโโโโโโโโโโโ
โ FastAPI Backend โ
โ (API Gateway) โ
โโโโโโโโโโโฌโโโโโโโโโโโ
โ
โโโโโโโโโโโโโโโโโโโโโโผโโโโโโโโโโโโโโโโโโโโโ
โ โ โ
โโโโโโผโโโโโโ โโโโโโโโผโโโโโโโ โโโโโโโโผโโโโโโโ
โ Vision โ โ Voice โ โ Reasoning โ
โ Service โ โ Service โ โ Service โ
โ (CLIP) โ โ (Whisper) โ โ (Llama) โ
โโโโโโฌโโโโโโ โโโโโโโโฌโโโโโโโ โโโโโโโโฌโโโโโโโ
โ โ โ
โโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโ
โ
โโโโโโโโโโโโโโโโโผโโโโโโโโโโโโโโโโ
โ โ โ
โโโโโโผโโโโโ โโโโโโโผโโโโโโ โโโโโโผโโโโโโ
โ MongoDB โ โ Faiss โ โ OSM โ
โ (Users, โ โ (Vector โ โ (Geo + โ
โ Scans) โ โ RAG) โ โ Routing) โ
โโโโโโโโโโโ โโโโโโโโโโโโโ โโโโโโโโโโโโ
-
ReNova uses two separate vector databases:
Global RAG โ shared knowledge base for all users Contains general waste management guidelines, recycling best practices, material classifications, disposal instructions, and environmental regulations. Built from curated documents and maintained by the platform. Read-only for users; updated by admins or automated ingestion pipelines.
Personal RAG โ user-specific knowledge base Stores documents uploaded by individual users (e.g., local recycling center guidelines, personal notes, community-specific rules). Each user has their own isolated vector space. Allows personalization: users in different cities get context relevant to their local recycling infrastructure.
- FastAPI: Async REST API framework
- MongoDB: User profiles, scans, transactions
- Faiss: Vector database for RAG (global + personal knowledge)
- CLIP (ViT-B/32): Zero-shot image classification (local inference)
- Whisper (Small): Multilingual speech-to-text (local inference)
- Groq (Llama 3.3 70B): LLM reasoning (FREE API)
- OSRM: Open-source routing for recycler navigation
- Vite: Fast build tool
- React Router: Client-side routing
- Zustand: Lightweight state management
- Leaflet: Interactive maps
- Axios: HTTP client
- Python 3.10+ (for backend)
- Node.js 18+ (for frontend)
- MongoDB 5.0+ (local or Atlas)
- Git
git clone https://github.com/Samrudhp/sathack.git
cd sathackcd backend
# Create virtual environment
python3.10 -m venv venv
source venv/bin/activate # On Windows: venv\Scripts\activate
# Install dependencies
pip install -r requirements.txt
# Create .env file
cat > .env << EOF
MONGODB_URI=mongodb://localhost:27017/
GROQ_API_KEY=your_groq_api_key_here
EOF
# Run server
uvicorn app.main:app --reload --port 8000Backend will be available at: http://localhost:8000
API Docs: http://localhost:8000/docs
cd frontend-v2
# Install dependencies
npm install
# Run dev server
npm run devFrontend will be available at: http://localhost:5174
cd backend
python scripts/seed_recyclers.py # Adds sample recyclers in Patiala
python scripts/seed_rag_docs.py # Adds waste management guidelines- CLIP-powered zero-shot classification (no training data needed!)
- Detects material type (PET, aluminum, e-waste, etc.)
- Estimates weight using object detection
- Assesses cleanliness score (affects token rewards)
- Identifies hazards (sharp objects, chemicals, biohazards)
- Whisper transcription in 12 Indian languages
- Natural language queries: "Where do I recycle batteries in Patiala?"
- RAG-powered responses using city-specific guidelines
- Bhashini translation for multilingual responses
- Geospatial ranking (distance, material acceptance, pricing)
- Real-time availability and capacity tracking
- Route optimization using OSRM (save time & fuel)
- Verified recyclers with ratings and reviews
- Earn tokens based on material value ร weight ร cleanliness
- Redeem for: pickups, premium analytics, partner discounts
- Leaderboards and challenges for engagement
- Referral system (both parties get bonus tokens)
- Dual-context retrieval: Global rules + your past behavior
- "You recycled PET well last time - try combining with HDPE pickup!"
- Learns your preferred recyclers, optimal days, material patterns
- Real-time tracking: COโ saved, water conserved, landfill avoided
- Verified calculations (not random numbers!)
- ESG-ready reports for businesses
โ
No facial recognition - Only waste images stored
โ
Location privacy - Coordinates never shared with recyclers until pickup confirmed
โ
Encrypted storage - MongoDB encrypted at rest
โ
GDPR-compliant - Right to deletion, data export
โ
Anonymous analytics - Personal data never sold
โ
Verification required - Business license + GST checks
โ
Escrow payments - Tokens held until pickup confirmed
โ
Fraud detection - AI flags suspicious patterns (fake scans, rating manipulation)
โ
Dispute resolution - Built-in mediation system
- Rate limiting (10 scans/min, 30 voice queries/min)
- Input validation (file type checks, size limits)
- SQL injection prevention (parameterized queries)
- CORS configuration (whitelist trusted origins)
- API key rotation (monthly automated)
- Audit logs (all transactions tracked)
Scan waste image and get disposal advice
curl -X POST http://localhost:8000/api/scan \
-F "user_id=USER_ID" \
-F "image=@bottle.jpg" \
-F "latitude=30.34" \
-F "longitude=76.38" \
-F "language=en"Response:
{
"material": "PET",
"confidence": 0.87,
"weight_estimate_kg": 0.03,
"cleanliness_score": 70,
"hazard_class": null,
"estimated_credits": 8,
"disposal_instruction": "โป๏ธ Clean, crush, recycle at nearest PET center...",
"recycler_ranking": [
{
"name": "Green Recyclers",
"distance_km": 2.3,
"phone": "+91-1234567890"
}
],
"environmental_impact": {
"co2_saved_kg": 0.075,
"water_saved_liters": 1.5
}
}Voice query with transcription + reasoning
curl -X POST http://localhost:8000/api/voice_input \
-F "user_id=USER_ID" \
-F "audio=@query.webm" \
-F "language=hi"Get nearby verified recyclers
curl "http://localhost:8000/api/marketplace/recyclers?lat=30.34&lon=76.38&material=PET"Full API docs: http://localhost:8000/docs (Swagger UI)
estimated_credits = weight_kg ร material_rate ร (cleanliness_score / 100)
# Example: 30g PET bottle, 70% clean
= 0.03 ร 400 ร 0.7
= 8.4 tokens (rounded to 8)| Material | Rate | Real-World Value |
|---|---|---|
| PET | 400 credits/kg | โน12/kg |
| Aluminum | 600 credits/kg | โน18/kg |
| E-Waste | 700 credits/kg | โน20/kg |
| Paper | 200 credits/kg | โน6/kg |
| Plastic (generic) | 250 credits/kg | โน7.50/kg |
| Glass | 150 credits/kg | โน4.50/kg |
- 100 tokens = Free doorstep pickup
- 500 tokens = โน50 voucher (Swiggy, Zomato, Amazon)
- 1,000 tokens = Premium analytics (waste trends, comparisons)
- 2,000 tokens = Tree planted in your name (verified via Grow-Trees.com)
-
Recycler Commissions (15% on transactions)
- User books pickup โ Recycler pays 15% platform fee
-
Premium Subscriptions (โน99/month)
- Priority pickups, advanced analytics, zero ads
-
B2G (Business-to-Government) Licensing
- Sell white-label solution to municipalities (โน5-10L per city)
-
Carbon Credit Aggregation
- Sell verified credits to corporates (โน1000-5000/ton COโ)
-
Data Licensing (anonymized)
- Insights to waste management companies (โน50K-2L/month)
- 500+ scans processed
- 50kg waste diverted from landfills
- 125kg COโ emissions avoided
- 2,500L water conserved
- 5M kg/year waste diverted
- 12,500 tons COโ/year avoided (= planting 570,000 trees!)
- 250M liters/year water saved
- SDG 11: Sustainable Cities and Communities
- SDG 12: Responsible Consumption and Production
- SDG 13: Climate Action
- SDG 17: Partnerships for Goals
We welcome contributions! Please see CONTRIBUTING.md for guidelines.
- Fork the repo
- Create feature branch:
git checkout -b feature/amazing-feature - Commit changes:
git commit -m 'Add amazing feature' - Push to branch:
git push origin feature/amazing-feature - Open Pull Request
- ๐ Bug reports and fixes
- ๐ Translations (add more languages)
- ๐ฑ Mobile app development
- ๐จ UI/UX improvements
- ๐ Documentation
- ๐งช Test coverage
- Email: samrudhprakash3084@gmail.com
- GitHub Issues: Report bugs here
- Groq - Free LLM API (Llama 3.3 70B)
- OpenAI - CLIP and Whisper models
- OpenStreetMap - Geospatial data and routing
- MongoDB - Database platform
- Qdrant - Vector database for RAG
โญ Star this repo if you found it helpful!
Made with ๐ for a sustainable future