Freelance (Upwork)
YourSearchBox - AI-Powered Chatbot Platform with Web Scraping
Multi-tenant AI chatbot SaaS platform enabling agencies to manage 50+ client chatbots from a single dashboard. Built with MERN stack, Puppeteer web scraping, OpenAI GPT-3.5, and real-time Socket.IO chat.
Project Overview
YourSearchBox is a multi-tenant SaaS platform for agencies to create and manage AI chatbots trained on scraped website data, supporting agency clients managing 50+ chatbot instances from a single platform.
Developed multi-tenant AI chatbot SaaS using MERN stack with TypeScript, implementing role-based access (Admin, Manager, Agent) and comprehensive agency dashboard with client management, team collaboration, and white-label customization (custom branding, domain mapping).
Implemented Puppeteer web scraping engine with rotating proxy services, extracting website content and transforming into structured JSON training data for chatbot knowledge bases with automatic updates and scheduled re-crawling for content freshness.
Built real-time Socket.IO communication for live chat with message persistence, typing indicators, read receipts, and online presence indicators; integrated OpenAI GPT-3.5 API for context-aware responses with custom prompt templates and temperature control.
Implemented complete authentication system: email verification (Nodemailer), password reset with JWT tokens, session management with Redis, and rate limiting; deployed on AWS EC2 with PM2, MongoDB Atlas, and Cloudflare CDN.
Key Features
Web Scraping Capabilities
Implemented web scraping to automatically extract content from websites using proxy services and transform them into training data for chatbot knowledge bases.
Multi-tenant Architecture
Built architecture supporting agency dashboard with client management, team collaboration, and role-based access control for managing multiple chatbot instances.
Real-time Communication
Integrated Socket.io for live chat functionality enabling real-time interactions between users and chatbots.
User Authentication
Implemented secure user authentication with email verification and password reset features for seamless user experience.
Challenges & Solutions
Web Scraping at Scale
Extracting content from diverse websites with different structures while using proxy services efficiently was challenging.
Solution
Developed robust scraping system with proxy rotation and content transformation pipelines to handle various website structures and create training data.
Multi-tenant Management
Managing multiple chatbot instances across different organizations with proper isolation and access control was complex.
Solution
Built comprehensive multi-tenant architecture with role-based access control, client management, and team collaboration features.
Real-time Chat Performance
Maintaining real-time chat functionality across multiple concurrent sessions required optimization.
Solution
Implemented Socket.io with optimized connection management and efficient message routing for live chat functionality.
Project Gallery
Search interface with AI suggestions
Analytics dashboard showing search metrics
Project Details
Timeline
Mar 2021 - Jun 2022
Company
Freelance (Upwork)
My Role
Full Stack Developer
Tech Stack
Links
Visit Live SiteTestimonial
Junaid's work on our search platform transformed how our users find information. The AI-powered search capabilities he implemented have significantly improved user satisfaction and reduced support tickets.
Sarah Johnson
Product Manager at Jaydee Solutions