HackTheNorth 2024 Project (Devpost Link)
Navigating large events can be overwhelming, and finding meaningful connections amidst the hustle and bustle is a challenge. We envisioned a platform that not only maps out event spaces in 3D but also weaves personal stories and hotspots into the experience. Inspired by the interactive nature of SnapMap, we aimed to create a space where attendees can share their stories, discover hotspots, and effortlessly navigate through events with the power of machine learning.
Spaces is an AI-powered interactive 3D map designed for events. It allows users to:
- Upload Stories: Share personal experiences and narratives tied to specific locations within the event.
- Discover Hotspots: Find popular areas and points of interest curated by the community.
- AI-Driven Search: Utilize AI to search for stories based on location and content, making it easy to find relevant experiences similar to SnapMap.
By combining these features, Spaces creates a dynamic and engaging environment using spacial data where attendees can connect, explore, and navigate events like never before.
Building Spaces was a collaborative effort, leveraging a robust tech stack to deliver a seamless user experience:
-
Frontend:
- Developed using React integrated with Capacitor to ensure a smooth mobile experience on both iOS and Android platforms.
- Utilized the Mappedin SDK for 3D mapping capabilities.
-
Backend:
- Powered by Python, our backend integrates with Google Cloud Platform (GCP) for multimodal embeddings models and file storage.
- Used ChromaDB for efficient vector embedding storage and retrieval.
- Implemented Convex for a swift backend infrastructure.
-
Integration:
- Seamlessly connected various tools and sponsor technologies to create a cohesive platform, ensuring that all components worked harmoniously together.
One of the toughest challenges we faced was integrating the Mappedin SDK for mobile. Since Mappedin v6 doesn't support React Native or other common mobile frameworks, we had to employ React and Capacitor for our frontend. This setup was significantly more complex and required extensive troubleshooting to achieve the desired functionality.
- First Hackathon Success: This was our team's inaugural hackathon, and we successfully brought our vision to life under tight deadlines.
- Seamless Tool Integration: Effectively integrated a multitude of different tools, including several from our sponsors, demonstrating our ability to collaborate and innovate.
- Bug Resolution: Overcame numerous pesky bugs, showcasing our persistence and problem-solving skills to deliver a polished product.
- Multimodal Embeddings: Gained a deep understanding of multimodal embeddings and their applications in enhancing user search capabilities.
- 3D Spatial Technologies: Explored and implemented 3D spatial technologies, expanding our knowledge in creating immersive digital environments.
- Model Fine-Tuning: Enhance our multimodal model for improved accuracy and better user experience.
- Event Partnerships: Collaborate with future events, such as hackathons, to deploy Spaces and provide attendees with an innovative navigation and storytelling tool.
- Quality of Life Improvements: Continuously refine the platform with user feedback, enhancing usability and adding new features to enrich the overall experience.
-
Frontend:
- React + Capacitor for mobile development
- Mappedin SDK for 3D mapping
-
Backend:
- Python integrated with GCP for multimodal embeddings and file storage
- ChromaDB for vector storage and retrieval
- Convex for backend infrastructure
Spaces represents our passion for blending technology with human stories, creating a platform that not only maps events but also captures the essence of the experiences within them. We're excited to continue developing Spaces and bring it to events worldwide, making every attendee's journey memorable and interconnected.