Overview
TripTok is an app that looks at travel videos on social networks, automatically identifies the places that appear in them, and shows the route on an interactive map. The user can view, filter, and build their own route.
The challenge
There is a lot of great content on TikTok and Instagram, but it is very hard to take inspiration and translate it into a real route. The places are not tagged, the descriptions are vague, and you cannot search by criteria. The client wanted to close that gap.
The solution
We built a hybrid architecture - a video analysis pipeline on the backend (Python + GPT-4 Vision) that identifies places, objects, and relationships. On the user side - an iOS app that shows the results on Mapbox with a UX suited to fast scrolling.
Results
The app launched in beta and reached 2K active users in the first month. Next step: an Android launch and collaborations with travel bloggers.
