Llama Teacher

An open source AI personal tutor. Powered by Llama 3 70B & Together.ai.

Tech stack

• Llama 3 from Meta for the LLM
• Together AI for LLM inference
• Next.js app router with Tailwind
• Serper for the search API
• Helicone for observability
• Plausible for website analytics

Cloning & running

1. Fork or clone the repo
2. Create an account at Together AI for the LLM
3. Create an account at SERP API or with Azure (Bing Search API)
4. Create an account at Helicone for observability
5. Create a .env (use the .example.env for reference) and replace the API keys
6. Run npm install and npm run dev to install dependencies and run locally

Tasks - v0.5 (working version)

• Finalize homepage as is
• Remove similar topics
• Move "question" to "summary"
• Make it a chat where messages stay on the UI + don't refresh everything
• Migrate to GPT-4o & remove restrictions on tokens
• Show messages more nicely + with markdown mode + streaming
• Redesign the second screen to match the design – move sources to the right & make chat fixed on bottom
• Add shift enter to add new lines to the prompt
• Fix outline in search bar (main + dropdown)
• Put in age group into react state and into the prompt
• Make the search bar longer overall
• Complete TODOs in the repo
• Remove all unused images
• Update the favicon
• Refactor code in all components

Tasks – v0.75 (final UI changes)

• Fix the loading state of the main screen
• Make new final input & disable after someone sends + clear it
• Make chat fixed on the bottom and no scrolling overall
• Make sure it works well on mobile pt.1
• Fix mobile overall pt.2
• Iterate on the system prompt to make sure its good
• Make the main chat page autoscroll by default
• Add GitHub CTA & Together logo on the header
• Add the together domains and test them out
• Add password and send to team

Tasks – v1 (after endpoint access)

• Switch all the names to Llama-Tutor (site, repo, ect...)
• Switch from GPT-4o to Llama 405B and do testing
• Update CTA to say 405B on the main screen
• Write copy for tweet / linkedin + record demo vid with nice zoomins

Future Tasks

• Add slight design changes on chat: LlamaTutor icon + user messages blue
• Split the page into two pages and add back the footer
• Move all my icons into their own typescript file (transform.tools)
• Add a share & copy buttons that folks can click on after convos are generated
• Add potential follow up questions + new chat at the end of chat page
• Add a more detailed landing page with a nice section with the GitHub link
• Add nice hamburger menu on mobile
• Try out the generative UI stuff from Vercel
• Add a nicer dropdown overall