I Control My Mac with Voice — Say Hey Jarvis and It Does Everything

python dev.to

I built a voice assistant that controls 45 AI tools. I say "Hey Jarvis" and it executes.

What It Does

Command Action
"generate content" Creates YouTube scripts for 9 channels
"research quantum computing" Deep research via Tavily + AI
"write email about meeting" Drafts email, copies to clipboard
"start focus" Starts Pomodoro + blocks apps
"code review" Reviews git diff with AI
"summarize" Summarizes clipboard content
"find file tax PDF" Natural language file search

Architecture

Mic → Whisper (offline) → Intent Classify → Router → Ollama → say (TTS)
Enter fullscreen mode Exit fullscreen mode

Key Features

  • Offline speech (Whisper local)
  • Wake word: "Hey Jarvis"
  • Global hotkey: Ctrl+Space
  • Command chaining: "research AI then write blog"
  • Memory across conversations
  • Hindi + English

Setup

brew install portaudio
pip install SpeechRecognition pyaudio openai-whisper
python voice_commander_pro.py
Enter fullscreen mode Exit fullscreen mode

🔗 github.com/amrendramishra/ai-tools
🌐 amrendranmishra.dev

Source: dev.to

arrow_back Back to Tutorials