The future of User Interaction
(making it so Jarvis can do stuff)
Let's wake up
Your brain needs this 🧠
What is J.A.R.V.I.S.?
Just
A
Rather
Very
Intelligent
System
What does Jarvis do?
Research and Analysis: Retrieves information, runs simulations, and provides strategic advice.
System Control: Manages and automates security, defense systems, and suit operations.
Personal Assistance: Manages Tony’s schedule, handles communications, and controls home automation systems.
Engineering Support: Assists in designing, building, and maintaining technology, especially Iron Man suits.
Combat Assistance: Provides real-time tactical analysis and operates automated defense/offense mechanisms.
Companionship: Engages in conversations, offering humor, advice, and emotional support.
Emergency Response: Handles crises by executing safety protocols and taking autonomous action to protect Tony and his assets.
EVERYTHING
What's a Jarvis Experience?
Multi-modal: Text, Voice, Video, Gestures
Everywhere: Same assistant for house, phone, car, suit
Immediate response: Responds instantly, even if the actual task requires time to complete
Natural Language: Uses context to understand intent of commands issued with natural language
Proactive: Monitors and takes action and anticipates needs
No Configuration: Manages integrations automatically and dynamically
The Paradigm Shift
Today:
Browsers
Websites
Future:
"Jarvis" Clients
MCP Services
What can we not do
that Jarvis can do?
Nothing*
*well... maybe not the SHEILD, FBI, and CIA database stuff, but not for technical reasons
and maybe not the holographic stuff I guess 😅
So why don't we each already have a Jarvis?
Integrations
INTEGRATIONS
Model Context Protocol (MCP)
🤖
History and Architecture
Phase 1
Answers questions 🤯
Can't do anything ☹️
Phase 2
Can do stuff 🤯
Can't do enough ☹️
Phase 3
Can do ANYTHING 🤯
Clients aren't all ready 🙁
... yet 🤩
Architecture
Ido Salomon
Liad Yosef
Clients
Servers
The MCP Future
🤖
Resources
- The game-changing potential of Model Context Protocol
- How LLMs Change User Onboarding
- The cost-effective promise of Model Context Protocol (MCP)
- Introducing the Epic Workshop MCP
- Solving tool overload: A vision for smarter AI assistants
- MCPs: The Natural Evolution of CLIs
- Letting AI Interface with Your App with MCPs
- Let's talk about "Tool Poisoning"
- MCP Search Engine
... + more and counting
Resources
You are great!
Thank you!
𝕏 @kentcdodds
The future of User Interaction
By Kent C. Dodds
The future of User Interaction
We are entering a new era of user interaction. It's being built right before our very eyes and changing rapidly. As crazy as it sounds, soon each one of us will get our own Jarvis capable of performing actually useful tasks for us with a completely different user interaction mechanism than we're used to. But someone's gotta give Jarvis the tools to perform these tasks, and that's where we come in. In this talk, Kent will live code an MCP server and use it with an AI assistant to help us catch the vision of what this future could look like and our role in it.
