Software Engineer, AI Gateway

Other Jobs To Apply

About Vercel:

Vercel is the agentic infrastructure company, freeing people and agents to ship what's next. For more than a decade we've helped builders move from idea to production with speed, security, and exceptional developer experience.

Now we're scaling our products for both agents and people to ship and run software, built in the open and trusted by OpenAI, PayPal, Ramp, Supreme, and millions of developers worldwide.

 

About the role

As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.
 

What you'll do

  • Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
  • Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
  • Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
  • Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
  • Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.

What you need

  • 5+ years of relevant experience
  • Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
  • Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
  • Experience contributing to or participating in open source projects
  • Excellent communication skills and the ability to work effectively in a collaborative team environment

Benefits & Compensation:

  • Competitive compensation package, including equity.
  • Inclusive Healthcare Package.
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
  • Flexible Time Off.
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.
The San Francisco, CA base pay range for this role is $196,000-$294,000. Actual salary will be based on job-related skills, experience, and location. Compensation outside of San Francisco may be adjusted based on employee location. The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role. Your recruiter can share more details during the hiring process.

#LI-KR1

Disclosures:

  • Privacy: Please review our Job Applicant Privacy Policy for more information on how we handle your data.
  • Equal Opportunity: Vercel is committed to fostering and empowering an inclusive community within our organization. We do not discriminate on the basis of race, religion, color, gender expression or identity, sexual orientation, national origin, citizenship, age, marital status, veteran status, disability status, or any other characteristic protected by law. Vercel encourages everyone to apply for our available positions, even if they don't necessarily check every box on the job description.
Back to blog

Other Jobs To Apply

Virtual Pharma Account Manager: High-Impact Territory Sales

Principal Business Development Manager Pharma at Waters Corporation: 100% Remote (US)

Dist Design Project Coord - Sr

Market Commentary Writer and Social Editor at Wealthfront: 100% Remote (San Francisco, CA, New York City, NY)

Analyst, Early Career (Full Stack)

Sales Executive, Digital Assets

Senior Pre-Sales Systems Engineer, Enterprise

Remote Enterprise Identity & Security AE

Remote Retirement Inside Sales Specialist

Account Executive, B2B SaaS — Hybrid/Remote

[Remote] Director - Special Investigations (FIU)

Senior Manager, SAP AI Engineering

Associate Director, eCommerce Operations, eProcurement

Manager, Professional Services- Streaming Media

Commercial Sales Engineer - East - Remote

Emerging Fraud Researcher

HubSpot Administrator - Remote

Remote Snowflake Data Lake Support Pro

Investigator, Operational Excellence

Remote Principal Engineer, Identity & Engagement

Crypto Twitter Content Lead: Real-Time & Witty

TikTok Social Programming, Bleacher Report at Warner Bros. Discovery: 100% Remote (NY, GA)

Inbound Sales Call Center Representative

Senior Manager, Compensation & People Analytics (Remote)

Virtual Sales Rep: Fully Remote, No Cold Calls, Great Training

Services Project Coordinator

Dashers - Sign Up and Start Earning

Remote-Eligible Senior Business Analyst: SDLC & Stakeholder Leader

Notary Stamp Order Online | West College Corner, IN

Remote Freelance Japanese Teacher & 1:1 Coach

Audio & Digital Account Executive

Assistant, Contract Administration

Coordinator, People Data Operations (Remote)

Live Entertainment Marketing Coordinator

Global Technical Product Advisor - Off Road

Guest Experience Center Agent / Inside Sales

Remote SEO Content Lead

Remote Diagnostic Technician: Fast, CustomerFocused Support

Navy Medicine Analytics SME — Remote

Digital Evangelist

Workday Solution Architect

Experience Strategy Manager

Part-Time Oncology Data Specialist - Certified (remote)

Technical Support Consultant Analyst (Remote - PST Working Hours)

GL Claims Specialist - Remote

Senior Underwriter - Management Liability

Controller / Director of Finance

Remote AR Analyst I: Collections & Resolution

Senior Sales Executive

Manager, Flight Maintenance - Traveling

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...