Software Engineer, AI Gateway

Other Jobs To Apply

About Vercel:

Vercel is the agentic infrastructure company, freeing people and agents to ship what's next. For more than a decade we've helped builders move from idea to production with speed, security, and exceptional developer experience.

Now we're scaling our products for both agents and people to ship and run software, built in the open and trusted by OpenAI, PayPal, Ramp, Supreme, and millions of developers worldwide.

 

About the role

As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.
 

What you'll do

  • Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
  • Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
  • Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
  • Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
  • Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.

What you need

  • 5+ years of relevant experience
  • Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
  • Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
  • Experience contributing to or participating in open source projects
  • Excellent communication skills and the ability to work effectively in a collaborative team environment

Benefits & Compensation:

  • Competitive compensation package, including equity.
  • Inclusive Healthcare Package.
  • Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
  • Flexible Time Off.
  • We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.
The San Francisco, CA base pay range for this role is $196,000-$294,000. Actual salary will be based on job-related skills, experience, and location. Compensation outside of San Francisco may be adjusted based on employee location. The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role. Your recruiter can share more details during the hiring process.

#LI-KR1

Disclosures:

  • Privacy: Please review our Job Applicant Privacy Policy for more information on how we handle your data.
  • Equal Opportunity: Vercel is committed to fostering and empowering an inclusive community within our organization. We do not discriminate on the basis of race, religion, color, gender expression or identity, sexual orientation, national origin, citizenship, age, marital status, veteran status, disability status, or any other characteristic protected by law. Vercel encourages everyone to apply for our available positions, even if they don't necessarily check every box on the job description.
Back to blog

Other Jobs To Apply

Lead Environmental Consultant

Virtual Banker III

Senior Customer Success Associate

Senior Consultant, Account Services Management - Plano, Texas

100% Remote Oracle HRMS Functional Lead

Solutions Architect, Virtualization

Remote Apple Jobs

Remote Medical Device Connectivity Engineer II

Solution Architect, D&T, Plan to Produce

Product Manager– Digital Transformation II USA

Construction Quality Assurance Manager

BESS Technician II – Traveling O&M Technician

Remote Project Manager – EPC & Engineering Delivery

Project Manager - Energy Efficiency

Energy Efficiency & Consumer Program Coordinator

barista - Store# 02976, MOHAWK & M STREET - SPRINGFIELD

Remote Creative Director, Enterprise Design & Branding

Remote Bank Customer Service (DE, OH, UT, AZ, MD, PA, NJ)

Anti-Money Laundering Monitoring Analyst

Credit Strategy Director, Home Improvement

Client Partner

Remote Customer Service & Sales Specialist

Remote Director, Customer Education

Talend Developer Healthcare EDI & Databricks USA (Remote)

Growth Marketer, Creators & Channels (Remote)

Remote AWS Cloud Engineer - Terraform & GitLab CI/CD

Remote New Business Account Executive - East

iOS Engineer Remote

Creator Payments Experience Product Manager

Optimizely Content Management consultant

Remote Sr Director, Atlas Customer Operations

Software Engineer (L3) Email

Solution Specialist- NY

Strategic Partnerships - Credit | Capital Markets

Product Manager – Pricing Delivery and Display

[Remote] JustGiving Sales Customer Account Manager

Principal Engineer, Network Software (Traffic & Modeling)

Remote Director of Community & Customer Experience

Remote BDR for Transportation SaaS Growth

AI Subject Matter Expert, Construction

Sr Technical Manager - Digital Integration for Semiconductor Process Development

Field Applications Engineering

Senior Lead Director of Demand Generation (Remote)

Senior Linux TAM - Enterprise Advisory (Remote)

Underwriting Large Case Specialist (Remote)

LTC Claims - Reimbursement Coordinator - 21596

Associate Director, Core Performance & Fixed Income Analytics - Americas

CME Associates is hiring: Senior Web Developer in Portland

Senior Relationship Manager, RIA Services (Remote, Bay Area)

Front-Office Software Technical Trading Engineer, AVP – API, ETL, Java, C#

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...