Note The job is a remote job and is open to candidates in USA. Company Confidential is the leading consumer purchase insights company, providing a complete view of U.S. and U.K. consumer spending. They are seeking a Senior Data and Software Engineer to architect, build, and maintain high-performance RESTful APIs for their data integration ecosystem. Responsibilities Design, develop, and maintain high-performance RESTful APIs that handle large-scale data operations with optimal efficiency and minimal latency Stay current with emerging API technologies, standards, and best practices, including GraphQL, gRPC, OpenAPI 3.0+, and modern authentication/authorization frameworks Implement performance optimization strategies for APIs, including caching, rate limiting, pagination, and asynchronous processing, to ensure scalability and reliability Integrate with third-party API vendors and external systems, managing authentication, data transformation, and error handling, and ensuring seamless interoperability Develop comprehensive API documentation using industry standards (Swagger/OpenAPI) and implement robust monitoring, logging, and observability solutions Design and implement data privacy features and services to enable secure multi-party collaboration, including query constraints, data clean room construction, deployment, and monitoring at scale Uphold data governance standards and practices, ensuring compliance with data quality standards Implement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial data Leverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records) Design highly performant data structures to ensure optimal storage and retrieval of data Utilize advanced database technologies to enhance data storage and processing capabilities Participate in code reviews to maintain code quality and consistency; collaborate with the infrastructure team to plan and execute deployments Lead and manage integration projects, including Company Confidential XMI Integration and Company Confidential integration, Additional clean rooms (AWS/AMC) modeling integration, CAPI integrations with walled gardens on behalf of brands, MadConnect integration pipes and Company Confidential, Opening new integration channels based on client demand Skills Extensive experience building production-grade RESTful APIs with proven expertise in API design patterns, versioning strategies, and backward compatibility Deep understanding of API performance optimization techniques, including query optimization, connection pooling, request batching, and response compression Strong knowledge of modern API technologies and standards, including OpenAPI/Swagger specifications, OAuth 2.0, JWT, GraphQL, and API gateway patterns Demonstrated success integrating with external API vendors and managing complex API ecosystems with multiple third-party dependencies Experience with API testing frameworks, contract testing, and implementing comprehensive API monitoring and alerting systems 6 or more years of experience as a back-end data/software engineer working on various data technologies, with proficiency in SQL, Python, and Javascript (Node.js) 2 or more years of hands-on experience with Company Confidential ecosystem, including expert knowledge of SnowPipes, Streams, Views, performance tuning, data modeling, ELT pipelines, data visualizations, and standard DWH concepts, and experience implementing complex SQL stored procedures Minimum 3 years' experience with various AWS cloud technologies and data lake management such as S3, Lambda, Airflow, Redshift, Company Confidential, and Glue Demonstratable knowledge of data clean room technologies (e.g., creating secure data shares using RBAC) Knowledge of all aspects of the SDLC as well as experience with Jenkins and setting up CI/CD processes Experience with security concepts such as CCPA, GDPR, SSO, and JWT Proficiency in data access controls, including aggregation constraints, projection policies, row access policies, column masking, and differential privacy; knowledge of data controls including semantic models, dbt, Company Confidential, Iceberg tables, various catalogs (glue, rest, nessie, hadoop etc), and catalog syncing concepts Experience with cloud environments such as Company Confidential, AWS, Company Confidential, Company Confidential, and GCP Expert-level experience building, maintaining, and scaling APIs using Node.js, Express, Fastify, or similar frameworks; proficiency with Swagger/OpenAPI specifications, API documentation tools, Next.js, and modern API development practices Knowledge of Company Confidential Native apps (v6+) Familiarity with BI tools such as Company Confidential, Company Confidential, Company Confidential, Looker, Quicksights, Tableau Detailed knowledge of AI concepts such as Generative AI chatbots, Company Confidential analyst, agent training, various LLMs, and prompt engineering Experience in modeling Snowpark ML, TensorFlow Benefits Benefits for full-time employees of Company Confidential begin on the first of the month following your date of hire with a generous employer contribution for medical, dental, and vision. In addition to company paid holidays, wellness time off, other wellness benefits, and employee discounts, you will also get employer paid life insurance and have the option to enroll into an employer-matched 401K Plan. We strongly encourage work/life balance by providing unlimited vacation days, available starting 90 days from your hire date as a team member. Company Overview Company Confidential offers technology, analytics, data processing, and business services for customers. It was founded in 2005, and is headquartered in New York, New York, USA, with a workforce of 51-200 employees. Its website is https// Confidential. Company H1B Sponsorship Company Confidential has a track record of offering H1B sponsorships, with 7 in 2026, 11 in 2025, 22 in 2024, 6 in 2023, 6 in 2022, 9 in 2021, 4 in 2020. Please note that this does not guarantee sponsorship for this specific role. Apply To This Job