Senior ML Engineer (Token Factory)

Nebius is seeking a Senior ML Engineer for its Token Factory team in Amsterdam, focused on building and optimizing an inference platform for foundation models. The role involves developing low-level kernels, improving GPU inference performance, and integrating new hardware architectures. Requires strong C++ or GPU programming expertise and systems-level experience.

Core AIHybridFull-timeSeniorC++GPU Programming

Senior ML Engineer (Token Factory)

Nebius is seeking a Senior ML Engineer for its Token Factory team in Amsterdam, focused on building and optimizing an inference platform for foundation models. The role involves developing low-level kernels, improving GPU inference performance, and integrating new hardware architectures. Requires strong C++ or GPU programming expertise and systems-level experience.

Apply

Core AIHybridFull-timeSeniorC++

Salary

Not specified

Work Location

Amsterdam, North Holland, Netherlands, NL

Work Model

Hybrid

Employment Type

Full-time

Experience Level

Senior

Core Qualifications

Technical (Must-have)

C++GPU programmingMemory managementSystems-level software developmentOperating system internalsKernel modulesDevice driversProfiling toolsDebugging toolsCPU architectureGPU architectureMemory hierarchy

Soft Skills

Collaboration

Preferred Qualifications

Technical (Nice-to-have)

CUDAROCmCUTLASSCuteThunderKittensTritonPallasMosaic GPUTensorRTTVMLinux internalsCompiler toolchainsperfVTuneNsightROCm profilervLLMsglangTGI

Key Responsibilities

•Develop and optimize low-level kernels and runtime components for AI inference
•Improve performance of inference engines GPU platforms
•Profile and debug system-level and hardware-level performance issues
•Integrate support for new hardware architectures (Hopper, Blackwell, Rubin)
•Collaborate with ML and backend teams to optimize end-to-end execution

ML EngineerAI InferenceGPU ProgrammingC++Cloud InfrastructureSeniorHybridAmsterdamTechnology