Scale AI System Design
Summary
Interview Experience
Design a system that fetches tasks (represented as JSON blobs) from MongoDB, and lets operators create jobs. A job can be comprised of up to 5000 tasks. A task is completed by sending it to a 3rd party LLM service and waiting for a response (synchronously). Each API request to the 3rd party LLM serv...


