Showing posts with label Vijay Gill. Show all posts
Showing posts with label Vijay Gill. Show all posts

Saturday, August 21, 2010

Cloud Computing: When to Use it; When Not To

There's an old set of tradeoffs between buying services or "doing it yourself," where it comes to computing or communications infrastructure. Hosted VoIP virtually always makes more sense than buying systems for a smaller business. But premises-based solutions typically are more economical for large enterprises.

Something of the same argument can be when companies or people choose between cloud computing services and building their own data centers. Obviously, large enterprises often justify building their own data centers. Others might be able to justify renting space in somebody else's data center. Smaller organizations might well find that renting computing cycles is the better choice.

Google Sr. Manager, Production Network Engineering and Architecture at Google argues that the decision is highly dependent on duty cycle. Steady, predictable loads, especially at a high rate of utilization, will tip economics in favor of self-operated or co-located facilities. Highly-variable demand, and low volume, will tend to tip the economics in favor of a cloud computing solution.

"Think of it as taking a taxi vs. buying a car to make a trip between San Francisco and Palo Alto," says Gill. "If you only make the trip once a quarter, it is cheaper to take a taxi." But "if you make the trip every day, then you are better off buying a car."

"The difference is the duty cycle. If you are running infrastructure with a duty cycle of 100 percent, it may make sense to run in-house," says Gill. The detailed assumptions and analysis are here: https://spreadsheets.google.com/ccc?key=0AgWfa8v6EGzjdElXQVFzU1plSXdEQmVHZ3M5YjlsNVE&hl=en&authkey=CM_RzL0E#gid=0

link to post

"Tokens" are the New "FLOPS," "MIPS" or "Gbps"

Modern computing has some virtually-universal reference metrics. For Gemini 1.5 and other large language models, tokens are a basic measure...