💡General Compute Raises $15M for AI Inference Neocloud
New chips and cloud service could slash your inference costs
TL;DR
General Compute raises $15M to launch an AI inference neocloud with specialized SambaNova SN50 chips. The new offering promises up to 3x faster performance and lower power consumption compared to GPUs.
General Compute has raised a $15 million seed round at a $60 million post-money valuation, aiming to disrupt the AI inference market with its neocloud service. This cloud solution uses SambaNova's specialized SN50 chips, which are air-cooled and consume less power than GPUs. The company claims its new offering is already the fastest for running MiniMax 2.7, an open-source large language model (LLM). If you're dealing with inference workloads, this could mean significant cost savings and performance boosts without the need to overhaul your existing data center infrastructure.
Key Points
General Compute secured $15M in seed funding at a $60M post-money valuation from FUSE VC, Carya Venture Partners, and Village Global Ventures.
SambaNova's SN50 chips are air-cooled and consume less power than GPUs, making them suitable for existing data center facilities without major upgrades.
General Compute has ordered $300 million worth of SambaNova SN50 chips to be the first neocloud deploying these specialized inference processors.
The new chips can generate 600-700 tokens per second compared to about 250 for GPUs, offering up to three times faster performance in certain workloads.
Evercrest Capital Partners made General Compute its first investment, highlighting the growing importance of efficient AI inference solutions.
Why It Matters
If you're running large language models or other complex AI workloads, General Compute's new neocloud could slash your costs and boost performance. The SambaNova SN50 chips offer up to three times faster token generation compared to GPUs, making them a game-changer for anyone looking to optimize their inference pipelines.
Frequently Asked Questions
Why does this matter?
If you're running large language models or other complex AI workloads, General Compute's new neocloud could slash your costs and boost performance. The SambaNova SN50 chips offer up to three times faster token generation compared to GPUs, making them a game-changer for anyone looking to optimize their inference pipelines.
What happened?
General Compute raises $15M to launch an AI inference neocloud with specialized SambaNova SN50 chips. The new offering promises up to 3x faster performance and lower power consumption compared to GPUs.
Comments
Be the first to comment
Enjoyed this article?
Get it daily. 7am. Free. Reads in 5 minutes.