type
status
date
slug
summary
tags
category
icon
password
Created time
Aug 12, 2023 12:35 AM
In the fast-paced world of AI, efficiency and cost-effectiveness are key. Together AI, a company known for its relentless pursuit of optimization, has just announced a groundbreaking update that's sure to make waves in the industry. Hold on to your hats, because we're diving into a 5x price reduction on Together API, thanks to faster inference! ๐
Innovations and Optimizations ๐ง ๐ผ
Together AI is no stranger to innovation. Their research team has been at the forefront of today's fastest optimizations, developing techniques like FlexGen and algorithms like FlashAttention-2. Since launching Together API, their cloud platform for running leading open-source AI models, they've been hard at work optimizing their inference stack. And guess what? They're not stopping anytime soon, with more speed-ups on the horizon.
More Speed, More Savings ๐๏ธ๐ธ
With faster performance, Together AI can process more transactions per GPU, leading to better cost efficiency. It's like upgrading from a bicycle to a race car without burning extra fuel! Today's announcement brings updated pricing that offers more for less. Let's break down the numbers:
Inference Pricing for Chat, Language, and Code Models
Model Size | Price per 1K tokens |
Up to 3B | $0.0001 |
3.1B - 7B | $0.0002 |
7.1B - 20B | $0.0004 |
20.1B - 40B | $0.001 |
40.1B - 70B | $0.003 |
Pricing for Fine-Tuned Models
Model Size | Price per 1K tokens | Price per hour hosting |
Up to 3B | $0.0001 | $0.52 |
3.1B - 7B | $0.0002 | $0.52 |
7.1B - 20B | $0.0004 | Coming soon |
20.1B - 40B | $0.001 | Coming soon |
40.1B - 70B | $0.003 | Coming soon |
Image Models Pricing
Image Size | 25 steps | 50 steps | 75 steps | 100 steps |
Up to 300 kilopixels (512 x 512) | $0.001 | $0.002 | $0.0035 | $0.005 |
Up to 1.1 megapixels (1024 x 1024) | $0.01 | $0.02 | $0.035 | $0.05 |
Get Started Today! ๐
Ready to jump in? Head to api.together.ai and start running more efficient inference with their Playgrounds and APIs. New users even get $25 in free credits to kickstart their journey.
My Thoughts: A New Era of AI ๐
Together AI's announcement is more than just a price reduction; it's a testament to the power of innovation and optimization. By focusing on efficiency and delivering value, they've set a new standard for the industry.
The detailed pricing structure, tailored to different model sizes and types, reflects a thoughtful approach to meeting diverse needs. It's like having a personalized menu for every AI enthusiast, from hobbyists to professionals.
In a world where every penny counts, Together AI's commitment to providing more for less is a refreshing and welcome change. It's not just about cutting costs; it's about empowering more people to explore, create, and innovate with AI.
So here's to faster inference, reduced prices, and a future where AI is accessible to all. Together, we're building a brighter tomorrow! ๐๐ ๏ธ
What are your thoughts on Together AI's pricing update? Share your insights and join the conversation below! ๐จ๏ธ๐ฌ
- Author:raygorous๐ป
- URL:https://raygorous.com/article/together-ai-price-reduction
- Copyright:All articles in this blog, except for special statements, adopt BY-NC-SA agreement. Please indicate the source!
Relate Posts
LLM Open Challenges 3: Do we always need GPUs? (3 min)
LLM Open Challenges 1: How to improve efficiencies of chat interface? (3min read)
๐ LLM Open Challenges 2: Large Language Models for Non-English Languages: Challenges and Perspectives ๐ย (3min read)
RAVEN: Unleashing the Power of In-Context Learning ๐ย (3min read)
Introducing DoctorGPT: Your Private AI Doctor ๐ฉบ๐ปย (3min read)
Exploring Open-Source AGI Projects: Use Cases and Comparisons (5min read)