Meta and Centrox Partner to Drive Enterprise Adoption of Llama 3.1 405B Using Scale GenAI Platform

Centrox is proud to be a Llama 3.1 405B is the largest openly available foundation model with capabilities that rival the best closed-source.

August 14, 2024

The Perceptron Pulse

Product

8 min read

Newsletter article hero image

What is Every Person And AI?

Artificial intelligence is no longer a tool reserved for researchers and enterprise teams — it has become woven into the everyday fabric of how people work, create, and communicate. From writing assistants to medical diagnostics, AI systems are reshaping interactions across every domain. At the center of this shift lies one fundamental question: how do we build AI that genuinely serves every person, regardless of background, language, or technical literacy?

The answer requires rethinking AI not as a product to be optimized for engagement metrics, but as infrastructure — reliable, accessible, and trustworthy. This newsletter edition explores the intersection of AI capability and human-centered design, examining where the industry is getting it right and where critical gaps remain.

Top 8

Each month, we track the eight most significant developments shaping the AI landscape. This edition's selections span foundation model releases, regulatory milestones, and breakthrough research papers that are already influencing how teams build in production.

  1. OpenAI releases GPT-4o with native multimodal input and real-time voice capabilities
  2. Google DeepMind's AlphaFold 3 extends protein structure prediction to DNA, RNA, and small molecules
  3. The EU AI Act enters into force, establishing the world's first comprehensive AI regulatory framework
  4. Meta releases Llama 3.1 405B as an openly available foundation model rivaling closed-source alternatives
  5. Anthropic publishes its model spec, offering rare transparency into alignment methodology
  6. Mistral Large 2 benchmarks above GPT-4 on several coding and reasoning evaluations
  7. Apple announces on-device AI features across iOS 18, prioritizing privacy-preserving inference
  8. A Stanford HAI report finds AI adoption in enterprise has doubled year-over-year for the second consecutive year

DeepSeek

DeepSeek has emerged as one of the most technically ambitious AI labs operating today. Founded in 2023 and backed by Chinese quantitative hedge fund High-Flyer, the company has rapidly produced a series of models that challenge assumptions about what is achievable outside of the largest Western AI organizations.

DeepSeek-V2, released in May 2024, introduced a mixture-of-experts architecture with 236 billion total parameters but only 21 billion activated per token — achieving frontier-level performance at a fraction of the inference cost. The model's technical report demonstrated competitive results on MMLU, HumanEval, and GSM8K benchmarks while significantly reducing per-token serving costs.

DeepSeek logo
DeepSeek — pushing the frontier from outside Silicon Valley

What makes DeepSeek particularly noteworthy for enterprise practitioners is the combination of open weights and detailed technical documentation. Unlike many labs that publish capability benchmarks without architectural specifics, DeepSeek's reports provide enough detail to inform deployment and fine-tuning decisions. Their OCR-focused models, in particular, have gained traction in document processing pipelines where accuracy on dense, multi-column layouts has historically been a bottleneck.

Latest News

The past thirty days have seen a convergence of product announcements, research publications, and policy developments that collectively signal a maturing industry navigating the transition from hype to infrastructure.

On the model front, the release of several strong open-weight alternatives has meaningfully shifted the build-vs-buy calculus for engineering teams. Organizations that previously defaulted to proprietary APIs for cost or latency reasons now have credible alternatives that can be hosted within their own infrastructure — an important consideration for sectors with strict data residency requirements such as healthcare, finance, and government.

Regulatory momentum continues to build. Beyond the EU AI Act, the United States has seen increased coordination between NIST, the FTC, and sector-specific regulators around AI transparency and accountability standards. For organizations building AI-powered products, the practical implication is that compliance documentation — model cards, data provenance records, human oversight mechanisms — is shifting from best practice to requirement.

Key Metrics

Understanding the quantitative landscape helps contextualize where investment and capability are concentrating. The following metrics are drawn from recent industry reports and our own tracking of public benchmarks.

Model MMLU HumanEval Cost / 1M tokens
GPT-4o 88.7% 90.2% $5.00
Llama 3.1 405B 88.6% 89.0% $0.90 (self-hosted)
DeepSeek-V2 78.5% 81.1% $0.14
Mistral Large 2 84.0% 92.1% $2.00
Benchmark scores and pricing as of Q3 2024. Self-hosted costs are estimates and vary by infrastructure.

What This Means For Enterprises

The commoditization of frontier-adjacent models has profound implications for enterprise AI strategy. Twelve months ago, access to a 70B+ parameter model required either a significant API budget or substantial in-house MLOps capability. Today, teams can run competitive open-weight models on rented GPU infrastructure at costs that make experimentation accessible to mid-market organizations.

Key Takeaway

The strategic question for enterprise teams is no longer "can we afford frontier AI?" — it is "how do we build the internal capability to evaluate, fine-tune, and responsibly deploy models that are now widely available?" Competitive advantage is shifting from model access to organizational readiness.

Three specific implications stand out for teams building AI-powered products in the current environment:

  • Vendor concentration risk is decreasing. The availability of strong open-weight alternatives reduces dependency on any single API provider, giving engineering teams more leverage in negotiations and more resilience in their architecture.
  • Fine-tuning ROI is improving. As base model quality rises, the marginal gain from domain-specific fine-tuning compounds. A stronger foundation means that even modest fine-tuning datasets can yield significant task-specific performance improvements.
  • Compliance burden is growing. Greater regulatory scrutiny means that the cost of deploying AI without proper documentation, testing, and oversight mechanisms is rising. Investing in AI governance infrastructure now is cheaper than retrofitting it under regulatory pressure.

Getting Started

For teams looking to act on the themes covered in this edition, we recommend the following starting points based on organizational maturity.

If you are evaluating models for the first time: Begin with a structured benchmark on your own data. Public benchmarks like MMLU and HumanEval measure general capability but rarely correlate perfectly with domain-specific tasks. Allocate time to build a small, representative evaluation set from your production use cases before committing to a model or provider.

If you have existing AI deployments: Audit your model selection decisions against the current landscape. Given how quickly the open-weight ecosystem has matured, a model comparison conducted six months ago may yield different conclusions today — particularly on cost-to-performance ratios.

If you are planning a fine-tuning project: Start with a strong open-weight base, establish a clean evaluation harness before you begin training, and treat your fine-tuning dataset as a first-class engineering asset with versioning and quality controls.

AI and enterprise strategy
Building the infrastructure layer for enterprise AI adoption

The Perceptron Pulse will continue tracking these developments monthly. If your team is navigating model selection, fine-tuning strategy, or AI governance implementation, the Centrox AI team is available for advisory sessions — reach out at research@centrox.ai.

user

The Perceptron Pulse

The Perceptron Pulse is Centrox AI's editorial team covering the latest breakthroughs in artificial intelligence, machine learning, and generative AI technologies.

Learn more about the latest News in AI Space

Join The Perceptron Pulse.

Cut through the AI hype with expert-selected research, product breakdowns, and trend analysis, delivered monthly.