engblogs

summaries of the latest blog articles from your favorite tech companies.
Apple MLApple ML

Accelerating LLM Inference on NVIDIA GPUs with ReDrafter

Optimizing LLM inference acceleration on NVIDIA GPUs with ReDrafter

12/18/2024
DatabricksDatabricks

Česká spořitelna: How GenAI is Transforming Call Centers in the Financial Services Industry

Explore how Česká spořitelna implemented GenAI in call centers to enhance quality control and reduce operational costs while managing approximately 2 million calls annually.

12/18/2024
MetaMeta

How we think about Threads’ iOS performance

Improving iOS performance in the Threads app by monitoring key metrics, including %FIRE, TTNC, and cPSR, while tackling performance challenges and case studies on publish reliability and navigation latency.

12/18/2024
AWS MLAWS ML

Using natural language in Amazon Q Business: From searching and creating ServiceNow incidents and knowledge articles to generating insights

Integrating Amazon Q Business with ServiceNow for enhanced user productivity and insights through generative AI-powered assistants and custom plugins

12/18/2024
AWS MLAWS ML

How Fastweb fine-tuned the Mistral model using Amazon SageMaker HyperPod as a first step to build an Italian large language model

Fastweb fine-tuned Mistral model using SageMaker HyperPod as first step to build Italian large language model

12/18/2024
DuolingoDuolingo

Duologues: the conversations shaping Duolingo Design

Exploring conversations shaping Duolingo Design through Duologues speaker series

12/18/2024
Google DeepMindGoogle DeepMind

FACTS Grounding: A new benchmark for evaluating the factuality of large language models

FACTS Grounding introduces a new benchmark and leaderboard to rigorously evaluate and improve the factual accuracy and grounding of large language model responses using comprehensive, multi-judge assessment across diverse, real-world documents.

12/17/2024
Snorkel AISnorkel AI

How LLM evaluation drives better models in Snorkel Flow

Enhancing large language model (LLM) evaluation using Snorkel Flow for better models and faster results

12/17/2024
DatabricksDatabricks

Introducing Git Support for Queries in Databricks

Manage queries in version control with Git support in Databricks' New SQL Editor.

12/17/2024
OpenAIOpenAI

OpenAI o1 and new tools for developers

Exploring the latest features of OpenAI o1 and innovative developer tools

12/17/2024
DatabricksDatabricks

Benchmarking Domain Intelligence

Evaluating models performance on Domain Intelligence Benchmark Suite (DIBS) in comparison to academic benchmarks to highlight the need for domain-specific testing and choosing models based on specific needs.

12/17/2024
NetflixNetflix

Title Launch Observability at Netflix Scale

Empowering successful title launches and discoverability at Netflix through robust observability solutions.

12/17/2024