Gemma 3 270M: Ultracompact AI for Mobile Devices

Gemma 3 270M: Ultracompact AI for Mobile Devices

Ondřej Barták
Ondřej Barták
Entrepreneur and Programmer
18. 8. 2025
2 minutes reading · 27 views
Gemma 3 270M: Ultracompact AI for Mobile Devices

Gemma 3 270M: Ultra-Compact AI for Mobile Devices

Google's Gemma model family is expanding rapidly. Following the launch of Gemma 3 and Gemma 3 QAT for the cloud and desktops, Gemma 3n arrived for mobile devices with multimodal AI. Now comes Gemma 3 270M, a model with 270 million parameters (170 million for embeddings and 100 million for transformer blocks), designed for task-specific fine-tuning. With a vocabulary of 256,000 tokens, it is ideal for domains such as languages or specialized fields. Its context window is 32,000 tokens, which is sufficient for most tasks.

The model excels in energy efficiency: with INT4 quantization, it consumes just 0.75% of a Pixel 9 Pro's battery for 25 conversations. It runs on devices with at least 4 GB of RAM (CPU) or 2 GB of VRAM (GPU), with a file size of around 550 MB and quantized versions as small as 200 MB. On the Apple M4 Max, it achieves over 650 tokens per second with low latency.

Key Capabilities and Deployment

Gemma 3 270M is multimodal (processing text, images, and video) and multilingual (supporting over 140 languages), with built-in instruction-following capabilities according to the IFEval benchmark. Both pretrained and instruction-tuned checkpoints are available, including QAT for INT4 precision without a significant drop in performance.

Fine-tuning is fast—it can be performed with minimal data using LoRA on devices with 8 GB of RAM and 4 GB of VRAM. It supports platforms such as Windows, macOS, and Linux, as well as tools such as Hugging Face, UnSloth, and JAX. Deployment is possible locally or on Google Cloud Run, making it ideal for privacy-preserving offline applications.

Gemma3 270M

Practical Applications

The model is designed for well-defined tasks such as sentiment analysis, entity extraction, query routing, and creative writing. One example is Adaptive ML's work with SK Telecom, where a fine-tuned version outperformed larger models in multilingual moderation. Other applications include the Bedtime Story Generator for offline story creation.

It is excellent for high-volume workloads, saving time and costs—it runs on inexpensive infrastructure or directly on the device. It enables the creation of a fleet of specialized models without a large budget.

Limitations and Availability

As a compact model, it may suffer from hallucinations and produce less robust outputs than larger LLMs. Neither the training data nor the source code has been published; only the pretrained weights are available. It can be downloaded from Hugging Face, Ollama, Kaggle, LM Studio, or Docker. Try it on Vertex AI, llama.cpp, Gemma.cpp, LiteRT, Keras, or MLX.

Gemma 3 270M, released in mid-August 2025, pushes the boundaries of efficiency for developers seeking fast, energy-efficient AI solutions on edge devices. We look forward to seeing your innovations in the Gemmaverse.

Advertisement

Content created with help from UpTier.

SEO and GEO on autopilot. UpTier’s multi-agent systems write and optimize content for search engines and AI answers.

Discover UpTier ↗

Category:AI
Did you enjoy this article?
Discover more interesting posts on our blog
Back to blog

Related posts

OpenAI cracks down on child abuse. ChatGPT will block accounts for a full dayOpenAI cracks down on child abuse. ChatGPT will block accounts for a full day
OpenAI is strengthening child protection: a new system can detect previously unknown AI-generated images, and ChatGPT will block accounts for 24 hours if users try to obtain them.
4 min read
18. 11. 2026
Google makes Tasks free for Gemini 4 Hydrogen usersGoogle makes Tasks free for Gemini 4 Hydrogen users
Tasks is becoming available for free to hundreds of millions of Gemini 4 Hydrogen users. Google says it can call businesses, book appointments and complete purchases on their behalf.
1 min read
18. 11. 2026
OpenAI introduces GPT-6.2 Astra and Sol for professional and everyday workOpenAI introduces GPT-6.2 Astra and Sol for professional and everyday work
OpenAI has introduced two models: Astra for complex professional tasks and Sol for everyday work. Both are available in ChatGPT Work, Codex and through the API.
3 min read
17. 11. 2026
Přihlaste se k odběru našeho newsletteru
Zůstaňte informováni o nejnovějších příspěvcích, exkluzivních nabídkách, a aktualizacích.
CodedTrip

Operated by CodedTrip LLC, USA.

YouTube
TikTok