Samza
Samza allows you to build stateful applications that process data in real-time from multiple sources including Apache Kafka. Battle-tested at scale, it supports flexible deployment options to run on YARN or as a standalone library. Samza provides extremely low latencies and high throughput to analyze your data instantly. Scales to several terabytes of state with features like incremental checkpoints and host-affinity. Samza is easy to operate with flexible deployment options - YARN, Kubernetes or standalone. Ability to run the same code to process both batch and streaming data. Integrates with several sources including Kafka, HDFS, AWS Kinesis, Azure Eventhubs, K-V stores and ElasticSearch.
Learn more
Muse Spark 1.2
Muse Spark 1.2 is Meta’s coding-focused model update designed to power Muse Code and improve software engineering workflows. The model is built for code generation, complex debugging, codebase understanding, long-horizon development tasks, and end-to-end developer workflows. Muse Spark 1.2 was co-trained with Muse Code to improve performance inside the terminal coding agent environment. It supports planning, goal conditioning, context compaction, subagent coordination, and iterative coding workflows across large repositories. The model was trained with expanded coding compute, diverse development environments, self-improvement loops, and long-running engineering tasks. Built for AI developers and software teams, Muse Spark 1.2 helps agents plan, write, validate, debug, and optimize code with greater autonomy.
Learn more
Apache Spark
Apache Spark™ is a unified analytics engine for large-scale data processing. Apache Spark achieves high performance for both batch and streaming data, using a state-of-the-art DAG scheduler, a query optimizer, and a physical execution engine. Spark offers over 80 high-level operators that make it easy to build parallel apps. And you can use it interactively from the Scala, Python, R, and SQL shells. Spark powers a stack of libraries including SQL and DataFrames, MLlib for machine learning, GraphX, and Spark Streaming. You can combine these libraries seamlessly in the same application. Spark runs on Hadoop, Apache Mesos, Kubernetes, standalone, or in the cloud. It can access diverse data sources. You can run Spark using its standalone cluster mode, on EC2, on Hadoop YARN, on Mesos, or on Kubernetes. Access data in HDFS, Alluxio, Apache Cassandra, Apache HBase, Apache Hive, and hundreds of other data sources.
Learn more
Muse Spark 1.1
Muse Spark 1.1 is a multimodal reasoning model from Meta Superintelligence Labs built for agentic tasks, coding, computer use, tool use, and multimodal understanding. The model improves on the original Muse Spark with stronger performance in planning, orchestration, long-context work, coding workflows, and external app interactions. Muse Spark 1.1 can manage a 1 million token context window, remember earlier actions, retrieve important information, compact context, and delegate tasks across parallel subagents. It is designed to operate across tools, MCP servers, custom skills, browsers, native apps, scripts, images, video, PDFs, and audio-based workflows. Developers can access Muse Spark 1.1 through the new Meta Model API public preview, while users can try it in Thinking mode in the Meta AI app and on meta.ai.
Learn more
