Project Icon

Mosaic

开源实时音视频创作工具

Mosaic是一款开源跨平台的实时音视频创作工具,面向艺术家和创意编码者。它采用可视化编程界面,整合Lua、GLSL实时编码和Pure Data等多种创意工具。Mosaic具备多线程处理、插件扩展、内置代码编辑器和非线性时间轴等特性,为创作提供灵活强大的支持。该工具适用于现场表演、教学和生成式艺术装置等领域,旨在提升人机交互效率和创意开发速度。

Mosaic logo

MOSAIC - an openFrameworks based Visual Patching Creative-Coding Platform

Mosaic

Mosaic Forum

Discord Mosaic Visual Programming

__

Table of Contents

INSTALL

LINUX

Check the Mosaic installer here: https://github.com/d3cod3/Mosaic-Installer

MACOS

Get Mosaic last release here: https://github.com/d3cod3/Mosaic/releases Just unzip the downloaded release and copy Mosaic app in your Application folder, that's it!

WINDOWS

Get Mosaic last release here: https://github.com/d3cod3/Mosaic/releases Just unzip the downloaded release and run it!

OF COMPATIBLE RELEASE

0.11.2 STABLE (official download from OF site)

Compiled/tested with QTCreator on osx/linux/windows Compiled on native VisualStudio on Windows

If you want to build Mosaic, just download OF0.11.2 for your OS (osx, linux, windows) and follow the correspondent setup guide.

DESCRIPTION

Mosaic-Data-Flow-Diagram

A very commonly used quote from Albert Einstein goes like this: « If I can't picture it, I can't understand it. ». A very commonly used quote from Henri Bergson goes like this: « The Eyes See Only What The Mind Is Prepared To Comprehend. » Following that thought, we'll eventually enter the realm of visual thinking, or better yet, the imagination realm, where complex ideas can be communicated in a simple way, or just the opposite.

Mosaic is a visual thinking toolkit made by artists, for artists.

Emanuele Mazza started the Mosaic project in 2018, in strict relation with the work of ART+TECHNOLOGY research group Laboluz from the Fine Art faculty of the Universidad Politécnica de Valéncia (Spain). From the very beginning, the source code was released on the Github development platform with a focus on making the code modular and simple to read, in order to encourage potentially interested coders in participating and collaborating on the project. Recently in 2020, digital artist Daan de Lange became a contributor of Mosaic code, participating in code development and restructuring.

Mosaic is a multi-platform livecoding programming/patching environment for creating real-time audio-visual compositions. It's principally designed for live needs, as can be teaching in class, live performing in an algorave, or running a generative audio-visual installation in a museum. It aims to empower artists, creative coders, scenographers and other creative technologists in their creative workflow. It's a FLOSS, Free/Libre and Open Source Software with multi-platform support, and it's written in C++, offering high performance.

Mosaic is shipped with an internal code editor, non-blocking system dialogs, a programmable non-linear interactive timeline, an included patch video exporter with subtitler for easy tutorial creation, lua/glsl/bash live-coding and pure data live-patching capability, a good selection of audio synthesis modules, multiple fullscreen output windows capabilities ( as many as your system can have ) with an independent warping for each window, a map-map style integrated mapping module, and an easy to use osc sending/receiving objects/nodes for network communication.

The idea behind Mosaic is to facilitate human-machine communication, to amplify imagination and to speed up the creative workflow, without sacrificing the spectrum of possibilities. To achieve this, it bundles together various creative-coding tools, acting as an interactive bridge between them. It includes a collection of audio-visual objects that can be easily connected together using a nodal-based graphical interface, defining a custom dataflow.

Mosaic is mainly based on two frameworks : OpenFrameworks and ImGui. OpenFrameworks is an open source C++ toolkit for creative coding. Dear ImGui is a bloat-free graphical user interface for C++ with minimal dependencies. Together with the latter ones, Mosaic bundles comes with other 3rd party libraries such as libpd and numerous ofxAddons. It also embeds various programming languages for live-coding purposes : Lua with OF-bindings scripting interpreter, live compiling of GLSL shaders and editing/execute Bash scripts (macOS & linux) capabilities.

Mosaic is extendable : you can easily add custom objects. While this involves writing and compiling code, requiring some C++ knowledge, we aim to make this process as easy as possible. Thus, Mosaic is flexible and devoted to grow over time. For example, any Openframeworks project can be easily ported to Mosaic Objects, exposing them to the live-patching environment. This way, working with OF becomes way more modular, and you can make run-time adjustments. Possibilities are endless. Once created, plugins can either be statically compiled into Mosaic, or if you wish, there's also support for dynamically loading them, making it easy to share and distribute your objects with others.

KEYWORDS

Mosaic, ofxVisualProgramming, openframeworks, linux, macOS, windows, creative-coding, live-coding, physical, visual, scripting, transmedia, programming, visual-programming

DEPENDENCIES

ofxAudioFile

ofxBTrack -- Fork

ofxChromaKeyShader -- Fork

ofxCv

ofxEasing

ofxFFmpegRecorder -- Fork

ofxFft

ofxJSON

ofxImGui -- Fork

ofxInfiniteCanvas -- Fork

ofxLua

ofxMidi

ofxMtlMapping2D -- Fork

ofxNDI -- Fork

ofxPd

ofxPDSP -- Fork

ofxSyphon -- Fork

ofxTimeline -- Fork

ofxVisualProgramming

ofxWarp -- Fork

Some addons are forks of the original, due to some mods, compatibility with OF0.11 and the intention of cross-platform compiling (osx,linux,win)

SPECIFICATIONS

  • FLOSS, Free/Libre and Open Source Software
  • cross-platform (Linux, macOS, Windows)
  • plugin injection capable, see ofxMosaicPlugin
  • multi-threaded
  • ImGui based GUI interface
  • included automatic window video exporter with subtitler for easy tutorial creation
  • non-blocking system dialogs
  • internal code editor
  • lua/glsl/bash live-coding
  • pure data live-patching
  • non-linear interactive timeline
  • good selection of audio synthesis modules
  • warping integrated on output window object
  • mapmap style projection mapping module

OFXADDONS

Clone all the required addons listed:

cd <your_openframeworks_release_folder>/addons

git clone https://github.com/npisanti/ofxAudioFile
git clone https://github.com/d3cod3/ofxBTrack
git clone https://github.com/d3cod3/ofxChromaKeyShader
git clone https://github.com/kylemcdonald/ofxCv
git clone https://github.com/arturoc/ofxEasing
git clone https://github.com/d3cod3/ofxFFmpegRecorder
git clone https://github.com/kylemcdonald/ofxFft
git clone https://github.com/jeffcrouse/ofxJSON
git clone https://github.com/d3cod3/ofxImGui
git clone https://github.com/d3cod3/ofxInfiniteCanvas
git clone https://github.com/danomatika/ofxLua
git clone https://github.com/danomatika/ofxMidi
git clone https://github.com/d3cod3/ofxMtlMapping2D
git clone https://github.com/d3cod3/ofxNDI
git clone https://github.com/danomatika/ofxPd
git clone https://github.com/d3cod3/ofxPDSP
git clone https://github.com/d3cod3/ofxSyphon
git clone https://github.com/d3cod3/ofxTimeline
git clone https://github.com/d3cod3/ofxVisualProgramming
git clone https://github.com/d3cod3/ofxWarp

Some addons use specific branches and remotes (usually in order to provide easy multiplatform support). Specially if you have already worked with OpenFrameworks, your current addons folder might be incompatible with Mosaic. To verify compatibility, it can be useful to cd path/to/mosaic && cd scripts/ofxAddonTool && ./ofxAddonTool.sh to get an oversight of ofxAddons compatibility.

Then clone Mosaic project as an openFrameworks example:

cd <your_openframeworks_release_folder>/apps/myApps

git clone --recursive https://github.com/d3cod3/Mosaic

Now you're ready to compile Mosaic! Load the .qbs project in QTCreator and compile it. Or just enter in Mosaic folder and run a make Release.

CONTRIBUTING

Contributing to the project adding new objects is relatively easy, as ofxVisualProgramming is at the core of Mosaic software, it has been implemented a plugin mechanism based on Pugg, in order to facilitate the extension and the creation of new objects/nodes to add at the ofxVisualProgramming/Mosaic default objects/nodes library. (see objects/nodes list below)

You can find the repo of the plugin template here: ofxMosaicPlugin, with some generic objects templates and more detailed info in the readme.

If you're curious, please try out Mosaic and don't hesitate to get in touch. Mosaic is open to anybody, contributions of any kind are welcome.

SCREENSHOTS

Mosaic 0.6.4_beta

Mosaic 0.4.3_beta

Mosaic 0.4.0_beta

Mosaic pre_0.2.0

Mosaic pre_0.2.0

Mosaic 0.1.7

Mosaic 0.1.7

Mosaic pre_0.1.7

Mosaic pre_0.1.6

Mosaic pre_alpha_0.1.0

Mosaic pre_alpha_0.1.0

Mosaic on linux

Mosaic on windows

LICENSE

license

All contributions are made under the MIT License. See LICENSE.

CREDITS

Mosaic is a FLOSS, Free/Libre and Open Source Software.

Mosaic is almost completely based on ofxVisualProgramming ofxaddon, if you like this software and are giving it a star, please consider giving another one at ofxVisualProgramming repo.

The Mosaic team is composed by Emanuele Mazza , Daan de Lange and Maria José Martínez de Pisón.

Mosaic uses ImGui, kiss_fft, libsamplerate, dr_libs, hap, snappy, ffmpeg and code from openframeworks and all the included

项目侧边栏1项目侧边栏2
推荐项目
Project Cover

豆包MarsCode

豆包 MarsCode 是一款革命性的编程助手,通过AI技术提供代码补全、单测生成、代码解释和智能问答等功能,支持100+编程语言,与主流编辑器无缝集成,显著提升开发效率和代码质量。

Project Cover

AI写歌

Suno AI是一个革命性的AI音乐创作平台,能在短短30秒内帮助用户创作出一首完整的歌曲。无论是寻找创作灵感还是需要快速制作音乐,Suno AI都是音乐爱好者和专业人士的理想选择。

Project Cover

白日梦AI

白日梦AI提供专注于AI视频生成的多样化功能,包括文生视频、动态画面和形象生成等,帮助用户快速上手,创造专业级内容。

Project Cover

Kimi

Kimi AI助手提供多语言对话支持,能够阅读和理解用户上传的文件内容,解析网页信息,并结合搜索结果为用户提供详尽的答案。无论是日常咨询还是专业问题,Kimi都能以友好、专业的方式提供帮助。

Project Cover

有言AI

有言平台提供一站式AIGC视频创作解决方案,通过智能技术简化视频制作流程。无论是企业宣传还是个人分享,有言都能帮助用户快速、轻松地制作出专业级别的视频内容。

Project Cover

讯飞绘镜

讯飞绘镜是一个支持从创意到完整视频创作的智能平台,用户可以快速生成视频素材并创作独特的音乐视频和故事。平台提供多样化的主题和精选作品,帮助用户探索创意灵感。

Project Cover

讯飞文书

讯飞文书依托讯飞星火大模型,为文书写作者提供从素材筹备到稿件撰写及审稿的全程支持。通过录音智记和以稿写稿等功能,满足事务性工作的高频需求,帮助撰稿人节省精力,提高效率,优化工作与生活。

Project Cover

阿里绘蛙

绘蛙是阿里巴巴集团推出的革命性AI电商营销平台。利用尖端人工智能技术,为商家提供一键生成商品图和营销文案的服务,显著提升内容创作效率和营销效果。适用于淘宝、天猫等电商平台,让商品第一时间被种草。

Project Cover

AIWritePaper论文写作

AIWritePaper论文写作是一站式AI论文写作辅助工具,简化了选题、文献检索至论文撰写的整个过程。通过简单设定,平台可快速生成高质量论文大纲和全文,配合图表、参考文献等一应俱全,同时提供开题报告和答辩PPT等增值服务,保障数据安全,有效提升写作效率和论文质量。

投诉举报邮箱: service@vectorlightyear.com
@2024 懂AI·鲁ICP备2024100362号-6·鲁公网安备37021002001498号