Lightingale Documentation

Welcome to the documentation hub of the Lightingale Community. See the sidebar for the list of documentations available.

To see a list of active projects not included here, feel free to visit the project website for the whole list, or GitHub pages host for projects hosted on GitHub.

Site powered by mdBook.

Clearnet CDNs are generously provided by Cloudflare, GCoreLabs, CloudFront, CacheFly and Fastly free of charge.

Services

For shorter descriptions, see Lightingale Services List.

• Lavender: Reddit-like Fediverse instance for the MLP fandom and LTGC.
• Liquestria: Invite-only semi-anarchy Minecraft survival multiplayer on mixnet.
• Matrix services: Managed Matrix bridges and more.

Projects

POSIX Shell

• Gel: ⛏ Rolling server bases, batteries included.
• Hyacinth: 💨 Build web projects with speed.
• Iceflakes: ❄️ Offline Linux installer images for everyone.
• Nightglow: 🌙 Yet another Cloudflare WARP client wrapper.
• shx: 📜 Bash/PDKSH shell action executor.
• Stratus: ☕️ JavaScript runtime containers (Deno, Bun, Node.js).

Data sheets

• midi-db: 🎹 Data concerning MIDI standards.
• Raven: 💨 Lightning-fast intuitive typing.
• SynPix: 👾 The open pixel font for embedded LCDs.

Rust

• Ensemble: 🎶 A synth framework in Rust.

Go

• Floaty: ☁️ Prevent Caddy loopbacks... Without traceability.

Java

• Mogician:
• Seperatist: 🔨 Seperated... As they should be.

Kotlin

JavaScript

• Berry: 🍇 Simple port exposure tunnel for stream entropy manipulation.
• Bread: 📦 Unified framework to stream binary in blocks.
• Crystal Quartz: 🎨 A colour palette generation system.
• Ditzy: 📬 Reconstruct stateful sockets over stateless messages.
• Eclipsed: 🔊 The Royal Canterlot Voice for SSE/EventSource.

• Ink Stone: 🖼 Modify font files with ease.
• Inkwell: 📒 The grand central terminal / Le grand terminal central.
• Leaflet: ⚠️ Stock Caddy error pages, free for anyone to use if kept credits.
• Lightfelt: 🕸 A collection of JS snippets for the Web and Deno.
• Mint: 🌱 Easy-to-configure load balancing serverless functions.
• Minuette: ⏳ Intercept, inspect, orchestrate.
• Octavia: 🎻 Event-driven multi-standard MIDI state-tracking library.
• Painted Palette: 🎨 Painting palettes, one pixel at a time.
• Parchment: 📃 Mark-down based client-side page generator.
• Rochelle: 🔪 Stream chunk splitting.
• Rosegap: 🌹🌙 Pleasant ads without compromises.
• Scope: 🔭 Easy-to-setup WireGuard meshing.
• Silk: 🕸 Bringing the fandom together.
• Snowy: ❄️ The BroadcastChannel polyfill for Firefox 29+ and Chrome 5+.
• Track me, senpai!: 🍑 Just giving thanks to your visitor sharing their everything with you.
• Twinkle Sprinkle: 📜 Task wait signals and simple WAL.
• WingBlade: ☁️ One codebase, multiple runtimes.

Privacy policy

As of 6th Oct 2023, these terms are not yet in effect.

By using services provided by the Lightingale Community, you agree to the following terms.

Default

Unless stated explicitly otherwise, the following policy will be applied to any web-based service run by the Lightingale Community.

TL;DR, we have access to all of the data the client implementation chooses to share with us, but unless an error is caused or you explicitly want us to, none of the data would be stored.

Accessible

Below is the list of data accessible by us if provided, on the server-side without user interaction.

• When accessing via clearnet, the IP address of your exit.
• When accessing via clearnet, IP packet fingerprints. (e.g. TCP fingerprint, UDP fingerprint)
• TLS connection fingerprint, when connected via TLS.
• Standardized client-identifying headers, if provided. Visit MDN for more information. Below is a list of possible headers, and may not include all headers.
  • Accept: Which types of content is accepted by the client.
  • Accept-Encoding: Encoding schemes accepted by the client, usually compression algorithms.
  • Accept-Language: Languages expected by the client.
  • Authorization: Tokens proving client's identification.
  • Origin: The URL of request's origin.
  • Referer: The initiator URL of each request.
  • Sec-Fetch-Dest: The initiator type of each request.
  • Sec-Fetch-Mode: Mode applied on requests.
  • Sec-Fetch-Site: Relationship between requested resource and source.
  • User-Agent: Implementation identification string provided by the client.
  • X-Forwarded-For, X-Real-IP: If behind a reverse proxy, the connecting IP address observed by the reverse proxy. These headers are almost always stripped, spoofed or generalized on reverse proxies we have control of however.
• Client hints, sent by Chromium-based browsers (e.g. Google Chrome). Below is a list of headers sent unconditionally by Chromium-based browsers. To prevent us from receiving these headers, please switch to a browser that isn't based on Chromium.
  • Sec-CH-UA: Array of implementation identification strings provided by the client.
  • Sec-CH-UA-Mobile: If the client runs on mobile platforms (e.g. Android, iOS).
  • Sec-CH-UA-Platform: The platform running the client, usually OS families.
• All other headers clients choose to provide.
• When the service involves server-side dynamically-generated content, basic cookies allowing said service to function properly.

We also have access to data you explicitly choose to share with us. They may be in cleartext or in their encrypted form.

Use

General

• Data explicitly stored by users will likely persist until takedowns.
• During suspected infiltrations, we will use any information accessible to identify and exterminate unauthorized access. Data stored during this period will be removed as soon as related investigations are finished.
• We do not share any information with any third-parties.
• Data requests from individuals and law enforcement agencies will be assessed before any action is taken. See the data request section for details.

Low-importance

Unless overriden, these uses do not store data.

• To deny access from clients we deem as unfit of service (WAF), we will use Origin, Referer, Sec-CH-UA, Sec-Fetch-Site, User-Agent, observed client IP address (if on clearnet/behind reverse proxies), IP packet fingerprints (if on clearnet) and TLS fingerprint.
• To conserve bandwidth whenever we can, we will use Accept-Encoding.
• To serve content to client's expectation, we will use Accept.
• To distinguish between sessions if essential to the service client accesses, Authorization and/or basic cookies will be used.
• To serve localized content in client's desired languages, we may use Accept-Language.

Medium-importance

Data stored from these uses will be kept for at most 7 days.

• Requests will be logged without observed IP addresses only upon causing non-critical software errors.

High-importance

Data stored from these uses will be kept for at most 365 days.

• Requests will be logged with observed IP addresses only upon causing critical software errors, or attempting to utilize known exploits.

Data access/removal request

• Approved data requests will be fulfilled within 30 days since approval, in the form that's available to us. Encrypted data will be provided as-is, along with their respective decryption keys only if available.
• Individuals can file requests for their data, and will be approved upon proving ownership.
  • In most cases, individuals have power to remove data on their own.
• Law enforcement agencies can file requests for data. All data requests filed from law enforcement agencies will be made public.
  • Requests sent from law enforcement agencies will only be approved if all listed criteria are satisfied.
    • Belongs to a political body deemed as "full democracy" or "flawed democracy" by The Economist Democracy Index.
    • Provides sufficient information for proving their identity.
    • Belongs to the political body where related services are hosted, or can provide proof that affected users violated our acceptable usage policy.
  • Affected resources of fulfilled removal requests from law enforcement agencies will be marked as 451 Resource Aflame, along with the name of requested agency.
• If the service's ability to continue operation becomes next-to-impossible due to a failed compliance from a rejected data request, we will wipe all data stored on our behalf and cease operation on said service. The same goes for the Lightingale Community itself.

Infrastructure providers

We extensively rely on Cloudflare for our infrastructure on the clearnet. If you do not want to go through Cloudflare, feel free to access our services through alternative means. Otherwise, a copy of privacy policy from Cloudflare could be obtained.

To improve availability and/or decrease cost on some of our services, we may also use other infrastructure providers. Check their respective privacy policies for details. Below is a list of providers we rely on.

• AWS CloudFront, for CDN.
  • Anonymized/generalized data generated by AWS CloudFront are stored for 30 days by the provider.
• AWS Lambda, for serverless computing.
  • Anonymized/generalized data generated by AWS Lambda are stored for 30 days by the provider.
• CacheFly, for CDN.
  • Data generated by CacheFly are never stored.
• Cloudflare, for DNS, CDN, WAF and edge serverless computing.
  • Identifying data generated by Cloudflare are stored for 24 hours by the provider.
  • Anonymized/generalized data generated by Cloudflare are stored for 30 days by the provider.
• Deno Deploy, for edge serverless computing.
  • Anonymized/generalized data generated by Deno Deploy are stored for 30 days by the provider.
• Fastly, for CDN and edge serverless computing.
  • Data generated by Fastly are never stored.
• GCoreLabs, for CDN.
  • Anonymized/generalized data generated by GCoreLabs are stored for 30 days by the provider.

Access denial

VPN

If you're accessing any Lightingale service from a VPN, chances are you're already blocked by us, but will get unblocked if with mixnets like Tor, or encrypted proxies. This is intentional.

We strongly support privacy and anonimity, while also highly detest the idea of fattening any commercial VPN vendor. VPNs do not offer privacy or security on the Internet in any way, let alone either anonimity or anti-censorship, and in no way any of them contribute to the effort of developing either anti-censorship or concealing technology to truly liberate the masses. As such, we've long since decided to take direct action, actively identifying and fingerprinting VPNs, while advising people to switch to real solutions instead.

Client

We identify some client programs as high-risk, and block requests from those programs if identified.

FAQ

I'm using a VPN, what should I do?

To put it simply, please stop using a VPN to access us.

If you're familiar with accessing services hosted on mixnets, you can access our services via alternative means. Or if you don't want to go through the hassle, please disconnect from your VPN, and if you have access to either exit/outproxy-enabled mixnet (e.g. Tor, I2P (I2Pd is recommended if you are comfortable with command line), Lokinet) or encrypted proxies, use them instead.

What if I'm blocked wrongly?

Within 18 hours, please contact us and provide your Cloudflare Ray ID in your unblocking appeal. After we've verified that you did indeed not connect from a VPN, you'll be unblocked as soon as possible. However, if you used a client program we deem as high-risk, we will reject your appeal immediately.

Could you stop blocking VPNs?

No.

Acceptable Usage Policy

These terms do not yet have legal liabilities, however they are enforced.

Underlined terms should have definitions available in the Definitions section.

Definitions

• Child pornography: Depictions of underage humans or underage characters resembling humans.
• Underage: Below 18 years old.

Disallowed use

AUP does not cover cases where reasons of policy enforcements are explained.

• Reselling any of our public services, which is free-of-charge for all.
• Breaching the awareness scope defined by projects/services.
• Scanning us or to scan others (e.g. port scanning).
• Gaining unauthorized resource access.
• Degrading the performance of our servers (e.g. flooding).
• Violating others privacy (e.g. doxxing).
• Impersonating existing identities without stating satire status.
• Exploiting stolen identities.
• Distributing unsolicited data (e.g. spam).
• Scamming.
• Hate speech (e.g. racism, xenophobia).
• Promotion of self-harm (e.g. suicide).
• Harming others physically or psychologicaly (e.g. torture threats, death threats, harassement).
• Engaging in distribution of illegal substances, human organs, guns and etc.
• Promoting, encouraging and/or beautifying any of the following topics.
  • Crimes against humanity (e.g. massacre).
  • Terrorism, its practices and exercising organizations.
• Distributing content matching any of the following criteria, without explicit warning to the target audience.
  • Malware.
  • Phishing content.
  • Pornography.
• Distributing and storing content matching any of the following criteria.
  • Child pornography.
  • Pornography without consent of involved parties.
• Defaming us without any validated proof.

Terms of Service

This agreement will become legally binding once Lightingale Community becomes a legally-registered non-profit organization.

As of 6th Oct 2023, these terms are not yet in effect.

In this agreement...

• The term "you" or "your" refer to "the user".
• The term "we", "us" or "our" refer to Lightingale Community itself and its members.
• The term "service" or "services" refer to publicly-available listed services hosted on behalf of Lightingale Community. The list is available here.

By accessing content or using the services provided by the Lightingale Community, you agree to the following terms. Specific services will apply amendments to fit their specific needs.

Any material changes to these terms will be publicly notified via our Mastodon and our Telegram channel at least 7 days prior. If you wish to exercise your right to reject such changes, you can file complaints to us, or stop using the service altogether.

Disclaimer

• We reserve the right to modify the service, including but not limited to changing certain features and updating the related software.

• We reserve the right to terminate your access to some or all of our services.

• We may deny access to certain services based on the geographic location of your immediate connection.

• We will attempt to prevent disruptions, defects and losses of data in our offered services, but despite our best efforts, we do not and can not guarantee availability of all times, and we are not responsible for materials served by us. Our service comes with absolutely no warranty, to the extent permitted by applicable law. You are solely responsible for your use of service.

The service

This section is defined in different services we offer to the public.

Software

Lightingale Community is powered fully by and produces FOSS, fit under the definition set by the Free Software Foundation. Further acknowledgements may be made in README files when we use software projects that require them.

Our content

Except for software, unless stated otherwise explicitly, content belongs to us is licensed under CC BY-NC-SA 4.0 License. Our members hold the rights of content they produced.

Your content

This section applies to services offering UGC.

You hold the rights to your own content, but you give us a license when submitting your content to us. Upon submission, you permit us to do the following to your submitted content. These terms are world-wide, non-exclusive, royalty-free, transferrable and perpetual.

• To store and display your content, you permit us to use, copy, store, distribute your content in ways consistent with your use of the services.
• To adapt your content for use of different platforms by different users with various backgrounds, you permit us to monitor, modify, translate and reformat your content.
• For public availability, you permit us to publish, publicly perform, or publicly display your content, if you've chosen to make it visible to others.
• To allow our services to work as intended, you permit us to sublicense your content.

We reserve the right to block, remove or wipe your content if in breach with these terms or other terms in effect.

Acceptable usage

As a user of services offered by us, you agree to adhere to our acceptable usage policy. Violations of AUP will result in a termination, and may result in your data made available to law enforcement agencies.

We encourage you to report abuses of our services with proof. We accept reports made via email at abuse (at) ltgc (dot) cc.

Donation

This section is subject to changes as our legal status changes.

We are not responsible for fulfilling any additional requirement attached to the donations made to us.

Applicable law

This section is subject to change as our legal status changes.

Legal contact

This section is subject to change as our legal status changes.

Legal contacts may be filed via email to legal (at) ltgc (dot) cc. We do not have a physical location available.

UGC Availability

To prevent Lightingale Community from getting blocked as a whole in certain countries, we've been forced to restrict or deny direct access from those countries. A restricted service coverage would've been marginally better than nothing at all.

We offer two levels of UGC services: high-liberty and restricted. Levels are separated by the measures avalable to the users, and users' ability to freely express whatever they desire. Some countries may have been denied direct access from high-liberty UGC services, but not restricted ones.

If you've been redirected to this page, it's likely that you have been denied direct access to our UGC service, and we have no other choice but to offer our deepest apology.

List of countries affected

Denied from high-liberty and restricted UGC services

• AE: United Arab Emirates
• AF: Afghanistan
• AZ: Azerbaijan
• BD: Bangladesh
• BH: Bahrain
• BT: Bhutan
• BY: Belarus
• CN: China
• CU: Cuba
• DJ: Djibouti
• DZ: Algeria
• EG: Egypt
• ER: Eritrea
• ET: Ethiopia
• GT: Guatemala
• HN: Honduras
• KH: Cambodia
• KZ: Kazakhstan
• IL: Israel
• IN: India
• IQ: Iraq
• IR: Iran
• LA: Laos
• LB: Lebanon
• LY: Libya
• MM: Myanmar
• NI: Nicaragua
• NK (KP): North Korea
• OM: Oman
• PK: Pakistan
• PS: Palestine
• RU: Russia
• RW: Rwanda
• SA: Saudi Arabia
• SD: Sudan
• SL: Sri Lanka
• SO: Somalia
• SY: Syria
• TJ: Tajikstan
• TM: Turkmenistan
• TR: Turkey
• UZ: Uzbekistan
• VE: Venezuela
• VN: Vietnam
• YE: Yemen

Denied from high-liberty UGC services

• BO: Bolivia
• CD: Democratic Republic of Congo
• CM: Cameroon
• GQ: Equatorial Guinea
• HK: Hong Kong
• KG: Kyrgyzstan
• JO: Jordan
• KW: Kuwait
• LS: Lesotho
• MA: Morocco
• MX: Mexico
• PE: Peru
• PH: Philippines
• SG: Singapore
• SS: South Sudan
• SV: El Salvador
• UG: Uganda

Technologies

Preferred technologies

Languages and runtimes

• Deno
• Go
• Rust

Networking

• CoreDNS
• I2Pd
• IPFS
• Lokinet
• Tor
• WireGuard
• Yggdrasil

Operating systems

• AlmaLinux
• Alpine Linux
• Debian
• openSUSE
• Rocky Linux

Virtualization and containerization

• KVM
• LXC
• Podman

Miscellaneous

• Caddy
• FabricMC
• Nixpkgs
• Syncthing

Used technologies

Technologies listed here have some of our projects using them. None of the technologies listed below are a preference, although project can freely choose to use them.

Languages and runtimes

• Java
  • OpenJDK
  • Microsoft OpenJDK

Virtualization and containerization

• Docker

Miscellaneous

• PostgreSQL

Avoided technologies

Technologies listed here will have their usage be discouraged and avoided. However, projects can still develop for them only if necessary. Software already developed with these technologies can also be deployed.

Languages and runtimes

• Node.js
• PHP
• Python
• TypeScript

Operating systems

• Ubuntu

Miscellaneous

• Snap

Banned technologies

Usage of technologies listed here are entirely banned within LTGC. Bans do not extend to members themselves.

Frameworks

• ASP.NET
• JSP

Miscellaneous

• LXD

Content encoding

None of the encodings listed are involved with patent concerns.

Read below for further details.

Rasterized image encoding

Lossy still

As WebP is properly supported in every browser built for systems newer than Windows XP, and it offers better quality-to-size ratio than all JPEG encoders, it is considered the best fallback format. However, as JPEG XL exists as an all-around better universal image format, lossy images should also be encoded with JPEG XL whenever possible.

Compared to all other image formats, JPEG XL offers jawdropping image fidelity, unmatched quality-to-size ratio, proper progressive loading and better responsiveness. The cherry on top of JPEG XL would be its ability to losslessly transcode from existing JPEG files, offering about 20% size reduction with cheap JPEG lossless bitstream reconstruction, which paves its way to be a backwards-compatible drop-in replacement for image storage and distribution.

Things to take notice of:

• mozJPEG-fronted JPEG, while offering a good choice for backwards-compatibility, shouldn't be used unless necessary when size is a consideration.
• AVIF offers an advantage on size, when progressive support, boundary artifacts and codec performance (slower than all others multiple times) aren't in consideration.
• AVIF is observed to have fewer observable artifacts for images with a simpler shading.
• The reference AVIF settings provide a balancing point between JXL -d 1 and JXL -d 2.

The full feature set comparison chart is available on Cloudinary.

Lossless still

JPEG XL lossless and WebP lossless are mostly on par, either could be the better solution at times. For compatibility reasons, WebP lossless should always be offered, while JPEG XL lossless could be offered only when the resulting file is smaller than that of WebP lossless. AVIF lossless is currently consistently worse than either JPEG XL or WebP, as such it's not recommended at all.

Do not enable progressive encoding for JPEG XL lossless, or the resulting file will be several times bigger than PNG files.

Lossy animated

Lossy animated WebP is the current baseline for animated image sequences, while lossy animated AVIF offers the best quality against others by a wide margin. Lossy animated JPEG XL doesn't offer a significant advantage against WebP, and is currently beaten by AVIF.

Audio encoding

Lossy

When high sampling rates are required, choose Vorbis. When support for the Apple ecosystem is required, choose AAC-LC. Otherwise use Opus under all possible scenarios, but beware that Opus only supports sampling at 48kHz.

Below are the suggested bitrates under different scenarios, when encoding stereo audio content under either 44.1kHz or 48kHz. Audio content should be encoded with constrained variable bitrate (CVBR).

The AAC-LC encoder in question is libfdk_aac, being the best FOSS AAC-LC encoder out there. The only AAC-LC encoder better than libfdk_aac is Apple's Audio Toolbox, which is proprietary and not in consideration.

Keep in mind that the scenario under "basic" indicates that, all audio content encoded with provided parameters should be virtually indistinguishable from LAME-encoded MP3 files at 192kbps.

Lossless

Streaming lossless audio is generally considered a bad idea due to high bandwidth usage. It's generally more useful for archival purposes.

You should choose FLAC when...

• Browser support is needed.
• The target is severely underpowered.
• The target only supports FLAC for lossless audio compression.

You should choose WavPack when...

• You need a smaller file.
• Higher bit depth is needed (more than 24).

Compression

Web

Brotli should be preferred over gzip at all times. Static low-entropy content (e.g. plain text files) should always be pre-compressed, with or without the original uncompressed file available. For dynamic content compression, zstd at level 8 consumes less than half of the resources used for Brotli, all the while outperforming Brotli on the output size.

For static precompression, the original file can be omitted when the space is constrained, serving only precompressed blobs. When compatibility with other infrastructure isn't in consideration, precompressed gzip files can also be omitted, although it's not recommended in most cases. Zstd isn't suitable for static precompression, as even at compression level 22 it falls behind Brotli at its highest compression level. However, a recommendation is still available for reasonable reference.

Bundle

lzip is the de-facto standard of bundle compression, featuring good compression ratio with data recovery abilities. Quality should always set to 9, unless a lower quality value is proven to yield a better result for smaller files, or time constraints are set.

bzip2 or xz should only be considered for compatibility purposes.

Font

As practically all modern browsers support the WOFF2 font format, all required TrueType and OpenType fonts must be served as WOFF2 files instead. If for unspecified reasons that original files must be served, always consider precompression and avoid storing uncompressed files.

Region and DC codes

Datacentre codes

Versioning

Semantic versioning

Visit semver.org for more information.

Decaday versioning

Inspired by Minecraft's snapshot versioning appraoch, decaday versioning is used for projects releasing snapshots, where the versioning follows the YYYYdDDx, where YYYY denotes the full year, d can either be d or m in different projects (due to historical mistakes...), DD denotes the decaday of the year, and x denotes the ever-increasing alphabetical index of snapshot versions.

"Decaday" is a way of dividing months to three roughly equal portions, where it usually tries to group 10 days as a "decaday". In a typical month, the 1st to the 10th day belongs to the first decaday, the 11th to the 20th belongs to the second, and the 21st to the 30th belongs to the third. If a month has 31 days, the 31st day belongs to the third decaday. This approach avoids the problem of different choices in a week's starting point.

Take 2023d30b as an example. 2023 means the snapshot was released in 2023, 30 means the snapshot was released between 21st October and 31st October, and b indicates the version was released as the second snapshot between the time period.

Project origins

What led to LTGC projects?

• Thestral: "Is oblivious user authentication possible?"
• Nightglow: "Ugh the official Cloudflare WARP client is so crappy and I don't need that much functionality anyways!"
• Scope: "No existing meshed WireGuard orchestration fits our needs!"
• Octavia: "Can I make a better MIDI visualizer?"
• shx: "I hate Node.js but I need something like npx."
• SynPix: "Emulated screens bundled in Octavia need a libre bitmap font."
• MIDI DB: "Why isn't there readily-available multi-standard MIDI data sheet?"
• Hyacinth: "JS projects should be built faster!"
• Painted Palette: "What if I made a better headless bot?"
• WingBlade: "Can I make the same codebase run everywhere?"
• (unnamed): "Let's build a clean, lightweight and ad-free boardgame experience!"
• Linen: "Wanna run an r/place replica of our own?"
• Cubics: "Want a convenient diagram generator for Rubik's cube-like puzzles..."
• Raven: "I don't want to relearn a keyboard layout to type in another writing system."
• (unnamed): "Wanna optimize Minecraft?"
• Rosegap: "Daily Dose of Pony needs an ad system."
• Ink Stone: "Will SynPix ever be released as font files?"

Where did names of projects come from?

Project inspiration hiearchy

• Project Moonlight (Media)
  • Heartstrings
  • Octavia
    • Cambiare
    • Ensemble
    • Hyacinth
      • shx
    • MIDI DB
    • Snowy
    • Swiftbook
    • SynPix
      • Ink Stone
• Project Lilac (Translation, localization and linguistics)
  • Noitieng
  • Raven
• Project Weaving (Networking and isolation)
  • Floaty
  • Nightglow
  • Patchwork
  • Scope
• Uncategorized
  • Acari
  • Berry
    • Bread
  • Citrus
  • Crystal Quartz
  • Daily Scoop
  • Ditzy
  • Domain DB
  • Flex
  • Flitter
  • Graceful Lattice
  • Inkwell
  • Leaflet
  • LiteBlock
  • Mint
    • Flame
  • Minuette
  • Painted Palette
    • WingBlade
      • Eclipsed
      • Rochelle
      • Stratus
      • Twinkle Sprinkles
  • Patchwork
  • PonyTrails
    • Gel
      • Iceflakes
  • Rosegap
  • Seperatist
  • Silk
  • Thestral

Lavender

Lavender is a friendly discussion lounge for both the My Little Pony fandom and LTGC, powered by the magic of Lemmy. No matter what you are, be a pony, dragon, hippogriff or draconnequus, you're welcome here!

Lavender adheres to the general Terms of Service and Acceptable Usage Policy.

The incubator thread can be viewed here.

Access

Addresses

The service can be accessed from the addresses listed below.

• Clearnet (not recommended): lavender.ltgc.cc
• Tor: lavender...j33btaqd.onion
• I2P (I2Pd): lavender.ltgc.i2p or lavender...v6bg4rfa.b32.i2p
• Lokinet: mwt5jdqg...jpxctyeo.loki
• Yggdrasil: lav.ygg.ltgc.cc

Panels

Read Lavender panels.

Account registration

Alpha phase

Lavender is still in the alpha phase. During the alpha phase...

• Only people already having a presence on Fediverse can apply for account registration. You must fulfill any criteria listed below.
  • Have an account on one of the listed public instances for more than 14 days, with at least 7 posts in total.
  • Have an account on any public Fediverse instances for more than 14 days, with at least 7 posts in total, and the identity relates to the My Little Pony fandom.
  • Be a member of the Lightingale Community.

Moderation

Alpha phase

Lavender is still in the alpha phase. During the alpha phase...

• Only accounts on the instance itself can apply to become a moderator.
• Only with two or more

Lavender Panels

Lavender currently organizes the following panels.

Best of Fedi Pones

Artists new to the Fediverse often complain about not reaching enough audiences. So what's the solution? Well, with a weekly panel promoting pony artworks published on the Fediverse, of course!

Organized by a group of Fediverse enthusiasts from the My Little Pony fandom, Best of Fedi Pones seeks to bring what the Fediverse has to offer to everyone enjoying the creativity from the pony fandom. Better together!

Source code: Codeberg

Artwork submission

Submitting artworks will get them included in the issues of Best of Fedi Pones if not denied. All submitted artworks, unless violating AUP, will be also referenced by the MLP English Lavender community.

Submitting artworks

Best of Fedi Pones has been directly integrated into the Fediverse since issue 10. Submission only requires the inclusion of #weeklypony tag while also mentioning @[email protected]. Works both when posting yourself and replying to others.

Inclusion denial

Submissions will be denied if they match at least one of criteria listed below.

• Is not SFW.
• Is generated by neural networks. Inspired by or assisted with NN doesn't count.
• Not posted by the artist themself.
• Violates LTGC AUP.
• Was posted for longer than 14 days to the deadline of the target issue.

Voting and issuing

Voting of each submission is done in a room accessible to all panel organizers. While the room is bridged to Discord and Telegram, only votes from Matrix and Discord are counted due to technical limitations.

Each eligible voter can part one ⭐️(:star:) emoji to give a submission an upvote. Submissions with high vote count will be ordered first, and submissions sharing the same vote count have their exact order determined by the hash of the origin URL. No downvotes are available.

Voting of each issue generally begins at 12:00 UTC +0 on every Saturday, and ends at 18:00 UTC +0 on the next day. The dataset should be available shortly after the voting ends, and any organizer can release the issue with the dataset.

To prevent accusations of theft, except for the cover art, all submission images must be hotlinked from source. Cover art is generally selected among the submission with the top 60% vote count, entirely by the organizer posting the issue with their own preferences. However, it's advised to avoid featuring the same artist within the span of 9 issues, and artists new to the Fediverse are advised to be preferred.

IM services

Lightingale Community has been hosting messaging services like Matrix for ease of communication, ever since the community's early days in 2021.

Services

Matrix

We run a Synapse homeserver for hosting all of our bridges and for internal communication. Only members of the Lightingale Community can apply for accounts on the homeserver.

Mumble

Planned. Internal and mixnet access only, with no clearnet access planned.

XMPP

We run a Prosody server with native mixnet access, for easier interfacing with the federated XMPP ecosystem. It is not intended for primary use, and its service availability is generally worse than Matrix.

Bridges

As long as adhereing to the Acceptable Usage Policy, members on our homeserver can freely use any of the bridges we host. Certain bridges offer integration to mixnets and overlay networks, namely I2P, Tor and Yggdrasil.

However, please note that integrations with alternative DNS systems (e.g. OpenNIC, ALFIS) likely will not work.

Group chat bridges

The following bridges support both group chats and direct messages.

• Discord to Matrix (via mautrix-discord)
• IRC to Matrix (via Heisenbridge) (planned)
• Mumble to Matrix (via MandM-bridge) (planned)
• Telegram to Matrix (via mautrix-telegram)
• XMPP/Jabber to Matrix (via matrix-bifrost) (planned)

Direct message bridges

The following bridges only support direct messages.

• Facebook Messenger to Matrix (via mautrix-meta) (planned)
• Instagram to Matrix (via mautrix-meta) (planned)
• Twitter to Matrix (via mautrix-twitter)

Voice chat bridges

The following bridges only bridge voice chats.

• Mumble and Discord (via mumble-discord-bridge) (planned)

Media proxies

Active Discord media proxy

As Discord began requiring expiring HMAC validations on media attachments, the Discord bridge now switches to an active proxying approach, before reuploading/re-serving re-encoded optimized media attachments becomes viable. Files delivered via this new approach will be served at dma.ltgc.cc.

However due to poor design, the active Discord media proxy fails from time to time. We are working on a dedicated active media proxy written in either JS (Deno) or Go.

Passive Discord media proxy

Due to MSC3860 being unsupported on homeservers without conformation of the Matrix 1.7 specification, homeservers will not recognize discord-media.mau.dev, the public redirecting Discord media repo. To circumvent this, we offer a custom cached Discord media proxy at dmr.ltgc.cc instead for use with bridges, however it will likely be shut down to public access if we notice it getting abused.

After Discord implemented expirations on media attachment links with HMAC validation, the media proxy now only serves non-attachment files, like avatars, stickers and custom emojis. Since passive media proxy is less costly to run than active media proxies, it's used whenever possible.

Bridge utilisation

Apply for use

Apart from internal use, we also offer bridging services to other entities upon approval with no SLA.

FLOSS projects

• RethinkDNS (Apache 2.0, MPL 2.0)
• Xray (MPL)

MLP fandom communities

Not-for-profit entities

• Uncyclopedia (Traditional Chinese)

Known issues

Global

• Animated stickers on certain platforms may only get their first frame be bridged, due to varying media codec support on different platforms.
• Double-bridged replies may not work on certain platforms.
• The bridge may become unresponsive when overloaded. You can help us relieve this problem via donations!

Telegram

• Reactions aren't bridged from Telegram.
• The bridge suffers from unresponsiveness or even downtimes due to PostgreSQL. Migration to SQLite3 is currently scheduled.
• Bot messages from Telegram cannot be bridged to other platforms, per Telegram's restriction.
• Senders from other platforms cannot be transparently bridged to Telegram, requiring embedding their display names as message content.
• Member leave events aren't bridged to Matrix, as such the Telegram member list on Matrix is not representative.

Discord

• Due to Discord validating time-sensitive HMAC codes on attachment URLs, media from Discord cannot be bridged currently.
  • This was fixed on 27th March 2024, where a combination of active and passive media proxying was deployed.
• Some of the animated stickers were vector images encoded in custom-defined JSON files. As a result, none of the services other than Discord recognizes them.
• The Discord bridge invites bridged accounts to rooms on-demand, and does not bridge member leave events to Matrix, as such the Discord member list on Matrix is not representative.

Ditzy

Ditzy is a transport-agnostic universal multi-message encoding scheme, allowing stateful bidirectional communications regardless of the statefulness of the underlying transport. With the state of the reconstructed tunnel fully decoupled from the underlying transport, possibilities are endless. How Ditzy performs is entirely dependent on implementation.

This project is inspired by Tor HTTP Meek, MIDI 1.0 and QUIC.

💌 Feel your messages delivered safely by your trustworthy Ponyvillan mailmare!

The first draft was written on 18th Nov 2021, with the next iteration on 5th Feb 2023. The current draft is written on 29th June 2023.

Advantages

• State of tunneled connections are decoupled from their underlying transports
• Seamless connection migration on connection losses and IP changes
• Total control over frame transmission

Use cases

• Bidirectional communication through incapable infrastructure (e.g. CDNs, request reflectors)
• Stablizing communication over unstable networks
• Replacing QUIC where UDP communication is not feasible
• Connection multiplexing
• Connection splitting

Specifications

• Binary encoding format
• Recommended implementation practices

Reference implementation API docs

JavaScript

Binary encoding format

Concepts

Meek

Originally, Meek is a technique emulating stateful connections over HTTP, utilized by Tor for its pluggable transports. It is now generalized to refer to any technique reconstructing stateful connections, regardless of the statefulness of underlying transport.

MIDI

MIDI is a standard for real-time communication between devices. It's originally designed for musical instruments, but has found its places in other fields requiring synchronization and/or automation as well, such as stage lighting systems.

Variable Length Value

Variable Length Value (VLV) is a way of encoding integer values to multiple bytes, utilizing as many bits inside as they want. With VLV, integer values can be as large as they want.

VLV is defined as a part of Standard MIDI File (SMF) Format Specification.

A VLV can take multiple bytes, and all data encoded are stored in Big-Endian format. VLV bytes use the bit before actual values of each byte to indicate whether or not to continue decoding, and the rest to carry actual values.

Examples below.

QUIC

QUIC is a general-purpose transport running on top of UDP, seeking to be a replacement over traditional TCP. It offers various advantages over traditional TCP, with the most notable ones being seamless connection migration and reduced communication latency.

Specification

Structure

Each Ditzy message is formed by directly combining multiple frames together. The structure of each frame is as follows.

Socket ID

The socket ID is randomly selected between 0 and 268435455 (0xfffffff, 2²⁸ - 1).

Frame ID

The frame ID is iterated from 0 to 268435455 (0xfffffff, 2²⁸ - 1) on the side where connections are initiated. When 268435455 is reached, the message ID is expected to roll back to 0. Frame ID should only validated and increased when a message is fully sent.

Length, EoP + Checksum

When Ditzy is set to fast mode (should only be used in safe environments), the payload length value only points to where the EoP byte is located. The EoP byte in fast mode only serves as a confirmation for bounds checking, and thus both sides should only select a random byte that has the 7th bit set to 1 (128~255) to do the job. When the supposed length doesn't match, Ditzy will try to search for bytes exceeding 127 from the beginning, and truncate the message accordingly.

When Ditzy is set to strict mode, the payload length value is ignored, and Ditzy will attempt to validate the checksum once it finds the EoP byte. If the checksum does not match, Ditzy will discard the message completely.

The checksum is calculated by setting the initial value to 63, and performing XOR operations to every byte in the payload. Once this is finished, the calculated value is then inverted, have 1 added. The final value would the the first 7 bits of the value. Example JavaScript code below.

let ditzyChecksum = (bytes) => {
	let checksum = 63;
	for (let i = 0; i < bytes.length; i ++) {
		checksum ^= bytes[i];
	};
	return (~checksum + 1) & 127;
};

Commands

IDs between 0 (0x00) and 31 (0x1f) are reserved for core functionalities. Extenstions are free to utilize any ID between 32 (0x20) and 255 (0xff).

Different commands have different support levels. To meet a certain support level, features of the indicated level must be implemented.

0: Socket close

Can be initiated bidirectionally.

Response should be exactly the same as request.

Closes a connection. Payload can be used to carry optional arbitrary error messages.

1: Socket open

Can be initiated bidirectionally.

Response should have the same frame ID as request.

Opens a connection. Payload is used to define suggested Socket timeout in milliseconds optionally. Frame ID must be set to 0.

(Optional) If sent from the receiving end, the value contains would be the final timeout value used in the connection.

2: Socket aftertouch

Can be initiated bidirectionally.

Response should have the same frame ID as request. Frame ID has no effect otherwise.

Challenges a connection. Often used to implement Socket latency tests.

Payload sets challenge type.

Types

• 0: Latency test SYN1.
• 1: Latency test ACK1.
• 2: Latency test SYN2.
• 3: Latency test ACK2.

3: Jump

Can be initiated bidirectionally.

No responses are needed for jumps. Frame ID has no effect.

Sends a junk frame. The receiving end should ignore jump messages.

4: Full message send

Can be initiated bidirectionally.

Use type 5 (message acknowledge) to send acknowledgements with the same frame ID.

Sends a full message.

5: Message acknowledge

Can be initiated bidirectionally. Only required over unreliable channels.

Sends acknowledgements of messages. Additional acknowledgements of tail frame IDs are all encoded via VLV7.

6: Set client ID

Can only be sent from clients. No responses from the server whatsoever.

Sets a request of Ditzy message to a client ID. Client IDs are random 16-char Base64-like sequences that are never decoded. This must be the first message in every Ditzy request.

7: Implementation exclusive

Can be initiated bidirectionally.

Response should have the same frame ID as request. Frame ID has no effect otherwise.

Implementation exclusive binary commands.

8: Error

Can be initiated bidirectionally.

No response is needed for errors. Frame ID has no effect.

Sends arbitrary errors without closing the connection.

Recommended implementation practices

Ideas

Meek as a general terms, covers techniques reconstructing states of duplex sockets over underlying measures of communication. It doesn't have to be constrained to a single set of views. Under ideal circumstances, Meek can achieve full socket state decoupling with arbitrary socket delivery, however reaching those

Generic

Floaty

Floaty is a Caddy plugin implementing customizable rolling random IDs on a per-host basis, providing easy access via placeholders in Caddy.

Uses include:

• Loopback prevention
• Multi-hop debugging
• Forced time-based rolling sticky hash wherever needed

All with little to no traceability, if the rolling duration is set correctly.

Usage

Caddyfile

In the global section, set Floaty to run before request header processing.

{
	order floaty before header
}

In any of the server blocks, use the floaty directive to prepare the respective rolling random IDs. The syntax is as follows.

floaty [length [rollDuration]] [{
	[fieldId [length [rollDuration]]]
}]

Whenever Floaty is initialized, the placeholder http.floaty would become available within that server block, where placeholders from HTTP handlers are accessible.

Generated ID lengths can be any value between 4 and 96, and out-of-bound values will be clamped into this range. By default, length is set to 8. Longer IDs may cause excessive resource usage.

Roll duration can be set to any value above 10 seconds with millisecond precision, if supported by the Go duration syntax. It's set to 15 minutes by default. A lower rolling duration may cause excessive resource usage.

When a request is received, Floaty will attempt to check if any of the needed request IDs have expired. Only when expired upon receiving a request, will Floaty begin to regenerate a new ID. This will add a little bit of overhead to each request, however it will prevent unnecessary ID rerolls when not in use.

Examples

Adding a response header with a default Floaty ID:

http://:8080 {
	...
	floaty
	header X-Floaty {http.floaty}
	...
}

Adding a request header with a Floaty ID to reverse proxies, while blocking requests with a matching Floaty ID:

http://:8080 {
	...
	floaty {
		instance_id 12 10m
		source_id 12 5m
	}
	...
	@directLoopback {
		header X-Previous-Hop {http.floaty.instance_id}
	}
	@indirectLoopback {
		header X-Source-Hop {http.floaty.source_id}
	}
	respond @directLoopback "Loopback denied" 403
	respond @indirectLoopback "Loopback denied" 403
	...
	reverse_proxy {
		...
		header_up X-Previous-Hop {http.floaty.instance_id}
		header_up ?X-Source-Hop {http.floaty_source_id}
	}
	...
}

gel

⛏ Rolling server bases, batteries included.

Gel is a set of scripts to quickly prepare supported base Linux distributions for use in cloud, aiming to lessen the burden interacting with servers. For Alpine Linux, it comes with a simple OpenRC wrapper to get several systemctl commands working for OpenRC.

Gel is extensively used throughout Lightingale Community's infrastructure, either for host servers or for LXC containers. Read more on infrastructure.

Flavours

Gel mostly comes with two flavours for each supported base distribution: slim and full.

The full flavour targets all sorts of servers. Unless storage is severely constrained, this is the flavour to go for.

The slim flavour targets container hosts and VM hosts, which barely gets interacted directly, but still requires the ease-of-use found in the full version of Gel. It can also be used in other scenarios, if the full flavour contains packages you'd prefer not to be present on your system.

Full list

Usage & Security

Further instructions available here.

Usage

Native

For bare-metal, virtual machines and LXC containers. Do not run native install scripts other than on new machines.

1. On any of the supported distros, make sure curl is available.
2. Execute sh <(curl -Ls https://github.com/ltgcgo/gel/releases/latest/download/install.sh).
3. Connect to the SSH with ssh -p 1122 <serverIP>. User passwords won't change, but SSH settings will. See the SSH section for details.

Containers

Container images are only offered as a convenient way of inspecting the installations.

1. Spin up one of the available Gel flavours.
   1. Images are available on the Docker Hub if you want to save time. Use podman pull docker.io/ltgc/gel:<flavour> to pull the images.
   2. Or feel free to build the image yourself with ./shx up <flavour>.
2. Connect to the SSH with ssh -p 1122 [email protected]. The default password is root.

Additional considerations

Alpine Linux

Gel needs the community repo to be enabled in order to function.

openSUSE Leap

doas is not available on the platform. The regular sudo is used instead.

LXC installation

Debian

apt install lxc

openSUSE

zypper in lxc

Rocky Linux/AlmaLinux

dnf install lxc

Alpine

apk add lxc lxcfs lxc-download lxc-bridge

Security

Privilege elevation

To reduce attack surface, Gel will attempt to replace sudo with doas from OpenBSD. By default, only the root user is allowed to use the doas command.

To allow other users to execute the doas command as root, append the following directives to a new line in /etc/doas.conf.

permit keepenv <user> as root

Make sure there is a trailing new line at the end of /etc/doas.conf. If not, doas command will not work.

SSH

The SSH settings will be changed with a relatively more secure one, except for permitting password logins to prevent you from losing access with an unfinished setup.

After finishing the automated Gel setup, do the following to secure your SSH access.

1. If the password of the root user wasn't set by you, change it to a stronger one.
2. Add a custom new user, which would be used for SSH logins.
3. As the newly-created custom user, add the public keys used for SSH authorization.
4. Keep the current SSH session active, and login as the new user to ensure access to machine is not lost.
5. Allow the new user to use the doas command and verify. See the Privilege elevation section for details.
6. Add the new user to the sshuser group, added automatically by the setup script. Example: usermod -aG sshuser <user>.
7. In /etc/ssh/sshd_config, do the following.

• Set PermitRootLogin from yes to no.
• Uncomment AllowGroups and DenyGroups.
• (optional) Change the listening port from 1122 to another.

8. Restart sshd with systemctl restart sshd.

Octavia

Octavia is an event-driven multi-standard MIDI state-tracking library.

Features

• Free, libre and open-source, under GNU LGPL v3.0.
• Behaves like a real MIDI module.
• Developed with Firefox and an open Web in mind.
• Supports 8 ports, 128 channels, 512-voice polyphony maximum.
• Built-in support of several standards, multiple plug-in cards, and tons of devices.
• Tells when MIDI programming errors are spotted, reducing chances of faulty programming.
• Available in JavaScript (browser and Deno).
• No modification required to run in Tor Browser, Bromite and LibreWolf.
• Wide support of bank mapping and bitmaps via midi-db.

Dev Talks

We're now hosting a new place to handle development talks! If you don't have a GitHub account, or just prefer to report bugs or give suggestions in a more casual way, feel free to chat with us with links below!

• Fediverse (Mastodon): @[email protected]
• Telegram channel: @ltgc_t
• Telegram group chat: Click to join DTM Hub

Further documentation

Demo usage

• Visualizers
• Middleware

Support coverage

• Implementation sheet
• SysEx instructions sheet
• Targets
• Standard visualizers

Implementation

• Basic messages
• Control changes
• RPN/NRPN values
• Audio Effects

SysEx documentation

• Mutual instructions
• Roland MT-32
• KORG 05/X5/N5

API documentation

• state.mjs: the core processing unit
• basic.mjs: the basis for visualizers
• bridge.mjs: the basis for middleware
• disp.mjs: ready-made example visualizers
• middle.mjs: ready-made middleware
• micc.mjs: streaming assembler and disassembler

Visualizer

Warning

This section covers how to use the visualizers bundled as public demos, as such it does not reflect the behaviour of the respective modules themselves.

Things to notice

Rendering

• Visualizers have strict render resolution constraints. For the best results, it is advised to only render while conforming to those resolution constraints.
• Visualizers are all designed to render at 50 FPS. Some visualizers may offer custom framerates, however it is advised to only render at a framerate less than or equal to the capture framerate. Visualizers offered by Octavia, especially ones displaying individual notes, feature an algorithm guaranteeing notes to be displayed each frame. As such, a framerate too high will cause visualizers fail to show display immediate notes.

Usage

Input selectors

To begin using visualizers, you must select how you want to accept events. There are several options available.

Load MIDI files

You can load standard MIDI files (.mid or .kar), load SysEx blobs (.syx), load voice remapping tables (.mdat) or custom voice bank files with this action. An audio track must be loaded with the MIDI file.

Click on the "MIDI" button to load respective files. For multi-port MIDI files, port declarations via standard meta events and XGworks port assign events are all supported. Refer to multi-port extensions for details.

Load synced audio tracks

You can load an audio file synced to the accompanying MIDI file with this action. A MIDI file must be loaded with the audio file.

Click on the "audio" button to load synced audio tracks.

Receive from the shared line-in bus

When active, the visualizer will receive events from the shared line-in bus. Events received are directly emitted from the middleware without any modifications. Read MIDI I/O routing to acknowledge how to configure how MIDI events are received.

Click on the "line in" button to begin receiving from the bus. The button may appear as just "line" in some visualizers.

Receive from the shared line-out bus

Same as "line-in", but the events received will be processed by the Octavia core present on the middleware panel page. As such, events could've been modified if polyfilling or real-time translation has been enabled. Read MIDI I/O routing to acknowledge how to configure how MIDI events are received.

Click on the "line out" button to begin receiving from the bus. The button may not be present in certain visualizers.

Mode selectors

Octavia supports a range of modes ensuring correct state handling. Upon mode switches, the corresponding mode selector will be highlighted. Clicking on the mode selectors will change the global fallback mode of the core respectively.

Visualizer-specific options

Some visualizers come with additional options for configuring behaviour and look. These options are usually quite self-explanatory, but explanations for certain options considered obscure are also available below.

Demo selector

Octavia have two demo selection systems used by various public demo visualizers: letter ID and double selection.

Letter ID

This is the simplest selection system used. Demos are indexed by a unique letter from different writing systems. Simply hitting on one of the letters loads the respective demo, while depending on the visualizer, hovering over the letters may either expose the file name or some detailed info.

Double selection

Demos are grouped by collections. To select a specific demo, first select the desired collection, then select the desired file. Pressing the "load" button will load the demo, while long presses or alt clicks will load and play the demo.

Explore

Toggle authentic mode ("true mode")

To allow visualizers function normally after possible legal strikes, most visualizers render under the "libre" mode. In libre mode, assets used are replaced with libre counter parts as much as possible, with famous examples like the libre 5 by 7 font from SynPix.

However, it is also possible for certain visualizers to try resemble the real screens as much as possible under a specific rendering mode. This mode is dubbed "true mode" or "authentic mode", and can be accessed by appending #trueMode to the URLs of visualizers, or by pressing T.

Changing channels/parts

Single-focus visualizers can only display information from one channel at a time. Focused channel can be changed by clicking on the vertical edges (left and right edges) of such visualizers, or scrolling on such visualizers.

For production purposes however, it's recommended to embed channel switch SysEx messages among the events instead. Most, if not all Octavia visualizers, support the Yamaha MU channel switch SysEx message.

Changing display modes

Certain visualizers offer various rendering modes. You can switch between modes by clicking on the top or the bottom edges of these visualizers.

Middleware

Audio Effects

Audio effects

Octavia supports tracking a range of audio effects applied on supported targets. For maximum compatibility, Octavia has seven available slots reserved for effect sends, which correspond to reverb, chorus, variation and four insertions in order.

Each slot isn't dedicated to what that slot is primarily used for, but rather allocated and controlled by the CC registers they are assigned to by default (cc91, cc93, cc94, cc16-19). For example, the variation slot (cc94) is taken away by delay effects when in GS mode, while the reverb and chorus slot could be taken away by any effect desired in X5DR or NS5R mode.

Due to varied setups, each effect also isn't just bound to the CC registers they are assigned to. They can also listen on other CC registers, or even multiple if they wish.

Comparison table

Singular effect

Reverb

Chorus

Delay

Miscellaneous

Dual effect

Mutual

• X: Yamaha XG
• G: Roland GS
• A: KORG AI²

RPN/NRPN values

RPN/NRPN values

Implementation Table

MIDI Implementation Chart

SysEx Instructions

For a list of supported modes, refer to state.mjs internal mode IDs.

Supported SysEx Instructions

• ✓: Supported
• -: Partially supported
• ✕: Not supported
• ?: Unknown
• (blank): N/A

Mutual instructions

1. Support in GS is called "frame draw", and with multi-page support.
2. Called "letter display" in XG, and "text insert" in GS.
3. GS only has "delay" effect occupying the space of variation setup.

Device-specific instructions

Roland MT-32

• Temporary Patch Setup
• Temporary Drum Setup
• Temporary Timbre Setup
• Device Patch Setup
• Device Timbre Setup
• Patch Memory Write
• Timbre Memory Write
• System

Yamaha MU1000

• A/D Part Setup
• A/D Mono/Stereo
• System

Yamaha PLG-100SG

• Master Setup
• Part Setup
• PhoneSEQ Setup
• Lyrics Information Setup

Yamaha PLG-150DX

• Master Setup
• Part Setup
• DX Voice Param
• DX Voice Additional Param

Yamaha PLG-150VL

• Master Setup
• Current Voice Parameters
• Part Setup

Roland SC-88

• Single/dual Mode

KORG X5D

• All Program Dump
• All Combi Dump
• Extended Multi Dump

KORG NS5R

• Mode Switch
• All Program Dump
• All Combi Dump
• Extended Multi Dump

Targets

Supported targets

General support table

The following list of targets have their support by Octavia status presented in a table. A target can be a model, a plugin board, a lineup, or a standard.

A supported standard may also have a list of specific target models listed.

For specific SysEx support range, refer to Supported SysEx Instructions. For a list of supported modes, refer to state.mjs internal mode IDs.

1. Octavia implements XG level 3.0 or later, and XG version 2.0 or later.

Specific targets

Roland MT-32

Roland GS

Yamaha TG

Yamaha XG

Octavia standard visualizers

Octavia comes with a set of modular standard visualizers with each release.

For a guide on how to use the public demos, refer to demo visualizer usage.

Visualizers

Octavia Cambiare

• Lead developer: Lumière Élevé

The most feature-rich visualizer built on top of Octavia available. Inspired by MegaMID, vanBasco Karaoke Player and TiMidity++, Octavia Cambiare is designed from the ground up, and seeks to entirely replace what inspired it.

Octavia MU

• Lead developer: Lumière Élevé

A recreation of the screens on the Yamaha MU line up. Bitmap is collected with collective effort.

The font used for labels is Public Sans, licensed under SIL OFL.

Bitmap contributors

Special thanks to all of the people who had contributed the MU bitmap! If you see your name missing here, please contact us for proper credits.

• MIDIMan
• Lumière Élevé
• GFHK-SDGM
• MJG0117

Octavia SC

• Lead developer: Lumière Élevé

A recreation of the screens on Roland SC-55, Roland SC-88 and Roland SC-88 Pro.

The font used for labels is Work Sans, licensed under SIL OFL.

Octavia NS5R

• Lead developer: Lumière Élevé

A recreation of the screens on KORG NS5R, with help from JayB.

The font used for labels is Jost, licensed under SIL OFL.

Octavia QY

• Lead developer: Lumière Élevé

A recreation of the screens on the Yamaha QY line up, with help from JayB.

Octavia PSR

• Lead developer: GFHK-SDGM

A recreation of the screens on Yamaha PSR.

Octavia SC-8850

• Lead developer: Lumière Élevé

A recreation of the screen on Roland SC-8850.

Bitmap contributors

Special thanks to all of the people who had contributed the SC-8850 bitmap!

• SSQMinky
• MasteredRealm
• Thorndust
• GFHK-SDGM
• Lumière Élevé

Octavia MU15

• Lead developer: Lumière Élevé

A recreation of the screen on Yamaha MU15.

Support and specification table

Voice details

• N: Name only
• P: With program number
• B: With bank number
• F: With full bank numbers

Current mode

• B: Bitmap prompt
• L: Letter prompt
• C: Colour change
• D: Dedicated slot

Additional notes

1. Planned feature, not yet implemented.
2. Octavia NS5R can render voice names with at most 12 characters under certain conditions.
3. Except for Octavia MU, Octavia PSR and Octavia MU15, the intensity of pixel blur is customizable.

state.mjs API

All constants and interfaces documented here are guaranteed to work, and very likely not subject to further changes.

Constants

MIDI modes

Octavia is compatible with a range of modes on MIDI synthesizers. A list of supported modes to their respective keys is available below.

• ?: The default "nothing" mode. Octavia will try to detect the correct mode.
• gm: General MIDI mode.
• gs: Roland GS mode. GS is short for General Sound.
• xg: Yamaha XG mode. Compatible with TG-100 and TG-300. XG is short for eXtended General.
• sc: Roland GS mode, but with mode 1 or mode 2 set. Specific to Roland SoundCanvas SC-88 and up.
• g2: General MIDI Level 2 mode.
• sd: Roland SD mode. SD is used for Roland's Studio Canvas lineup.
• ns5r: KORG NS5R mode. Compatible with NX5R, and has limited compatibility with KORG N1R and N5.
• x5d: KORG X5D(R) mode. Compatible with AG-10.
• 05rw: KORG 05R/W and KORG X5 mode. Compatible with AG-10.
• k11: Kawai GMega or K11 mode.
• sg: Akai SG mode.
• krs: KORG KROSS 2 mode.
• s90es: Yamaha S90 ES mode.
• motif: Yamaha Motif ES mode.
• mt32: Roland MT-32 mode.
• doc: Yamaha DOC mode. DOC is short for Disk Orchestra Collection.
• qy10: Yamaha QY10 native mode.
• qy20: Yamaha QY20 native mode.

MIDI event types

• 8: Note off
• 9: Note on
• 10: Note aftertouch, a.k.a. polyphonic aftertouch
• 11: Channel controller change
• 12: Channel program change
• 13: Channel aftertouch
• 14: Channel pitch bend
• 15: System exclusive message

allocated

ccToPos

Interfaces

OctaviaDevice

General MIDI Extended

GME, short for General MIDI Extended, is a standard based off General MIDI level 1, which emphasizes on slightly extending the ability of General MIDI while not being too demanding. General MIDI Extended can be considered as a summarization of the common functionality among all GM-compatible synthesizers, and should be the baseline of all contemporary General MIDI-compatible synthesizers.

Requirements

Any GME-compliant synthesizer must adhere all requirements listed below.

• Has at least 24 oscillators available simultaneously (polyphony), which must either be...
  • At least 24 fully dynamically allocated oscillators for both melodic and percussion sounds.
  • At least 16 dynamically allocated oscillators for melodic sounds, 8 for percussion sounds.
• Supports all 16 MIDI channels, which...
  • Can play arbitrary number of voices within the polyphony limit.
  • Can change to a different instrument.
  • Channel 10 is set to percussion by default.
• Correctly responds to listed required events, CC and RPN.
• Has all voices listed in the required voice list.
• Has drum kits following the required drum note mapping.
• Correctly responds to required System Exclusive messages.

Voice list

Drum voices

Drum kits will reside on MSB 124, and all level 1 kits will also reside on MSB 120.

The above portion is not yet decided.

Melodic voices

Piano

Chromatic percussion

1. Some implementations may swap Dulcimer out with Santur.

Organ

Guitar

Bass

Solo strings/orchestra

Ensemble strings/orchestra

Brass

Reed

Pipe

Synth lead

Synth pad

1. Or "Fantasia Pad".

Synth melodic sound effects

Ethnic

Percussive

Sound effects

1. Can be optionally extended as a menu voice, with examples including Stadium!!! in KORG AI² lineup.

Drum note mapping

• Regular: Required.
• Italic: Optional. If not defined, the note will behave the same as in Standard Kit.
• ←: Same as Standard Kit.

Events, CC and RPN

Events

Assembly

Except System Exclusive messages, the first byte of each MIDI event defines the event type and target channel. The first four bits define the event type, with the last four bits defining the target channel.

Types

System message types

Types

Control Changes

Mapping

Data

Voice

Modes

Types

Registered Parameter Numbers

Non-registered Parameter Numbers

Warning

This section is optional.

System Exclusive

Painted Palette

Painted Palette is a headless bot implemented purely in JavaScript, which helps pixel placements on r/place. It is developed for the My Little Pony factions, but can work for any other faction with modification.

If the codebase isn't modified, in auto mode, Painted Palette runs on a defensive stance by default - as long as pixels covered by the template aren't badly damaged, it barely activates. If in manual mode, Painted Palette only places pixels when the user commands or schedules a pixel placement.

Features

• Extremely fast to build, fast and easy to deploy for anyone. IT prowness is not a problem.
• No dependency compiling before running.
• Fully-unattended automated updates.
• Relatively low on resources.
• Native support for multi-account deployments. (less than 10 per IP address)

Installation

Warning

Node.js on Windows does not respect proxy settings. If proxies are needed, switch to Deno instead.

With an acceptable Internet connection, the whole installation process should not take more than 20 seconds. On POSIX systems, the figure is even lower.

If you're up for the task, feel free to contribute, and expand our horizon of OS support!

Windows

1. Download the latest version of node_windows.zip.
2. Extract node_windows.zip to an appropriate folder of your liking.

Linux, Android, macOS

1. Ensure bash, curl and unzip are available.
2. Assign export VARIANT=node.
3. Make sure you have either Node.js 18 or Node.js 19 installed.
4. Run bash <(curl -Ls https://github.com/ltgcgo/painted-palette/raw/main/src/bash/install.sh).

Running

Warning

Despite our efforts on bot detection evasion, when not in manual mode, running the bot on your main is generally considered a bad idea. Please use disposable alts when in auto mode.

For more advanced usage, please refer to command line docs.

Windows (default GUI only)

• Double-click webui.cmd, and click on the link it provides. Should point to 127.0.0.1:14514 by default.
  • If the browser displays an error page, run winFix.cmd first, then restart gui.cmd to see if the problem goes away.

Linux, Android, macOS

• Run ./palette-bot batch, and click on the link it provides.
• Do you have Tor installed on your system? If yes and you're using Deno, run ./palette-tor batch to use it without the tedious configuration process!
• Are you running Painted Palette with Deno on Linux? If yes, run ./palette-proxy batch to connect to public proxy pools with ease!

Windows (CLI)

• Open a terminal session where webui.cmd is located.
• Run with .\node.exe node.js <arguments>.

Podman/Docker

• Clone the repo via git clone https://github.com/ltgcgo/painted-palette.git palette.
• Switch into oci via cd ./palette/oci.
• Run docker-compose up -d if on Docker, or podman-compose up -d if on Podman.

Open Source

Painted Palette is a piece of open-source software, licensed under GNU GPL 3.0.

Source code: GitHub

Web UI

WIP

Command line

The Windows build does not ship with a helper like ./palette-bot . As such, please replace ./palette-bot with node node.js or deno run --allow-read --allow-write --allow-net deno.js .

With Deno or Bun, if you need to specify custom proxies, define the https_proxy environment variable (e.g. https_proxy=http://127.0.0.1:4444/). There are direct proxy integrations available on Linux and Android, which can be used by replacing ./palette-bot with either ./palette-proxy for public proxy pools, or ./palette-tor for Tor.

Environment variables

• BIND_ADDRESS: Define a bind address. Do not include ports.
• HTTP_PROXY: Used by Deno and Bun to connect to upstream proxies.
• HTTPS_PROXY: Same as above. Must be the same as HTTP_PROXY.
• NO_UPDATE: Set to 1 to disable the automatic updater.
• PORT: Set the port PP listens for REST API calls. Used in ./palette-bot ctl.
• SLEEP: Set to 1 to behave as if ./palette-bot ctl sleep is run.
• TEMPLATE_URL: Customize the pointer URL.

./palette-bot help

Prints help messages.

./palette-bot paint

Deprecated and not recommended. Paint on Reddit with given credentials.

Format: ./palette-bot paint <username> <password> <otp>

Examples:

• Direct login: ./palette-bot paint myCoolName myGoodPassword
• Direct login with 2FA codes: ./palette-bot paint myCoolName myGoodPassword 114514

./palette-bot pixel

Removed. Paint on VKontakte with given credentials.

Same format as ./palette-bot paint.

./palette-bot test

Deprecated and not recommended. Paint on the test server with given credentials.

Same format as ./palette-bot paint.

./palette-bot batch

Start a batch mode server for account management, complete with Web UI and REST API.

Since version 0.0.16, manual mode became the default - pixel placements require user interaction, and only a single account is allowed.

Format: ./palette-bot batch <port>

./palette-bot ctl

Send commands to a running batch server. Define the target port which the batch server listens on with the environment variable PORT.

Format: ./palette-bot ctl <subcommand> <...args>

Subcommands

r/place 2023

Warning

Information on this page is outdated.

Written on 22nd June 2023

Warning

r/place 2023 did not happen on 1st April or 23rd June.

You know the drill: r/place 2023 is coming. So we prepared a list of FAQs, for you as a brony/pegasister to bootstrap your knowledge!

What is r/place?

r/place is a social experiment run by Reddit, where every participant gets to place coloured pixels with a defined cooldown. With itself categorized as a form of "pixel battle", it is by far the largest pixel battle held across the globe.

With only the power of a single person, not much could be created. However, with the power of factions, there's no such thing as "impossible"!

Why should I participate?

Although r/place isn't an annual event, Reddit held r/place last year (2022) also. And last year, we suffered dozens of raids, most of them lost due to a lack of firepower, and were able to recover solely because attackers went inactive eventually, either due to sleeping or due to recess between raids. We hope we could stop the same from happening again.

We prepared for r/place in advance this year, but with multi-account and automated pixel placement banned in the main faction, all while protests regarding Reddit APIs going in full swing, the expected firepower looks even dimmer. Despite the ongoing Reddit API fiasco, we desperately need everyone we can hopefully get, to extend our firepower as much as possible for all possible defense. Please consider participating the event!

When is it expected to happen?

On 23rd June 2023, Reddit's anniversary before its IPO. The exact time may vary, but it is rumored to happen at around 13:00 UTC.

How do I participate as a My Little Pony fan?

Lucky for us, a group of enthusiastic bronies established a faction before r/place even began, which became the main MLP faction of r/place 2023. But unlucky for us, said faction recently got splintered.

Why the splinter?

The initial trigger was an announcement on 18th June, regarding ban on all forms of automatic pixel placement, alongwith joining an unknown alliance called "P3ACE".

The ban alone did directly result in the creation of a faction, but it was a series of indications and later dealings sending the splinter onto a seemingly irreversible course: lack of transparency regarding joining the alliance, single parties meddling and forced the join, reluctance of communication regarding multi-account and automated pixel placement, with certain mods outright shunning and diverting arguments, all while removing downvotes on that specific announcement. All these enraged some parties, setting the splinter in stone.

The current splinter does not dwindle the firepower MLP as a whole possesses, as both use the very same template.

What about the pros and cons of automated pixel placements?

Pros

• Relatively low resource consumption, good for low-end devices
• Does not require you to stare at a screen and clicking your mouse for hours end
  • Does not hinder you from your work
  • Allows you to sleep as usual

Cons

• If only with automated placements, one cannot experience the event to its fullest
• Shamed by some people
• "Does not believe in friendship"

How do existing implementations of automation fit?

• Browser overlay: Auto-clicker is removed, and tab freeze circumvention became borked. Auto-focus and automatic colour picking still exist, but every pixel placement now requires user interactions.
• PonyPixel (Python headless): Retired.
• Painted Palette (JavaScript headless): A seperate manual-only mode is planned, but is largely unhindered.

How should I join the factions?

With the main faction prohibited discussions regarding several topics, the splintered-off faction offers a supplemental and more libre place where said topics are likely not forbidden. If you are fine with all the bureaucracy issues in the main faction, and agrees to stare at a screen for hours to place every single pixel manually, you can join the main faction. Otherwise, joining the splintered-off faction is much recommended.

Invite links

Since Painted Palette by itself is a somewhat independent project, it has an additional place for dev talks unrelated to the splinter.

• Secret r/place Brownies (the splintered-off faction): https://discord.gg/Nhf8HrWAku
• Sky Splash's Island: https://discord.gg/ZnU6sgDT
• Independent Painted Palette dev talks: Discord topic
• Main faction: https://discord.gg/BronyPlace

raven

💨 Lightning-fast intuitive typing.

Target scripts

• Arabic script
• Cyrillic script
• English phonetic alphabets
• Mongolian

Usage

m17n

m17n is an IME library for mapped stream conversion of characters. To develop schemas for m17n, read the database tutorial.

m17n is included in both IBus (Intelligent Input Bus) and fcitx5.

Linux

• Get the required .mim files.
• Check if the IME framework of your system supports m17n. Most Linux desktop distros with IBus has m17n support included by default.
• Check if directory ~/.m17n.d/ exists for the current user. If not, create it via mkdir ~/.m17n.d/.
• Copy the .mim files you want to use to ~/.m17n.d.
• Restart your IME framework.
  • If on IBus, run ibus restart.

Android

Warning

No input methods on Android support m17n currently. For its possible support on Android, please check out the issue in the fcitx5-android project.

Rime

Rime is an IME framework for implementing custom input schemas for different languages. To develop schemas for Rime, read here (machine translation required).

Rime is supported on Linux via IBus, Windows and macOS. Platform support is extended with forks, e.g. for fcitx5 (fcitx-rime), Android (Trime) and iOS (Hamster, iRime).

The official Rime documentation is only available in Orthodox Chinese.

Linux

• Get the required .yaml files. Check for files ending in .schema.yaml, .dict.yaml and .custom.yaml.
• Copy the .yaml files to ~/.config/ibus/rime/.
• (Optional) Customize the new schema as you see fit.
• Enable the new schema in ~/.config/ibus/rime/default.custom.yaml.
• Redeploy Rime via touch ~/.config/ibus/rime/; ibus restart.

Windows

• Get the required .yaml files. Check for files ending in .schema.yaml, .dict.yaml and .custom.yaml.
• Copy the .yaml files to %APPDATA%\\Rime.
• (Optional) Customize the new schema as you see fit.
• Enable the new schema in %APPDATA%\\Rime\\default.custom.yaml.
• Redeploy Rime via start menu or right-click menu of the taskbar icon.

Android

fcitx5-android

TBD.

Trime

TBD.

Key map

Consonants

Vowels

Letters with hamza

Numbers

Arabic and Persian numerals have separate codepoints, despite only three of them (4, 5, 6) look different. Urdu numerals share the same codpoint as the Persian ones, but three of them (4, 6, 7) should look different with proper language settings.

Punctuations

English phonetic alphabets

As per effort of decreasing the learning curve as much as possible, all English phonetical alphabets share the same set of key map.

Included alphabets

British English Phonetic Alphabet

BEPA is an adaptation of International Phonetic Alphabet, optimized to represent the sounds of British English, and by extension all of its variants.

Shavian alphabet

The Shavian alphabet is a constructed alphabet aims to permit efficient writing and spelling for British English Received Pronunciation.

Deseret alphabet

Warning

Due to a lack of several vowels, there are no plans to support the Deseret alphabet as of yet.

The Deseret alphabet is a constructed alphabet developed to be used in an English-language spelling reform for American English.

Key map

Keys are ordered via BEPA.

Vowels

Vowels require at most two keys.

Short vowels