PHP Community on Mastodon

5 posts4 participants0 posts today

Peter CzanikEach time a new major <a href="https://fosstodon.org/tags/Elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Elasticsearch</a> version is released, someone asks if it works with <a href="https://fosstodon.org/tags/syslog_ng" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#syslog_ng</a>. So I gave it a quick test and based on that, Elasticsearch 9.0.0 beta1 works fine with syslog-ng. But of course, some terms and conditions apply… :-) <a href="https://www.syslog-ng.com/community/b/blog/posts/testing-elasticsearch-9-0-0-beta1-with-syslog-ng" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.syslog-ng.com/community/b/blog/posts/testing-elasticsearch-9-0-0-beta1-with-syslog-ng</a>

Juliet Merida, Dum Tran Elf 🏳️‍⚧️I know I give <a href="https://merida.hair/tags/Elasticsearch" rel="nofollow noopener noreferrer" target="_blank">#Elasticsearch</a> a lot of crap, but I've got a sales meeting with the Elastic folks to this morning to talk about their SIEM offering (which I love) and I'm totally geeking out about it. I can't wait for my manager to see it and understand why I love it so much. Unfortunately our last sales meeting was with Crowdstrike and they're pretty flashy and impressive so we'll see what happens.

Emanuele PanzElastic roadshow: how Turgauer cantonal bank used Elastic observability to normalize and aggregate their logs, with an ingestion rate of 55M logs ler dayMetrics will be integrated in the future"We just ingest logs, but some metrics are already available in our logs, which we leverage to trigger alerts and build dashboards"Quite impressive work!<a href="https://phpc.social/tags/elasticsearch" class="mention hashtag" rel="tag">#elasticsearch</a> <a href="https://phpc.social/tags/observability" class="mention hashtag" rel="tag">#observability</a> <a href="https://phpc.social/tags/zurich" class="mention hashtag" rel="tag">#zurich</a> <a href="https://phpc.social/tags/elastic" class="mention hashtag" rel="tag">#elastic</a>

Emanuele Panz<a href="https://phpc.social/tags/elasticsearch" class="mention hashtag" rel="tag">#elasticsearch</a> roadshow in Zürich: "Google is recommending Elastic AI search as search solution"That's quite an announcement, from the sales representative of Google EMEA<a href="https://phpc.social/tags/elastic" class="mention hashtag" rel="tag">#elastic</a> <a href="https://phpc.social/tags/googlesearch" class="mention hashtag" rel="tag">#googlesearch</a>

FLOX Advocate<a href="https://floss.social/tags/getFedihired" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#getFedihired</a> - Know <a href="https://floss.social/tags/MongoDB" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MongoDB</a> and/or <a href="https://floss.social/tags/ElasticSearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ElasticSearch</a> and/or GNU/Linux <a href="https://floss.social/tags/sysadm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#sysadm</a> ? Expecially if you know <a href="https://floss.social/tags/Ansible" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Ansible</a> and/or <a href="https://floss.social/tags/python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#python</a> and <a href="https://floss.social/tags/shell" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#shell</a> scriptingA couple US or India <a href="https://floss.social/tags/WFH" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#WFH</a> positions opening up for 24/7 support ( includes <a href="https://floss.social/tags/weekend" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#weekend</a> and <a href="https://floss.social/tags/holiday" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#holiday</a> shifts )US roles are US daytimes, India roles are the other 16 hours of dayDM me if you're interested ( job listings coming soon )We should also have some SRE and dev positions and a MongoDB DBA position soon<a href="https://floss.social/tags/FediHire" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FediHire</a> <a href="https://floss.social/tags/FLOSSjobs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#FLOSSjobs</a> <a href="https://floss.social/tags/Elastic" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Elastic</a> <a href="https://floss.social/tags/Mongo" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Mongo</a>

N-gated Hacker News🚀✨ Wow, <a href="https://mastodon.social/tags/PostgreSQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PostgreSQL</a> just got a shiny new toy to play well with others! Apparently, adding <a href="https://mastodon.social/tags/BM25" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#BM25</a> ranking makes it 3x faster than Elasticsearch—because, you know, exaggerated <a href="https://mastodon.social/tags/performance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#performance</a> boasts never get old. 🤔🔍 So, strap on folks, because your slightly quicker searches in databases are the next big thing! 😂📚 <a href="https://blog.vectorchord.ai/vectorchord-bm25-revolutionize-postgresql-search-with-bm25-ranking-3x-faster-than-elasticsearch" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://blog.vectorchord.ai/vectorchord-bm25-revolutionize-postgresql-search-with-bm25-ranking-3x-faster-than-elasticsearch</a> <a href="https://mastodon.social/tags/Elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Elasticsearch</a> <a href="https://mastodon.social/tags/database" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#database</a> <a href="https://mastodon.social/tags/search" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#search</a> <a href="https://mastodon.social/tags/speed" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#speed</a> <a href="https://mastodon.social/tags/HackerNews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HackerNews</a> <a href="https://mastodon.social/tags/ngated" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ngated</a>

Seth GroverMalcolm v25.02.0 contains some major performance improvements, a few smaller new features and enhancements, several component version updates, bug fixes, and documentation updates. See the <a href="https://github.com/cisagov/Malcolm/releases/tag/v25.02.0" rel="nofollow noopener noreferrer" target="_blank">release notes</a> for more details.<ul><li>✨ Features and enhancements<ul><li>performance improvements (4x faster) for NetBox enrichment (<a href="https://github.com/cisagov/Malcolm/issues/#547" rel="nofollow noopener noreferrer" target="_blank">#547</a>) and autopopulation</li><li>performance improvements (18x faster) for Suricata's processing of uploaded PCAP files (<a href="https://github.com/cisagov/Malcolm/issues/#457" rel="nofollow noopener noreferrer" target="_blank">#457</a>)</li><li>include <a href="https://github.com/corelight/zeek-long-connections" rel="nofollow noopener noreferrer" target="_blank">corelight/zeek-long-connections</a> plugin to log long connections (<a href="https://github.com/cisagov/Malcolm/issues/#585" rel="nofollow noopener noreferrer" target="_blank">#585</a>)</li><li>significant work-in-progress towards support for Sigma rules via OpenSearch Security Analytics (still incomplete due to some blocking issues upstream, see <a href="https://github.com/cisagov/Malcolm/issues/475" rel="nofollow noopener noreferrer" target="_blank">#475</a> for details)</li></ul></li><li>✅ Component version updates<ul><li>Arkime to <a href="https://github.com/arkime/arkime/blob/10bf375cc98e2c12c0286fddc7c79cb3126b993c/CHANGELOG#L43-L75" rel="nofollow noopener noreferrer" target="_blank">v5.6.1</a></li><li>capa to <a href="https://github.com/mandiant/capa/releases/tag/v9.0.0" rel="nofollow noopener noreferrer" target="_blank">v9.0.0</a></li><li>OpenSearch and OpenSearch Dashboards to <a href="https://github.com/opensearch-project/opensearch-build/blob/main/release-notes/opensearch-release-notes-2.19.0.md" rel="nofollow noopener noreferrer" target="_blank">v2.19.0</a></li></ul></li></ul><a href="https://malcolm.fyi/" rel="nofollow noopener noreferrer" target="_blank">Malcolm</a> is a powerful, easily deployable network 🖧 traffic analysis tool suite for network security monitoring 🕵🏻‍♀️.Malcolm operates as a cluster of containers 📦, isolated sandboxes which each serve a dedicated function of the system. This makes Malcolm deployable with frameworks like Docker 🐋, <a href="https://malcolm.fyi/docs/quickstart.html#DockerVPodman" rel="nofollow noopener noreferrer" target="_blank">Podman</a> 🦭, and <a href="https://malcolm.fyi/docs/kubernetes.html#Kubernetes" rel="nofollow noopener noreferrer" target="_blank">Kubernetes</a> ⎈. Check out the <a href="https://malcolm.fyi/docs/quickstart.html" rel="nofollow noopener noreferrer" target="_blank">Quick Start</a> guide for examples on how to get up and running.Alternatively, dedicated official <a href="https://malcolm.fyi/docs/malcolm-hedgehog-e2e-iso-install.html#InstallationExample" rel="nofollow noopener noreferrer" target="_blank">ISO installer images</a> 💿 for Malcolm and Hedgehog Linux 🦔 can be downloaded from Malcolm's <a href="https://github.com/cisagov/Malcolm/releases" rel="nofollow noopener noreferrer" target="_blank">releases page</a> on GitHub. Due to limits on individual files in GitHub releases, these ISO files have been split 🪓 into 2GB chunks and can be reassembled with scripts provided for both Bash 🐧 (<a href="https://github.com/cisagov/Malcolm/blob/main/scripts/release_cleaver.sh" rel="nofollow noopener noreferrer" target="_blank"><code>release_cleaver.sh</code></a>) and PowerShell 🪟 (<a href="https://github.com/cisagov/Malcolm/blob/main/scripts/release_cleaver.ps1" rel="nofollow noopener noreferrer" target="_blank"><code>release_cleaver.ps1</code></a>). See <a href="https://malcolm.fyi/docs/download.html#DownloadISOs" rel="nofollow noopener noreferrer" target="_blank">Downloading Malcolm - Installer ISOs</a> for instructions.As always, join us on the <a href="https://github.com/cisagov/Malcolm/discussions" rel="nofollow noopener noreferrer" target="_blank">Malcolm discussions board</a> 💬 to engage with the community, or pop some corn 🍿 and <a href="https://www.youtube.com/@malcolmnetworktrafficanalysis/playlists" rel="nofollow noopener noreferrer" target="_blank">watch a video</a> 📼.<a href="https://infosec.exchange/tags/Malcolm" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Malcolm</a> <a href="https://infosec.exchange/tags/HedgehogLinux" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HedgehogLinux</a> <a href="https://infosec.exchange/tags/Zeek" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Zeek</a> <a href="https://infosec.exchange/tags/Arkime" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Arkime</a> <a href="https://infosec.exchange/tags/NetBox" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NetBox</a> <a href="https://infosec.exchange/tags/OpenSearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OpenSearch</a> <a href="https://infosec.exchange/tags/Elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Elasticsearch</a> <a href="https://infosec.exchange/tags/Suricata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Suricata</a> <a href="https://infosec.exchange/tags/PCAP" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PCAP</a> <a href="https://infosec.exchange/tags/NetworkTrafficAnalysis" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NetworkTrafficAnalysis</a> <a href="https://infosec.exchange/tags/networksecuritymonitoring" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#networksecuritymonitoring</a> <a href="https://infosec.exchange/tags/OT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OT</a> <a href="https://infosec.exchange/tags/ICS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ICS</a> <a href="https://infosec.exchange/tags/icssecurity" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#icssecurity</a> <a href="https://infosec.exchange/tags/CyberSecurity" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CyberSecurity</a> <a href="https://infosec.exchange/tags/Cyber" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Cyber</a> <a href="https://infosec.exchange/tags/Infosec" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Infosec</a> <a href="https://infosec.exchange/tags/INL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#INL</a> <a href="https://infosec.exchange/tags/DHS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DHS</a> <a href="https://infosec.exchange/tags/CISA" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CISA</a> <a href="https://infosec.exchange/tags/CISAgov" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CISAgov</a>

Philipp Krenn"RAG made easy with <a href="https://mastodon.social/tags/SpringAI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SpringAI</a> and <a href="https://mastodon.social/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#elasticsearch</a>": meetup tomorrow (february 26) evening by the SF JUG in the elastic office. we'll try to balance the java side, vector search, and not getting too serious ;) <a href="https://www.meetup.com/sfjava/events/306118459/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.meetup.com/sfjava/events/306118459/</a>

Emanuele PanzElasticsearch meetup: how Digitec/Galaxus implemented semantic search and ML to improve their search engine<a href="https://phpc.social/tags/elasticsearch" class="mention hashtag" rel="tag">#elasticsearch</a> <a href="https://phpc.social/tags/machinelearning" class="mention hashtag" rel="tag">#machinelearning</a> <a href="https://phpc.social/tags/vectorsearch" class="mention hashtag" rel="tag">#vectorsearch</a>

Philipp Krennrunning <a href="https://mastodon.social/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#elasticsearch</a> + <a href="https://mastodon.social/tags/kibana" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#kibana</a> preview releases just got a lot easier: `curl -fsSL <a href="https://elastic.co/start-local" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://elastic.co/start-local</a> | sh -s -- -v 9.0.0-beta1` 🙌or also older versions for testing: `curl -fsSL <a href="https://elastic.co/start-local" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://elastic.co/start-local</a> | sh -s -- -v 7.17.27`no need for my hack any more 😅

Philipp Krenn<a href="https://mastodon.social/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#elasticsearch</a> 9 is approaching and you can give it a spin 🌪️ more on features later (and also the release strategy with the remaining 8.x minors). but this is the easiest way to get going: 1. use start-local, which will give you 8.17.2 right now: curl -fsSL <a href="https://elastic.co/start-local" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://elastic.co/start-local</a> | sh 2. stop it and remove all state: docker compose down -v 3. in the .env file, change the version line (1st line) to: ES_LOCAL_VERSION=9.0.0-beta1 4. spin up 9: docker compose up

Benjamin Carr, Ph.D. 👨🏻‍💻🧬What Happens to Relicensed <a href="https://hachyderm.io/tags/OpenSource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#OpenSource</a> Projects and Their Forks? Contributor impact varies after projects adopt more restrictive licenses, finds Community Health Analytics in Open Source Software (CHAOSS) research on <a href="https://hachyderm.io/tags/Elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Elasticsearch</a>, <a href="https://hachyderm.io/tags/Redis" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Redis</a>, <a href="https://hachyderm.io/tags/Terraform" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Terraform</a> and their forks. So "Looking at all of these projects together, we see that the forks from relicensed projects tend to have more organizational diversity than the original projects," they conclude. <a href="https://thenewstack.io/what-happens-to-relicensed-open-source-projects-and-their-forks/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://thenewstack.io/what-happens-to-relicensed-open-source-projects-and-their-forks/</a>

Philipp KrennCSVES (CSV to <a href="https://mastodon.social/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#elasticsearch</a>): <a href="https://github.com/githubesson/csves/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://github.com/githubesson/csves/</a> the little utilities to get you going with your data :)

Philipp Krenn"<a href="https://mastodon.social/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#elasticsearch</a>: 15 years of indexing it all, finding what matters": <a href="https://www.elastic.co/search-labs/blog/elasticsearch-history-15-years" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.elastic.co/search-labs/blog/elasticsearch-history-15-years</a> we turned it into a proper blog post with shay :) including some wild stats (how many downloads has Elasticsearch had every second since its start 15 years ago?), past highlights, and next focus areas

Daniel ColquittIt turns out that the issue wasn’t ES using excessive RAM, but rather the off heap memory growing from other processes. When the total RAM exceeded that available on the VPS, ES was killed.Setting -Xmx2048m seems to result in a stable configuration with ES happily humming away. <a href="https://colquitt.xyz/tags/ElasticSearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ElasticSearch</a> <a href="https://colquitt.xyz/tags/MastoAdmin" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MastoAdmin</a> <a href="https://colquitt.xyz/tags/SingleUserInstance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SingleUserInstance</a>

Daniel Colquitt• Set ES_HOST=https://localhost in .env.production • Set ES_CA_FILE=/path/to/selfsigned/cert(b) I had to carefully set the maximum Java heap size, even though I thought I had plenty of RAM.This last point confused me for sometime. I am running ES on the same VPS as my mastodon instance, which has 8GB RAM. So I I initial set -Xmx3g, but ES kept failing with exit code 137 (excessive memory consumption). I successively increased -Xmx to 4g, 5g, 6g, but with no luck.After checking the logs, the heap size was not growing and the cap was being enforced properly.<a href="https://colquitt.xyz/tags/ElasticSearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ElasticSearch</a> <a href="https://colquitt.xyz/tags/MastoAdmin" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MastoAdmin</a> <a href="https://colquitt.xyz/tags/SingleUserInstance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SingleUserInstance</a>

Daniel ColquittFor those interested, setting up <a href="https://colquitt.xyz/tags/ElasticSearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ElasticSearch</a> was fairly straightforward. I mostly followed the official instructions at <a href="https://docs.joinmastodon.org/admin/elasticsearch/" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://docs.joinmastodon.org/admin/elasticsearch/</a>, with two minor modifications:1. I installed OpenJDK 21 (latest version in the Ubuntu repository) 2. I installed ElasticSearch 8.Two things tripped me up:(a) ES v8 requires TLS by default, even when binding only to localhost. This means that: • When using curl, you have to use --cacert to specify the path to the self-signed certificate generated by ES & prepend localhost with https://<a href="https://colquitt.xyz/tags/MastoAdmin" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MastoAdmin</a> <a href="https://colquitt.xyz/tags/SingleUserInstance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SingleUserInstance</a>

Daniel ColquittCuriosity got the better of me and I ended up rescaling* my server and installing ElasticSearch. Let’s see how much I use it.— * FYI 2 vCPU & 4GB isn’t anywhere near enough for a <a href="https://colquitt.xyz/tags/SingleUserInstance" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SingleUserInstance</a> of <a href="https://colquitt.xyz/tags/mastodon" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mastodon</a> + <a href="https://colquitt.xyz/tags/ElasticSearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ElasticSearch</a>. <a href="https://colquitt.xyz/@daniel/113975100843242921" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://colquitt.xyz/@daniel/113975100843242921</a>

Philipp Krenn"15 years of query tuning, and we’re still just throwing boost: 10 at the problem" <a href="https://mastodon.social/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#elasticsearch</a>

Philipp Krenn"15 years, and we’re still debating refresh_interval: 1s vs 30s like it’s a life-or-death decision" <a href="https://mastodon.social/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#elasticsearch</a>

Recent searches

Search options

Administered by:

Server stats:

#elasticsearch