#databases
Next week in Manhattan https://2023.pgconf.nyc is taking place, 3 full days of #Postgres content with an all-star speaker lineup! I will be debuting my new talk "How #PostgreSQL Can Help You Enforce Best Practices" - come say hi!
#bestpractices #opensource #database #databases #pgconfnyc #edb
Managed databases with sqlc vet
https://sqlc.dev/posts/2023/09/25/v1.22.0-managed-databases/
Discussions: https://discu.eu/q/https://sqlc.dev/posts/2023/09/25/v1.22.0-managed-databases/
So many free #databases and nothing to write to them. #Turso #Neon #PlanetScale
Getting Postgres logs in a GitHub Action https://brandur.org/fragments/postgres-logs-in-github-actions | https://lobste.rs/s/rlkybm #databases #testing
I'm planing on setting up #postgresql in a @docker container. In the past, I've stayed away from using #databases in a container.It seemed like #containers tech was too immature to rely on for a database. But it seems like perhaps it has matured at least for a development instance of a #db. I'm still going to use a hosted solution for a production database. I'm using #GCP for this project) Wonder if folks have any advice on how to do it right. @planetpostgresql
A SQL query parser written in Rust.
Open source: https://github.com/systemxlabs/sqlparser-nom
#sql #databases #parser #rustlang #mysql
You may have read my post about big data not really being a thing:
https://radiki.dev/posts/a-small-dbms/#commodity-hardware-is-all-you-need
but you may have remained skeptical. In that case, here's someone else saying the exact same thing:
https://motherduck.com/blog/big-data-is-dead/
Marketing angle aside, the conclusions are the same. Big data is not real and even if it was, it's not useful.
The biggest barrier to entry for working with #databases in #Python is terminology. Here I try to break it down.
Any #postgresql server admins out there? Successfully running a decently large cluster for quite a while but have never quite figured out if there is server side tuning that can be brought to bear to weed out LWLock:buffer_mapping. Sure, smaller batches, or table sharding, but that's software side. Any server settings tweaks? #databases #dbadmins
How do databases execute expressions?
https://notes.eatonphil.com/2023-09-21-how-do-databases-execute-expressions.html
Discussions: https://discu.eu/q/https://notes.eatonphil.com/2023-09-21-how-do-databases-execute-expressions.html
Data Contract Specification https://datacontract.com | https://lobste.rs/s/3syk0k #api #databases
64-Bit Bank Balances ‘Ought to be Enough for Anybody’?
https://tigerbeetle.com/blog/2023-09-19-64-bit-bank-balances-ought-to-be-enough-for-anybody/
Discussions: https://discu.eu/q/https://tigerbeetle.com/blog/2023-09-19-64-bit-bank-balances-ought-to-be-enough-for-anybody/
What if OpenDocument used SQLite? (2014)
https://www.sqlite.org/affcase1.html
Discussions: https://discu.eu/q/https://www.sqlite.org/affcase1.html
We Need A Standard Layered Image Format (2013)
https://shapeof.com/archives/2013/4/we_need_a_standard_layered_image_format.html
Discussions: https://discu.eu/q/https://shapeof.com/archives/2013/4/we_need_a_standard_layered_image_format.html
PostgreSQL 15 Cookbook by GitforGits | Asian Publishing House is on sale on Leanpub! Its suggested price is $29.99; get it for $23.99 with this coupon: https://leanpub.com/sh/VxfPE83Y @GitforGits #Postgresql #SqlServer #Databases
Get Organized with Notion — by Jill from the Northwoods https://www.podfeet.com/blog/2023/09/notion-jill/
She explains how she uses Notion to manage her “Podcast Empire” and her daily life. Check out her shows at https://startwithsmallsteps.com
My favourite API is a zipfile on the European Central Bank's website
Discussions: https://discu.eu/q/https://csvbase.com/blog/5
SQL join flavors https://antonz.org/sql-join/ | https://lobste.rs/s/5jpbgl #databases
Using Janet as Database
https://www.1a-insec.net/blog/18-janet-as-database/
Discussions: https://discu.eu/q/https://www.1a-insec.net/blog/18-janet-as-database/
PostgreSQL 16 Released https://www.postgresql.org/about/news/postgresql-16-released-2715/ | https://lobste.rs/s/py94bo #databases
#postgresql 16 has been released 🎉
https://www.postgresql.org/about/news/postgresql-16-released-2715/
Very glad to see a successful PGDay UK take place. The UK #PostgreSQL #community is thriving and there is huge potential to connect, learn from & work with each other. Let's keep growing, and potentially take this to other places in the UK.
Congratulations to all the organisers, volunteers and speakers for an excellent #conference, and a big thank you to Alice Keane and Mostafa Zakaria for their great presence at the EDB booth.
https://2023.pgday.uk/schedule
#postgres #openSource #database #databases
Datalite: A Simple Datalog Built Around SQLite in Python
https://www.philipzucker.com/datalite/
Discussions: https://discu.eu/q/https://www.philipzucker.com/datalite/
#selfhosting #docker #podman #containers #databases #database #postgresql #SQL
self-hosting newbie here. Is it worth centralizing all my databases onto one container, or is having a container for each service the best approach?
PGDay UK here I come!
#PGDayUK #London #postgres #postgresql #openSource #database #databases
I just really like writing #databases in docs… i dunno why but organising notes in a table and adding columns for various metadata really speaks to me.
I had a page for job listings and house hunting, I’m not cases Notion flexible enough to support changing needs in terms of the fields I was storing and the way I thought about the data.
Check out the Leanpub Frontmatter podcast interview with Andy Grove, Author of How Query Engines Work: An Introductory Guide https://leanpub.com/podcasts/frontmatter/andy-grove-17-02-21 #books #databases #podcasts
How Query Engines Work https://leanpub.com/how-query-engines-work #books #databases #softwarearchitecture
#Databases in the #Microservices world: "Why do we refactor apps into microservices then use the same #monolith #datastore our grandparents used?" Join us #online for #TwinCities #dotNET User Group at https://www.meetup.com/tcdnug/events/295749203/ and grab the slides at https://robrich.org/slides/databases-in-the-microservices-world/#/
### Home - Database of Databases
> Discover and learn about 926 database management systems
If you are wondering what the future of #databases looks like, you might be interested in this article https://doi.org/10.14778/3603581.3603604
The authors argue that despite increasing specialization, databases share the same components. By relying on standards, you can develop a composable system with:
- your preferred language interface (#SQL, #Ibis, #dplyr, ...). The query is converted into an intermediate representation (like #substrait)
- a query optimizer
- an execution engine
- an execution runtime
The Top Programming Languages 2023
https://spectrum.ieee.org/the-top-programming-languages-2023
Discussions: https://discu.eu/q/https://spectrum.ieee.org/the-top-programming-languages-2023
Well, I think it could be nice to talk a bit about myself, so here it goes (it is a long one, be warned)
My (still ongoing) journey from engineering to programming: Prologue
As can be seen in my profile bio, my name is Iago Andrade, and I am a Brazilian. What can't be seen there, though, is that I'm a mechanical engineer, and I have worked as a mechanical designer since 2018. This year (2023) I decided to pursue an old desire, which was to be able to work with #programming.
First contact
From the very first year at university, I fell in love with programming, when we were introduced to #C. Most of my friends were not really interested in that, and thought it was too difficult, but I was fascinated by the possibilities of what could be done with it.
At first, we used it mostly to solve dificult mathematical problems through iterative process, but my curiosity led me to learn more than just what was taught in classes. We were also later introduced to MATLAB and EES, and I even learned a bit of #Python in order to help a friend of mine.
But as the course became more and more time consuming, I started to drift away from that passion, and focus more on the other disciplines, and only sparingly did I delve into anything related to programming.
First job
As I graduated, I soon got a #job in mechanical design, modeling industrial equipment and parts and its drafts for production. As I had little time for studying, programming was put aside for a while, and all the focus was put into this job.
I learned a lot at this job, and managed to build a lot of resources for accelerating, and even automating tasks, and that kept me reminded of how much I liked to solve problems like these. I even got to the point of learning some #bash script in order to automate the creation of folders in the company's server (which did not end up very well, due to the lack of some quotes hehe). Though the script caused some problems, it was solved in the end (and I learned the important lesson of debugging everything very thoroughly).
Reigniting an old passion
At some point between then and now, I learned of the existence of a "new" game engine called #Godot. I had never made any #games, and had never used a game engine before either, but I had had some contact with #FOSS (free and open source softwares), like #blender and #inkscape, and that one caught my attention, since I had always wanted to create games. Since it was free, super lightweight, I decided to give it a go. It felt so good to learn that tool, and programming in it reminded me of how much I liked to code.
Back then, a friend of mine was also interested in making a game, and he wanted to be more focused on the story part of it, which was perfect since I wanted to focus on the programming and possibly the art and music for it. We started to work on the idea, got a ton of references, and started building the overall scope and story, until one day we lost momentum and just couldn't get back to it. Our jobs were sucking too much energy, and we decided to put it aside until we had more time to do it properly.
#SQL and the leap of faith
After some more years of working with 3D modeling, the company where I was working decided to implement an ERP system. The problem was they didn't have anyone from the inside who was qualified for some of the tasks that would appear, and they tasked me with dealing with those problems.
I had never worked with an ERP system, but had some idea of how #databases worked, and that helped a lot in making some decisions early on (like not entrying all data manually). I had to learn how to bulk clean old data from another system they had used before, which had been fed by many different people, with a lot of mistakes and inconsistencies.
After that, I had to import all that data into the system, and I decided it was time to learn SQL so I could query the database properly when I needed information. And that once again triggered my interest in programming, leading to my decision to make new templates for the engineering team.
These templates used programming for automating some of the tasks, in a language specific for the modeling software,reducing many of the steps in the project pipeline, and making it easier to input new equipment in the system.
As I became more and more #tired of some problems at work, and got more interested in programming again, I made the decision of focusing in relearning the languages I had contact with, and while searching for resources, I was informed that #Harvard offered this course online, called #CS50
For a few months I tried, and was unable to #study in my spare time. So ultimately, I decided to #quit my job, finish CS50, and start a career in programming.
Paying the #bills
With only the final project from the course left, money was running short, and bills were still appearing, so I had to start looking for jobs, and I ended up getting another job in mechanical design. The difference now is that it is much closer to home, so I will be able to finish my final project on my spare time, and keep looking for #junior roles in programming.
Epilogue: The Final Project
Since this toot is ridiculously long already, I may as well talk about the final project for whoever got to this part haha
The idea for the project is to mix a bit of #gamedev with #webdev, making a site with three main areas containing mini-games in three different styles, from #ASCII to one with actual graphics. If all goes well, I also wanted to enable players to get a score, and keep that in a database, if the player so desires. #Backend is being done in python with #flask, #frontend is using templates from flasks #jinja, but mostly plain #HTML #CSS and #javascript
The Advantages Of Flexible Typing https://www.sqlite.org/flextypegood.html | https://lobste.rs/s/irawiz #compsci #databases
I've been looking at distributed #sql #databases for a while, like #cockroachdb and #yugabytedb. Does anyone have any experience running these on prod? What are the foot guns one might encounter while running these databases ?
Explaining The Postgres Meme https://www.avestura.dev/blog/explaining-the-postgres-meme | https://lobste.rs/s/1rbawx #databases #math
This looks like a lovely successor to innotop: Dolphie - an intuitive feature-rich terminal tool for monitoring #MySQL in real-time
#python #opensource #databases #monitoring #cli #terminal
https://percona.community/blog/2023/08/22/dolphie-your-real-time-mysql-monitoring-assistant/
Data scientists and cancer specialists demonstrate a data encryption technique that makes possible real-world cancer data sharing while preserving individual privacy.
https://sciencebusiness.technewslit.com/?p=45103
#News #Press #Science #Business #Collaboration #RealWorldEvidence #Cancer #MedicalRecords #Databases #MachineLearning #Algorithms #ComputerScience #Engineering #Privacy #Encryption #Israel
🔴 We're live
Christian Glassiognon is here on #TeachJennTech to break down all things queries.
#TechTuesday #QueriesUnleashed #databases #datainfrastructure #learninglive #100devs
It's today! 🎉
Christian's here on #TeachJennTech to break down all things queries. 🧐
⏰ Grab your questions and meet us at 11a PST | 2p EST | 6p UTC | 8p CEST
📍 https://twitch.tv/jennjunod
#TechTuesday #QueriesUnleashed #QueriesWithChristian #databases #datainfrastructure #learninglive #100devs
Reminder alert! 🚨
Tomorrow, Christian @_heyglassy joins me on Teach Jenn Tech to unravel the mysteries of queries.
⏰ Set those reminders for 11a PST | 2p EST | 6p UTC | 8p CEST
📍 https://twitch.tv/jennjunod
#QueriesWithChristian #TechTalk #databases #datainfrastructure #learninglive #100devs
Hello beautiful humans!
Christian's @_heyglassy coming on #TeachJennTech livestream, & we're diving into questions about queries 🧐
⏰ 11a PST | 2p EST | 6p UTC | 8p CEST
📍 https://twitch.tv/jennjunod
#QueriesWithChristian #databases #datainfrastructure #learninglive #100devs
Scaling Postgres to 1 Million Connections
https://supabase.com/blog/supavisor-1-million
Discussions: https://discu.eu/q/https://supabase.com/blog/supavisor-1-million
Things #databases Don't Do - But Should
20x faster pgvector alternative written in Rust
https://github.com/tensorchord/pgvecto.rs
Discussions: https://discu.eu/q/https://github.com/tensorchord/pgvecto.rs
💖post from @joelle reminded me of #library #book:
#Information #Activism: A #Queer #History of #Lesbian #Media Technologies by Cait McKinney.
From the publisher: “…how these #women developed communication #networks, #databases & digital #archives… #activists brought people and their visions of #justice together… media technologies animate the collective and unspectacular #labor that sustains social movements, including their #antiracist and #trans-inclusive endeavors.”
So I'm back from sailing and today is PGSQL Phriday (weird spelling I know) and the topic for today's community Postgres blogging event is "Partitioning vs. Sharding", a topic that is right up my alley!
So here is my blog contribution on Understanding Partitioning and Sharding in Postgres, featuring the Citus database extension in the sharding section of course!
#PostgreSQL #PGSQLPhriday #Citus #databases #OpenSource #blogging #Postgres
A bit of a programmer rant...
People wonder why I like ORMs even when they're unnecessary. Firstly, I've never liked SQL. I think that writing queries to a RDBMS is something that a computer should do, akin to compilation. In the few times when extreme optimization is warranted, low level code can be generated to suit that specific case. In other times, ORMs usually provide a more natural interface to data that increases readability and code flow.
#programming #rant #sql #databases #orm
1/2
Repeating Yourself Thrice Doesn’t Turn You Into a 3x Developer https://yrashk.medium.com/repeating-yourself-thrice-doesnt-turn-you-into-a-3x-developer-a778495229c0 | https://lobste.rs/s/lxp7ys #api #databases #practices #scaling
#Development #Findings
State of Databases 2023 · Favorite database technologies of thousands of developers worldwide https://ilo.im/14ej66
_____
#Survey #Databases #WebTechnologies #WebDevelopment #WebDev #Backend #Code #SQL #ORM #Hosting #DataWarehouses #ClientTools #AdminTools #BiTools
Starting every moment ... if you have experience with #Databases, #MariaDB / #MySQL specifically, please consider to join us :)
In general, tables in relational #databases should have:
Research in programming Wikidata https://en.m.wikiversity.org/wiki/Research_in_programming_Wikidata | https://lobste.rs/s/bsn3gy #book #databases #science
Sometimes #postgresql feels like the #emacs of #databases. It has so many crazy features and yet I've never had comfortable muscle memory in it, so it always takes me longer to do about anything vs some flavor of #mysql (or #vim, depending on which tract you followed to get here).
What is database-as-a-service (DBaaS)? https://silverliningsinfo.com/apps-services/what-database-service-dbaas by @sjvn
#Cloud Databases as a Service make using #databases much easier, but that's not the same thing as easy.
Yet another question... what's the Squarespace/WordPress of databases?
Been bumping into all these cool new museums/independent research orgs people are starting up and I really feel they deserve better than the bloated crap sold at museum expos that the big institutions are currently saddled with...
I got nerdsniped by @tef & @sushee to demonstrate how relatively easy it is to build a CRAQ (https://timilearning.com/posts/mit-6.824/lecture-9-craq/) system atop @couchdb — Showing that as much as CouchDB is a distributed database in itself, it is also a very nice toolkit to build other kinds of distributed databases with it :)
The demo is in Node.js with some private JS/HTTP API glue that is not relevant to the demo: https://gist.github.com/janl/d0ba3544631e054e59fbd5f4d3ee96f8
Let me know if you ahave any questions.
The topic for this month's podcast for developers who love Postgres (aka "Path To Citus Con") is:
> My favorite ways to learn more about Postgres
When?
> Live podcast recording will happen on Discord on Wed 12 July @ 10am PDT
Guests = @ryanbooz & Grant Fritchey
Hosts = myself & Pino de Candia
Join us! And please boost so more people discover it! Calendar invite w/details on how to join https://aka.ms/PathToCitusCon-Ep05-cal
#PostgreSQL #Postgres #podcast #discord #databases #SQL #microsoft #OpenSource
Doing an online course on #Databases - I'm a bit rusty on #SQL queries. I'll be trying #Docker for the first time to create a DB test environment. Weird that I haven't tried it before, suppose having access to your own VM means less faffing around via a desktop machine. Also probably put off by all the girning I see on social media relating to Docker. Almost every day someone in my feed will complain about some setting or other that caused calamity and lost time...what delights/horrors await? 🤯
Got some time this Saturday? Check out Cory Doctorow's linkblog @pluralistic long thread: https://mamot.fr/@pluralistic/110520863461422021 also https://pluralistic.net/2023/06/10/in-the-dumps/#do-the-humpty-dump
In his inimitable style Cory shares some of his takes on #Pride month, #AIHype, #WIPO, the #news industry, #databases and #ScienceFiction
Primate Genome A.I. Model IDs Human Disease Variants
A #genomic systems company created an artificial intelligence #algorithm from #primate genomic data that identifies possible disease-causing #mutations in humans.
https://sciencebusiness.technewslit.com/?p=44852
#News #Science #Business #ArtificialIntelligence #MachineLearning #Databases #Proteins #AlphaFold #NeuralNetwork #Sequencing #Collaboration
Bruce Momjian of EDB is a prolific PostgreSQL presenter 🔥 and the organizers of Citus Con: An Event for Postgres were thrilled he gave a talk at Citus Con.
So today's Citus Con video of the day is from Bruce! If you are looking for a solid primer on Postgres & the Artificial Intelligence landscape, Bruce's #CitusCon talk 📺🎙️ is the place to start.
https://aka.ms/cituscon-brucem-2023
#PostgreSQL #Postgres #CitusCon #databases #artificialintelligence
It's the last day of May and today's #CitusCon video of the day is by @cyberdemn of Microsoft, who is the lead of the Patroni project for PostgreSQL...
If you want to learn about the key to scalable (horizontally scalable) & fault-tolerant PostgreSQL, watch this talk (and demo) about Citus and Patroni.
https://aka.ms/cituscon-alexanderk-2023
#PostgreSQL #Citus #databases #Patroni #Microsoft #OpenSource #HighAvailability
Writing a chat application in Django 4.2 using async StreamingHttpResponse, Server-Sent Events and…
https://valberg.dk/django-sse-postgresql-listen-notify.html
Discussions: https://discu.eu/q/https://valberg.dk/django-sse-postgresql-listen-notify.html
Today's #CitusCon video of the day 📺 was presented by Postgres committer @tmunro who I am privileged to work with at Microsoft.
It's all about Parallelism in PostgreSQL. With a lovely sock analogy to boot. Thomas is such a good explainer & teacher, hope y'all enjoy it.
https://aka.ms/cituscon-thomasm-2023
#PostgreSQL #Postgres #databases #database #conference #OpenSource #Microsoft
Collaboration to Boost Rare Disease Clinical Trials
An organization seeking new uses for today's #drugs and a contract #research company aim to increase the number of clinical trials for rare diseases testing already approved drugs.
https://sciencebusiness.technewslit.com/?p=44782
#News #Business #Science #ClinicalTrials #Collaboration #RareDisease #ArtificialIntelligence #Algorithms #Databases #CRO #Generics
I do rather love being able to run tail¹ on my database tables² as I work on building Domain³ with Kitten⁴ ;)
(JSDB keeps tables in an append-only JavaScript log which are read fully into memory when the database is opened. And yes, if you noticed the class names, you can store custom objects.)
¹ Actually: tail -f <database path>/table.js | bat --paging=never --language=js
² https://codeberg.org/small-tech/jsdb
³ https://codeberg.org/domain/app
⁴ https://codeberg.org/kitten/app
Everyday applications need to do a lot more than just short reads and writes.
❓ So how do we handle mixed workloads with fewer #databases?
👀 Watch our on-demand webinar to find out: https://bit.ly/3zmLnyZ
The “Build Your Own Database” book is finished https://build-your-own.org/blog/20230420_byodb_done/ | https://lobste.rs/s/gibx9w #databases #go #programming
@selfcare just yesterday when I attended and spoke at the brilliant #PGDay #Chicago ♥️:postgresql:
#postgres #postgresql #opensource #database #databases
Ouch, the startup I joined last year could not get funding, so I need to get a new job... I would love to continue working with #rustlang but I'm also experienced in software architecture, #java, relational and graph #databases... I'm working remotely from the South of France, I've worked in small startups and big companies so I can adapt. Just DM me if you need somebody like me!
My product team at Google just released a downloadable edition of #AlloyDB, its #PostgreSQL-compatible database engine loaded with lots of neat features like an index advisor and a columnar engine and so on and suchlike.
It's in preview! You can install it on any newish RHEL or Debian-like and try it out for free.
https://cloud.google.com/blog/products/databases/run-alloydb-anywhere
I co-authored the docs, by gar.
What entry-level courses/tutorials/guides do people recommend for learning SQL basics for web apps: schema design, foreign keys, relationships, but also: how to express these this in ORMs and DB migration tooling. Postgres flavour preferred, but any will do. #sql #databases #BoostsOk
It looks like the campus subscription to Quorum is on the chopping block. What are some affordable option for government policy and regulation tracking in the US (state and federal)?
Thanks in advance!
I'm a sucker for #StateOf posts. Lee Robinson (of #Vercel) has a concise article on the state of #databases for #serverless and #edge I enjoyed: https://leerob.io/blog/backend
ICYMI, I'm speaking about debugging in production at #QConLondon later this month.
The lovely organisers have set me up with a discount code, so if you'd like an extra £50 off your ticket, use code ChrisSQUK2350 when buying your ticket (https://qconlondon.com/registration/event/1)! Early bird ends on the 6th.
Really excited about this one. Hope to see you there ✌🏻💖