Aiven monthly update 2022-21-12 | | | | 2022 is so last year (almost) | | | Hi,
The end of the year approaches! It’s cold outside. Or hot. Or, you know, sort of the same as most of the year because that’s how planets work. Anyway, it’s been a busy year and we’ve been happy to share it with you.
Let’s take a last look
at some big firsts – and what’s on the horizon for us in 2023. | | | Aiven for ClickHouse®
now generally available (2 min read)
Since the introduction of the beta version of the service just 3 months ago, we’ve worked with the beta testers to iron out the glitches and implement new capabilities. ClickHouse is now a fully-supported part of the integrated, open source data service stack we provide on our platform.
One of the early adopters of Aiven for ClickHouse was Chatlayer by Sinch, a company that provides AI-powered chatbot solutions to their customers. The Chatlayer solution includes advanced analytics capabilities that provide insights into the
customers’ conversations with their end users.
“We were positively surprised with the performance of Aiven for ClickHouse - it is really fast. And thanks to the excellent data compression, we were able to save on costs compared to our previous solution.” – Miguel Carvajal, Technical Lead at Chatlayer. | | 8 tips to speed up Apache Kafka® Connect development (8 min read)
Defining
Apache Kafka® Connect connectors might feel like dark magic at times. One of the essentials for building a successful connector is to make sure all the arcane rituals are performed: ✔️ Put all the required JAR dependencies in the right folder ✔️ Check the network paths ✔️ Evaluate the credentials and privileges ✔️ Validate that required objects are in place
Read the full guide to master the wizardry of building fast, scalable, and resilient streaming data pipelines. | | | Tip! 💡
Now that you know how to speed up Apache Kafka® Connect development, try producing data into Apache Kafka® from your favourite language: | | | | Your cloud platform isn't future-proof without an API (3 min read)
Complete your perfect cloud platform: APIs open the door to third-party extensions, and also give you the freedom to build integrations as you scale. | | Get to know the Aiven API with Postman® (5 min read)
At Aiven we'd love you to get to know our API, so we created a Postman®
collection to help you get started. If you haven't used Postman before, it's a friendly interface for humans to work with APIs. We use it ourselves, so we created something you could use too. In this post, you'll learn about using Postman to take your first
steps with the Aiven API. | | Use our recipes to cook yourself up a resilient data infrastructure with Terraform
Are you using Terraform to manage data infrastructure? We’ve put together some of the most common Terraform setups for you, complete with sample code:
⭐ Apache Kafka® and OpenSearch® - take data from Kafka and ingest it into OpenSearch
using Apache Kafka Connect. ⭐ Multicloud PostgreSQL® - set up three highly-available PostgreSQL databases in three regions and across different cloud providers. ⭐ Apache Kafka® and Apache MirrorMaker - replicate your data across Kafka clusters for disaster recovery.
... and more! Check out the Aiven Terraform cookbook. | | Solving problems with event streaming (5 min read)
Nick Chiu, CTIO of James Job AG, talks about how the “event first” mindset made their application become
more resilient, stable and flexible.
Nick’s piece came to us through the Aiven Technical Content Contribution Program. If you have any open source, data technology-related topics in mind, and want to
share your thoughts with the wider Aiven community, submit a piece and we’ll get to work! | |
|
It’s never too early for a new year’s resolution, and – as you might have guessed – one of ours just has to be about supporting and expanding the open source world.
Is it lazy if you make a resolution about something you wanted to do anyway? Or is it clever optimization and leveraging of proficiency streams? We think it’s
that second thing. - We decided to refresh our Open Source resources - meet the new Open Source page! Read all about our core values and open source projects, and check out the spotlight of our open source developers and engineers.
- We didn’t just stop there; we
also created a dedicated page for our OSPO team! Meet Aiven’s OSPO team, learn about the projects we own and the projects we contribute to daily.
- Want to dig even deeper into our open source mission? Aiven contributes back to the Apache Kafka® community with a dedicated full-time team. Read more in our blog!
- Ronan Dunklau, Senior Software Engineer at Aiven, joined the Postgres Open Talks series and talked about the PGTracer tool, developed and maintained by Ronan. Watch his episode: Building a perf-like tool for PostgreSQL.
- Joining the FOSS Backstage in March 2023? Aiven has lots of exciting talks lined up with Josep Prat, Claude Warren Jr, Ahmed Sobeh, and Floor Drees. Check out our sessions!
| | |
Worth a look Yep, it’s been a year. But we can’t wait to do it all again – and that’s not even all we have for you this time! If you’re still looking for tips and info, we’ve got you covered.
- Are you building a new application or looking to upgrade an existing one? Then you could use this tutorial on integrating Apache Kafka® using Python libraries (code examples included!) by our Senior Developer Advocate and gastronomic hero Francesco Tisiot.
- Benchmarking SQLite Performance in Go by Markus Wüstenberg - SQLite has a bit of a reputation as a “toy database” useful only for hobby projects and integration tests. Find out why this is not true, with data to back it up.
- Fun stats: Take a look at the volume of data created, captured, copied, and consumed worldwide from 2010 to 2020, with forecasts from 2021 to 2025.
| | | Thanks for reading! We’re curious to hear your feedback on Aiven’s latest newsletter. Reply with a couple of words to this email, and help us improve! | | | | | |