Here’s what we’ve been up to in the closing weeks of 2022. ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌
Aiven monthly update 2022-21-12
Email not displaying correctly?
View it in your browser
2022 is so last year (almost)
Hi, 

The end of the year approaches! It’s cold outside. Or hot. Or, you know, sort of the same as most of the year because that’s how planets work. Anyway, it’s been a busy year and we’ve been happy to share it with you.

Let’s take a last look at some big firsts – and what’s on the horizon for us in 2023.
fire-solid   Aiven for ClickHouse® now generally available
(2 min read)

Since the introduction of the beta version of the service just 3 months ago, we’ve worked with the beta testers to iron out the glitches and implement new capabilities. ClickHouse is now a fully-supported part of the integrated, open source data service stack we provide on our platform. 

One of the early adopters of Aiven for ClickHouse was Chatlayer by Sinch, a company that provides AI-powered chatbot solutions to their customers. The Chatlayer solution includes advanced analytics capabilities that provide insights into the customers’ conversations with their end users.

“We were positively surprised with the performance of Aiven for ClickHouse - it is really fast. And thanks to the excellent data compression, we were able to save on costs compared to our previous solution.” – Miguel Carvajal, Technical Lead at Chatlayer. 

 
rocket-solid  8 tips to speed up Apache Kafka® Connect development
(8 min read)

Defining Apache Kafka® Connect connectors might feel like dark magic at times. One of the essentials for building a successful connector is to make sure all the arcane rituals are performed:
 
✔️ Put all the required JAR dependencies in the right folder 
✔️ Check the network paths
✔️ Evaluate the credentials and privileges
✔️ Validate that required objects are in place


Read the full guide to master the wizardry of building fast, scalable, and resilient streaming data pipelines.
Tip! 💡

Now that you know how to speed up Apache Kafka® Connect development, try producing data into Apache Kafka® from your favourite language: 
  • Python Jupyter Notebooks for Apache Kafka®
  • Hands-on material for session "Apache Kafka simply explained" (Java version)
Laptop-solid.png  Your cloud platform isn't future-proof without an API
(3 min read)

Complete your perfect cloud platform: APIs open the door to third-party extensions, and also give you the freedom to build integrations as you scale. 
rocket-solid  Get to know the Aiven API with Postman®
(5 min read)

At Aiven we'd love you to get to know our API, so we created a Postman® collection to help you get started. If you haven't used Postman before, it's a friendly interface for humans to work with APIs. We use it ourselves, so we created something you could use too.
In this post, you'll learn about using Postman to take your first steps with the Aiven API.
coffee-solid   Use our recipes to cook yourself up a resilient data infrastructure with Terraform

Are you using Terraform to manage data infrastructure? We’ve put together some of the most common Terraform setups for you, complete with sample code:

⭐ Apache Kafka® and OpenSearch® - take data from Kafka and ingest it into OpenSearch using Apache Kafka Connect.
⭐ Multicloud PostgreSQL® - set up three highly-available PostgreSQL databases in three regions and across different cloud providers.
⭐ Apache Kafka® and Apache MirrorMaker - replicate your data across Kafka clusters for disaster recovery.

... and more! Check out the
Aiven Terraform cookbook. 
Laptop-solid.png  Solving problems with event streaming
(5 min read)

Nick Chiu, CTIO of
James Job AG, talks about how the “event first” mindset made their application become more resilient, stable and flexible. 

Nick’s piece came to us through the
Aiven Technical Content Contribution Program. If you have any open source, data technology-related topics in mind, and want to share your thoughts with the wider Aiven community, submit a piece and we’ll get to work!
It’s never too early for a new year’s resolution, and – as you might have guessed – one of ours just has to be about supporting and expanding the open source world.

Is it lazy if you make a resolution about something you wanted to do anyway? Or is it clever optimization and leveraging of proficiency streams? We think it’s that second thing.
  • ​​​​​We decided to refresh our Open Source resources - meet the new Open Source page! Read all about our core values and open source projects, and check out the spotlight of our open source developers and engineers. 
  • We didn’t just stop there; we also created a dedicated page for our OSPO team! Meet Aiven’s OSPO team, learn about the projects we own and the projects we contribute to daily.
  • Want to dig even deeper into our open source mission? Aiven contributes back to the Apache Kafka® community with a dedicated full-time team. Read more in our blog!
  • We released a new version of the Slack connector for Apache Flink®. 
  • The OpenSearch Community Meeting 11-22-22 featured 3 projects from Aiven: 
    • Aiven's OpenSearch® Connector for Apache Kafka®
    • Prometheus Exporter Plugin for OpenSearch®
    • Encrypted Repository Plugin for OpenSearch®.
  • Ronan Dunklau, Senior Software Engineer at Aiven, joined the Postgres Open Talks series and talked about the PGTracer tool, developed and maintained by Ronan. Watch his episode: Building a perf-like tool for PostgreSQL.
  • Joining the FOSS Backstage in March 2023? Aiven has lots of exciting talks lined up with Josep Prat, Claude Warren Jr, Ahmed Sobeh, and Floor Drees. Check out our sessions! ​​​​
bookmark-solid  Worth a look

Yep, it’s been a year. But we can’t wait to do it all again – and that’s not even all we have for you this time! If you’re still looking for tips and info, we’ve got you covered.
 
  • Are you building a new application or looking to upgrade an existing one? Then you could use this tutorial on integrating Apache Kafka® using Python libraries (code examples included!) by our Senior Developer Advocate and gastronomic hero Francesco Tisiot.
  • What’s Next for Data Engineering in 2023? Check out these 7 Predictions by Barr Moses. 
  • A release of kcctl 1.0.0.Beta1 - Your Cuddly CLI for Apache Kafka® Connect 🧸
  • Benchmarking SQLite Performance in Go by Markus Wüstenberg - SQLite has a bit of a reputation as a “toy database” useful only for hobby projects and integration tests. Find out why this is not true, with data to back it up.
  • Fun stats: Take a look at the volume of data created, captured, copied, and consumed worldwide from 2010 to 2020, with forecasts from 2021 to 2025.
 
That's it, folks!
Thanks for reading! We’re curious to hear your feedback on Aiven’s latest newsletter. Reply with a couple of words to this email, and help us improve!
Facebook    linkedin    twitter    youtube

Aiven.io |  Antinkatu 1,  Helsinki,  Uusimaa,  Finland

You received this email because you are subscribed to emails from Aiven.io. 
Don’t want this email? No worries!
Update your email preferences to unsubscribe.
 
crabby