Streaming Data Engineer Claude Skill

Name: Bartosz - Streaming Data Engineer AI Skill
Brand: KissMySkills
Price: 29.0 USD
Availability: InStock

Bartosz - Streaming Data Engineer AI Skill

$29.00

$29.00 $43.99

Bartosz - Streaming Data Engineer AI Skill

$29.00 this skill vs $43.99 hiring a senior streaming data engineer

Complete skill package instant downloadbartosz-streaming-data-engineer.skill

Works with

Choose how to get it

Buy once $29 This one skill as a file. Yours forever, works in any AI chat. All-Access whole library $8.25/mo billed yearly All 1,000+ skills in the marketplace. Your AI picks the right one and loads it by itself. Claude, ChatGPT, Claude Code, Cursor · or $19 month to month

Secure checkout by Shopify

⚡ Instant download ∞ Keep forever ✎ Written by us

Add it once. Your AI works like a specialist.

Add it to Claude, ChatGPT or Gemini - your AI works as a specialist in this field.

Instant download · 30-day money-back guarantee. Pay once, keep forever - no subscription. Written and tested by us, never scraped from GitHub. Refund policy

Ask Bartosz something hard.

📎 bartosz-streaming-data-engineer.md LOADED ✓

Kafka consumer lag grows by 2M messages every evening peak, catches up by 3am. Product wants sub-minute freshness. Cheapest path?

CLAUDE · AS BARTOSZ, STREAMING DATA ENGINEER Lag that self-heals overnight is throughput, not a bug - check partition count first: if the hot topic has 6 partitions, consumer parallelism caps at 6 no matter how many instances you add. Then the consumer itself: synchronous per-message processing - an HTTP call per event is the classic - caps you at hundreds per second; batch the sink writes and it's tens of thousands. Repartitioning the hot topic to 24-48 plus batched writes usually erases a 2M backlog pattern without new hardware. Keep exactly-once only where the sink truly needs it - it costs throughput. What does the consumer do per message today?

Questions before you buy?

Write to us and a person answers - usually the same day. Not a bot, not a ticket queue.

hello@kissmyskills.com

Trademarks of their respective owners. KissMySkills is not affiliated with or endorsed by them.

You don't read it. Your AI does.

Add the skill file to Claude, ChatGPT or Gemini once. From then on it works as a specialist in this field and answers as Bartosz from the very next message.

Buy once and the file is yours to keep forever. Or subscribe to All-Access and let the KissMySkills connector load it, and every other skill, into your chat on request.

// what's inside

What's inside this skill

Event-time and watermark design for late data
Exactly-once and checkpointing plan for the pipeline
A diagnosis of where the duplicates come from
Operational runbook for restarts and backfills

Data engineers running Kafka and Flink pipelines without a streaming specialist

A senior streaming data engineer bills $130+/hr, the complete skill is yours forever.

// what's inside

What you're actually buying

Senior Streaming Data Engineer who treats real-time pipelines as a distinct discipline, not batch processing running faster.

Bartosz covers the full real-time pipeline surface: Kafka and Flink cluster and topic design, exactly-once versus at-least-once processing tradeoffs, schema registry and schema evolution (Avro/Protobuf), consumer group and partition strategy, backpressure and consumer lag monitoring, streaming-to-warehouse landing patterns (CDC, Kafka Connect, streaming inserts), and stream processing job design (windowing, watermarks, stateful aggregation).

Who it's for

Data engineers, platform leads, and streaming-pipeline owners who need Kafka/Flink topic design, processing guarantees, and lag monitoring tied to real freshness and ordering requirements, not a copy-pasted default.

Key capabilities

Kafka/Flink topic, partition, and processing-guarantee design mapped to real duplicate/drop cost
Schema registry compatibility checks that catch a downstream consumer break, not just a registry pass
Per-partition consumer lag and backpressure monitoring, not misleading aggregate lag
CDC, Kafka Connect, or streaming-insert landing pattern chosen per freshness and volume need
Windowing, watermark, and checkpoint/savepoint recovery design verified before go-live

How to use it

Paste Bartosz's SKILL.md into your Claude Project Instructions (or any AI system prompt), then describe your Streaming Data Engineer problem. Works with Claude, ChatGPT, and any AI chat. Under 2 minutes to install.

// how to install Under 2 minutes

Four steps. Any AI chat.

01
Download the file
After checkout, the download link lands in your inbox. Save the file anywhere on your device.
02
Open your AI chat
Claude, ChatGPT, Gemini, Grok, or Copilot - whichever one you already use.
03
Paste the file contents
Drop it into the system prompt, Project instructions, or custom instructions field.
04
Start working
Your AI is now configured as a specialist. Ask it anything inside its domain.

No technical knowledge required. No subscription. Pay once, keep forever.

// compatible with

Works with every major AI chat.

Drop the file into your AI's system prompt, Project instructions, or custom instructions. No setup. No code. No vendor lock-in.

// faq

Questions about this product

What AI tools does this work with?+

Claude, ChatGPT, or any AI chat that accepts a system prompt or project instructions. Claude Projects gives the best results.

How do I install it?+

Paste the SKILL.md content into your Claude Project Instructions or your AI's system prompt. Under 2 minutes, no setup required.

Is this a course or a tool?+

It's a skill file, not a course. One file that turns your AI into a configured Streaming Data Engineer ready to work on your Streaming Data Engineer problem immediately.

Our consumer lag looks fine on average but something is clearly falling behind, what does Bartosz check?+

Bartosz never trusts an aggregate lag number. He checks per-partition consumer lag directly, since a single stuck partition hides completely inside a healthy-looking average, and that's the failure mode he flags first.

Do I have to read it myself?+

No. The file is written for your AI to read, not for you. Upload it or paste it in once and the AI takes on the role. After that you just ask it questions the way you normally would. You're welcome to open it and read it, but nothing here depends on you doing that.

Is this a physical book?+

No, it's digital. You download it the moment the order goes through and it's yours permanently. The cover is styled like a book because each edition is written and edited as one self-contained piece of work. The reading part is your AI's job, not yours.