Free AI web copilot to create summaries, insights and extended knowledge, download it at here

5243

Abstract

name">C:\Users\feng\Kafka\kraft>ls docker-compose.yml C:\Users\feng\Kafka\kraft>docker-compose up -d [+] Running 2/2

Network kraft_default Created 0.0s
Container kraft-kafka-1 Started

C:\Users\feng\Kafka\kraft>docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 54342e49a1f2 bitnami/kafka:latest "/opt/bitnami/script…" 18 seconds ago Up 17 seconds 0.0.0.0:9092->9092/tcp kraft-kafka-1 0.5s</pre></div><h2 id="095a">1.5 Create Kafka topic</h2>We’ll login to the instance and create a test topic in Kafka<div id="aaf2"><pre>## Login to Kafka docker instance C:\Users\feng\Kafka\kraft>docker exec -it kraft-kafka-1 /bin/bash $cd /opt/bitnami/kafka /opt/bitnami/kafka$ ./bin/kafka-topics.sh --version 3.4.0 (Commit:2e1947d240607d53)

## Create topic named "test_topic" /opt/bitnami/kafka$ ./bin/kafka-topics.sh --bootstrap-server localhost:9092 --create --replication-factor 1 --partitions 2 --topic test_topic WARNING: Due to limitations in metric names, topics with a period ('.') or underscore ('_') could collide. To avoid issues it is best to use either, but not both. Created topic test_topic.

## List current topics /opt/bitnami/kafka$ ./bin/kafka-topics.sh --bootstrap-server localhost:9092 --list test_topic</pre></div>So by now we have a Kafka docker instance running successfully.<h1 id="80ee">2 Run sanity checks using simple producer/consumer app codes</h1><h2 id="b504">2.1 Setup producer/consumer Dev ENV</h2><div id="8e5b"><pre>## Create conda env for Kafka producer and cosumer C:\Users\feng\Kafka\kraft>conda create -n kafka_env python=3.10 ... C:\Users\feng\Kafka\kraft>conda activate kafka_env

Install kafka-python package

(kafka_env) C:\Users\feng\Kafka\kraft>pip install kafka-python ... (kafka_env) C:\Users\feng\Kafka\kraft>pip list | grep kafka kafka-python 2.0.2

Install Faker package to generate dummy messages

(kafka_env) C:\Users\feng\Kafka\kraft>pip install Faker ... (kafka_env) C:\Users6119811\Kafka\kraft>pip list | grep Faker Faker 17.3.0</pre></div><h2 id="6701">2.2 Code examples</h2>Now we can use VSCode to create producer/consumer files.Producer generate fake user info as JSON load sending to Kafka topic “test_topic”. producer.py is like following.<div id="8801"><pre>import time import json from datetime import datetime from kafka import KafkaProducer from faker import Faker

# JSON messages needs to be serialized # when sending to Kafka topic def json_serializer(message): return json.dumps(message

Options

).encode('utf-8') # Kafka Producer producer = KafkaProducer( bootstrap_servers=['localhost:9092'], value_serializer=json_serializer ) if name == 'main': fake = Faker() for i in range(0, 3): # Generate a fake JSON message name = fake.name() email = fake.email() city = fake.city() fake_message = { "name": name, "email": email, "city": city }

    <span class="hljs-comment"># Send fake JSON message to Kafka topic</span>
    <span class="hljs-built_in">print</span>(<span class="hljs-string">f'<span class="hljs-subst">{datetime.now()}</span>: Message = <span class="hljs-subst">{<span class="hljs-built_in">str</span>(fake_message)}</span>'</span>)
    producer.send(<span class="hljs-string">'test_topic'</span>, fake_message)
                                                          
    time.sleep(<span class="hljs-number">1</span>)</pre></div><p id="6594">And here is our consumer.py</p><div id="a19b"><pre><span class="hljs-keyword">import</span> json

from kafka import KafkaConsumer

if name == 'main': # Kafka Consumer consumer = KafkaConsumer( 'test_topic', bootstrap_servers='localhost:9092', auto_offset_reset='earliest' ) for message in consumer: print(json.loads(message.value))</pre></div>OK, now let’s start consumer and run producer to send some fake message for a sanity check.<div id="572f"><pre># Run producer (kafka_env) C:\Users\feng\Kafka\kraft>python producer.py 2023-02-25 18:48:41.143953: Message = {'name': 'Susan Best', 'email': '[email protected]', 'city': 'Kellytown'} 2023-02-25 18:48:42.160545: Message = {'name': 'James Wilson', 'email': '[email protected]', 'city': 'Lake Bryanfort'} 2023-02-25 18:48:43.177933: Message = {'name': 'Haley Brooks', 'email': '[email protected]', 'city': 'East Janetburgh'}

# Monitor consumer (kafka_env) C:\Users\feng\Kafka\kraft>python consumer.py {'name': 'Susan Best', 'email': '[email protected]', 'city': 'Kellytown'} {'name': 'James Wilson', 'email': '[email protected]', 'city': 'Lake Bryanfort'} {'name': 'Haley Brooks', 'email': '[email protected]', 'city': 'East Janetburgh'}</pre></div>Great, our Kafka Docker instance and simple applications are working as expected!Happy Reading!<div id="2213" class="link-block"> <a href="https://medium.com/@fengliplatform/membership"> <div> <div> <h2>Join Medium with my referral link - Feng Li</h2> <div><h3>Writing helps ourselves, sharing helps many. It started from study notes for myself with no pressure of perfection…</h3></div> <div>medium.com</div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*K9psL5RefQfuKkzr)"></div> </div> </div> </a> </div></article></body>

How To Edit The Hell Out Of Your Stories So That They’re Great Instead Of Good

Rule #1 — Don’t fall in love with your work

I am my own worst editor. I can’t really tell if my writing is good or bad. I just know that, now that the words are out of my brain and on the page, it’s what I have to work with.

Despite this fact, I still edit my own work.

I have to — for a number of reasons:

I can’t afford to hire a professional editor to review all my ‘masterpieces’. It’s just not financially feasible.
I am very impatient when it comes to publishing my pieces and don’t want to wait for my family and friends to take their sweet time editing my articles.

So I edit my own work even though I really shouldn’t. But after hundreds of articles later, I’ve learned some tricks on how to edit my own work without having blinders on.

Don’t fall in love with your work

Each word, sentence, paragraph has been carefully crafted and chosen. You’ve spent hours, maybe even days creating this beautiful relationship with your work of art.

Editing is like a sad love story.

No matter how beautiful and loving the relationship is, sometimes you just need to let go because it was simply part of the journey and letting go will make you a better person.

Writing and editing is the same.

Sometimes, we need to cut huge chunks of our work in order to make it better.

The only way to edit your work objectively is to not fall in love with it. It’s hard not to when we pour our heart and soul into every sentence but if you want to objectively edit your work, that’s the condition.

Put the piece aside for a few hours or even a day

I am a slow writer so when I finally finish a piece, I just want to hit publish.

But I resist and I wait.

I wait, sometimes, days at a time.

Why do I do this?

Because we always need a fresh pair of eyes to edit our work and if we don’t have the privilege or patience for someone else’s eyes to review our work then it’s our eyes that need to be fresh and ready.
I need time away from my work in order to think about what I just wrote.

Even though I’m not completely objective when I’m my own editor, taking a break gives me fresh or at least rested eyes. The last thing I want to do after spending 5 hours on my computer is to spend another 5 hours staring at the same screen. We need to rest our eyes otherwise we will simply zoom by the editing process because our brain knows when we should take a break and it tries to get you to take it as soon as possible.

Time away also allows me to mull over my piece. Maybe that story isn’t so relevant after all and maybe there’s another story that will drive the purpose home.

Resist the urge to hurriedly edit and publish. We all want to get our works of art out there as soon as possible but the first draft is literally a brain dump. By letting our story breathe, we may be able to inject new life into it.

Read your story or article out loud

The Observer had a very interesting article about why our brain “chunks” information. The process is called typoglycemia. If the first and last letters are stable, the middle letters of any word can be scrambled and your brain can still read the word as if it were spelled correctly. I did this exercise and it really works. Why does our brain do this? Essentially, it’s so it can process a large amount of information more efficiently. If it didn’t do this, we’d spend all our waking days trying to decipher scrambled words and information.

Chunking: The Brain's Shortcut to Understanding and Recalling Information

Aoccdrnig to a rscheearch at Cmabrigde Uinervtisy, it deosn't mttaer in waht oredr the ltteers in a wrod are, the olny…

observer.com

Because of our brain’s need for efficiency, reading your own work in your head is not the best editing technique.

When I reread my story in my head, I have a bad habit of skimming. Coupled with typoglycemia, why edit at all?

When you read your story out loud, you’re forced to slow down and read every word. You can hear when the flow isn’t there or pick up any awkwardness in your piece. You naturally pause where there should be punctuation and where you can lose the comma.

We want to whiz through the editing process but editing is the most important part of writing. Reading our article aloud makes us slow down, breathe, and think — everything our story needs before the world should see it.

Run your story through a free editing tool

This should be the bare minimum.

A lot of people use Grammarly. I use the Hemingway Editor.

When I first started using it, I would forget all the time but now it’s become a habit to run all my pieces through this app before publishing.

My eyes and brain can only catch so much so why not have technology help me out a bit?

Cut out the parts of your life that aren’t relevant to the point you’re trying to make.

We all want to put a personal touch to our articles. People want to know exactly how you went from making $0 to $1,000,000 in a month. We want to tell people our life story because for some of us, it’s much easier to do with pen and paper than it is with our own voices.

Since writing, I’ve found that the world wants to know your story. They want to celebrate and cry with you. But you’re not writing your memoir in 1,000 words. I like to sprinkle bits and pieces of myself in each of my story because I find them relatable to the point I’m trying to make. But I’ll only include them if they make my points stronger.

So be ruthless with your life and cut out anything that doesn’t support the lesson you’re trying to teach or the point you’re trying to make. In the words of Joey Gladstone, “Cut it out.”

Realize that editing is for your audience

Writing is such a personal experience but realize that if you decide to publish your work, once it’s out for the world to see, that article you spent hours or days on is no longer for you — it’s for your readers.

We edit so that our reader have context and clarity. We edit so our readers know what we’re trying to say.

A good writer writes but a great writer can write and edit their own work. They can see the faults in their arguments and make them better. They can see the difference between what’s filler and the ideas that will truly resonate.

Even in writing about how to effectively edit your own work, I’m sure this piece still needs further editing. I’m still trying to become a master editor of my own work.

It’s not easy. It’s not supposed to be.

It’s hard to be objective when writing is a subjective craft. It’s hard to find our own mistakes and figure out how to correct them. It’s hard to edit a portion of our lives out.

The editing process is often seen as an afterthought but it’s really the most important part of transforming ourselves from a good writer into a great one. After all, that’s what editing is all about — transforming something good into something great.

Thanks for reading! If you liked this, you might enjoy this:

How To Know If You’re Meant To Write

A lesson about creating Big Magic

writingcooperative.com

What Happens When Writers Edit Their Own Work

We can’t distinguish the good from the bad

medium.com

Install kafka-python <span class="hljs-built_in">package</span>

Install Faker <span class="hljs-built_in">package</span> to generate dummy messages