avatarFrank T Bird

Free AI web copilot to create summaries, insights and extended knowledge, download it at here

5243

Abstract

name">C</span>:\Users\feng\Kafka\kraft>ls docker-compose.yml <span class="hljs-name">C</span>:\Users\feng\Kafka\kraft>docker-compose up -d [+] Running <span class="hljs-number">2</span>/<span class="hljs-number">2</span>

  • Network kraft_default Created <span class="hljs-number">0.0</span>s
  • Container kraft-kafka<span class="hljs-number">-1</span> Started

<span class="hljs-name">C</span>:\Users\feng\Kafka\kraft>docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES <span class="hljs-number">54342e49</span>a1f2 bitnami/<span class="hljs-name">kafka</span>:latest <span class="hljs-string">"/opt/bitnami/script…"</span> <span class="hljs-number">18</span> seconds ago Up <span class="hljs-number">17</span> seconds <span class="hljs-number">0.0</span><span class="hljs-number">.0</span><span class="hljs-number">.0</span>:<span class="hljs-number">9092</span>-><span class="hljs-number">9092</span>/tcp kraft-kafka<span class="hljs-number">-1</span> <span class="hljs-number">0.5</span>s</pre></div><h2 id="095a">1.5 Create Kafka topic</h2><p id="0672">We’ll login to the instance and create a test topic in Kafka</p><div id="aaf2"><pre><span class="hljs-comment">## Login to Kafka docker instance</span> C:\Users\feng\Kafka\kraft>docker exec -it kraft-kafka-1 <span class="hljs-string">/bin/bash</span> <span class="hljs-keyword">cd</span> <span class="hljs-string">/opt/bitnami/kafka</span> <span class="hljs-string">/opt/bitnami/kafka</span> <span class="hljs-string">./bin/kafka-topics.sh</span> <span class="hljs-params">--version</span> 3.4.0 <span class="hljs-params">(Commit:2e1947d240607d53)</span>

<span class="hljs-comment">## Create topic named "test_topic"</span> <span class="hljs-string">/opt/bitnami/kafka</span>$ <span class="hljs-string">./bin/kafka-topics.sh</span> <span class="hljs-params">--bootstrap-server</span> localhost<span class="hljs-function">:9092</span> <span class="hljs-params">--create</span> <span class="hljs-params">--replication-factor</span> 1 <span class="hljs-params">--partitions</span> 2 <span class="hljs-params">--topic</span> test_topic WARNING: Due to limitations in metric names, topics with a period <span class="hljs-params">('.')</span> or underscore <span class="hljs-params">('_')</span> could collide. To avoid issues it is best to use either, but not both. Created topic test_topic.

<span class="hljs-comment">## List current topics</span> <span class="hljs-string">/opt/bitnami/kafka</span>$ <span class="hljs-string">./bin/kafka-topics.sh</span> <span class="hljs-params">--bootstrap-server</span> localhost<span class="hljs-function">:9092</span> <span class="hljs-params">--list</span> test_topic</pre></div><p id="8304">So by now we have a Kafka docker instance running successfully.</p><h1 id="80ee">2 Run sanity checks using simple producer/consumer app codes</h1><h2 id="b504">2.1 Setup producer/consumer Dev ENV</h2><div id="8e5b"><pre>## Create conda env <span class="hljs-keyword">for</span> Kafka producer <span class="hljs-keyword">and</span> cosumer <span class="hljs-name">C</span>:\Users\feng\Kafka\kraft>conda create -n kafka_env python=<span class="hljs-number">3.10</span> ... <span class="hljs-name">C</span>:\Users\feng\Kafka\kraft>conda activate kafka_env

Install kafka-python <span class="hljs-built_in">package</span>

(kafka_env) <span class="hljs-name">C</span>:\Users\feng\Kafka\kraft>pip install kafka-python ... (kafka_env) <span class="hljs-name">C</span>:\Users\feng\Kafka\kraft>pip list | grep kafka kafka-python <span class="hljs-number">2.0</span><span class="hljs-number">.2</span>

Install Faker <span class="hljs-built_in">package</span> to generate dummy messages

(kafka_env) <span class="hljs-name">C</span>:\Users\feng\Kafka\kraft>pip install Faker ... (kafka_env) <span class="hljs-name">C</span>:\Users<span class="hljs-number">6119811</span>\Kafka\kraft>pip list | grep Faker Faker <span class="hljs-number">17.3</span><span class="hljs-number">.0</span></pre></div><h2 id="6701">2.2 Code examples</h2><p id="c7dc">Now we can use VSCode to create producer/consumer files.</p><p id="fc6a">Producer generate fake user info as JSON load sending to Kafka topic “test_topic”. producer.py is like following.</p><div id="8801"><pre><span class="hljs-keyword">import</span> time <span class="hljs-keyword">import</span> json <span class="hljs-keyword">from</span> datetime <span class="hljs-keyword">import</span> datetime <span class="hljs-keyword">from</span> kafka <span class="hljs-keyword">import</span> KafkaProducer <span class="hljs-keyword">from</span> faker <span class="hljs-keyword">import</span> Faker

<span class="hljs-comment"># JSON messages needs to be serialized</span> <span class="hljs-comment"># when sending to Kafka topic </span> <span class="hljs-keyword">def</span> <span class="hljs-title function_">json_serializer</span>(<span class="hljs-params">message</span>): <span class="hljs-keyword">return</span> json.dumps(message

Options

).encode(<span class="hljs-string">'utf-8'</span>) <span class="hljs-comment"># Kafka Producer</span> producer = KafkaProducer( bootstrap_servers=[<span class="hljs-string">'localhost:9092'</span>], value_serializer=json_serializer ) <span class="hljs-keyword">if</span> name == <span class="hljs-string">'main'</span>: fake = Faker() <span class="hljs-keyword">for</span> i <span class="hljs-keyword">in</span> <span class="hljs-built_in">range</span>(<span class="hljs-number">0</span>, <span class="hljs-number">3</span>): <span class="hljs-comment"># Generate a fake JSON message</span> name = fake.name() email = fake.email() city = fake.city() fake_message = { <span class="hljs-string">"name"</span>: name, <span class="hljs-string">"email"</span>: email, <span class="hljs-string">"city"</span>: city }

    <span class="hljs-comment"># Send fake JSON message to Kafka topic</span>
    <span class="hljs-built_in">print</span>(<span class="hljs-string">f'<span class="hljs-subst">{datetime.now()}</span>: Message = <span class="hljs-subst">{<span class="hljs-built_in">str</span>(fake_message)}</span>'</span>)
    producer.send(<span class="hljs-string">'test_topic'</span>, fake_message)
                                                          
    time.sleep(<span class="hljs-number">1</span>)</pre></div><p id="6594">And here is our consumer.py</p><div id="a19b"><pre><span class="hljs-keyword">import</span> json 

<span class="hljs-keyword">from</span> kafka <span class="hljs-keyword">import</span> KafkaConsumer

<span class="hljs-keyword">if</span> name == <span class="hljs-string">'main'</span>: <span class="hljs-comment"># Kafka Consumer</span> consumer = KafkaConsumer( <span class="hljs-string">'test_topic'</span>, bootstrap_servers=<span class="hljs-string">'localhost:9092'</span>, auto_offset_reset=<span class="hljs-string">'earliest'</span> ) <span class="hljs-keyword">for</span> message <span class="hljs-keyword">in</span> consumer: <span class="hljs-built_in">print</span>(json.loads(message.value))</pre></div><p id="8d09">OK, now let’s start consumer and run producer to send some fake message for a sanity check.</p><div id="572f"><pre><span class="hljs-comment"># Run producer</span> (kafka_env) C:\Users\feng\Kafka\kraft>python producer.py 2023-02-25 18:48:41.143953: Message = {<span class="hljs-string">'name'</span>: <span class="hljs-string">'Susan Best'</span>, <span class="hljs-string">'email'</span>: <span class="hljs-string">'[email protected]'</span>, <span class="hljs-string">'city'</span>: <span class="hljs-string">'Kellytown'</span>} 2023-02-25 18:48:42.160545: Message = {<span class="hljs-string">'name'</span>: <span class="hljs-string">'James Wilson'</span>, <span class="hljs-string">'email'</span>: <span class="hljs-string">'[email protected]'</span>, <span class="hljs-string">'city'</span>: <span class="hljs-string">'Lake Bryanfort'</span>} 2023-02-25 18:48:43.177933: Message = {<span class="hljs-string">'name'</span>: <span class="hljs-string">'Haley Brooks'</span>, <span class="hljs-string">'email'</span>: <span class="hljs-string">'[email protected]'</span>, <span class="hljs-string">'city'</span>: <span class="hljs-string">'East Janetburgh'</span>}

<span class="hljs-comment"># Monitor consumer</span> (kafka_env) C:\Users\feng\Kafka\kraft>python consumer.py {<span class="hljs-string">'name'</span>: <span class="hljs-string">'Susan Best'</span>, <span class="hljs-string">'email'</span>: <span class="hljs-string">'[email protected]'</span>, <span class="hljs-string">'city'</span>: <span class="hljs-string">'Kellytown'</span>} {<span class="hljs-string">'name'</span>: <span class="hljs-string">'James Wilson'</span>, <span class="hljs-string">'email'</span>: <span class="hljs-string">'[email protected]'</span>, <span class="hljs-string">'city'</span>: <span class="hljs-string">'Lake Bryanfort'</span>} {<span class="hljs-string">'name'</span>: <span class="hljs-string">'Haley Brooks'</span>, <span class="hljs-string">'email'</span>: <span class="hljs-string">'[email protected]'</span>, <span class="hljs-string">'city'</span>: <span class="hljs-string">'East Janetburgh'</span>}</pre></div><p id="3143">Great, our Kafka Docker instance and simple applications are working as expected!</p><p id="79d6">Happy Reading!</p><div id="2213" class="link-block"> <a href="https://medium.com/@fengliplatform/membership"> <div> <div> <h2>Join Medium with my referral link - Feng Li</h2> <div><h3>Writing helps ourselves, sharing helps many. It started from study notes for myself with no pressure of perfection…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*K9psL5RefQfuKkzr)"></div> </div> </div> </a> </div></article></body>

Stand up for yourself

Your Negative Emotions Are a Gang of Bullies

And how do we deal with bullies?

Image: cottonbro

When I was young, my Dad gave me some good advice

He said that when facing a gang of bullies, you pick the biggest one and headbutt them in the teeth.

It’s good advice because no one expects you to do that.

Of course, it may not work with a gang of genuinely dangerous people, and you could find yourself in concrete boots as a result. But growing up, most of the bullies we encounter are just bags of hot wind.

In other words, they talk the talk, but they have no substance.

Bullying works because it is dependant on showmanship

And, it is usually successful because humans are predictable.

When you play the numbers game of acting tough, most people back down, especially when the odds are against them.

It takes a rare character to notice the tendency to run away and then do the opposite. When you are in that position, your default action is to plead for your life, and the default action of the bully is to strike fear into your heart with the threat of attack.

But a clever, brave person notices the tendency and switches the role. They become the attacker, and when bullying is a show, the bully tends to change roles quickly as well.

Why emotions are like bullies

I know some tough people who are bullied internally by their negative emotions.

We don’t tend to think of negative emotions as bullies because we still think that we own them — that they are us.

This assumed identification with emotions renders us powerless to fight the bastards. It becomes a mistaken battle with yourself instead, where you get more and more frustrated because you can’t ‘control your own mind’.

The fight against the bully gang of negative emotions begins with acknowledging that they are not you.

To do this, it might help to make characters out of them.

Give anxiety a name such as ‘Garth’. Then give it a personality as this whining, bitching little shit. Make Garth a coward of a gang leader that maintains strength through a big fucking mouth.

Know without a doubt that if Garth was left in a room and it’s just you and him, you could whip that little shit into next week without blinking an eye.

Anxiety, like Garth, is just a word, but through the concept of anxiety, we allow this little bastard Garth to control us.

By giving Garth a name and a personality, next time that fuckhead shows up, we don’t say I am anxious. We say,

Oh, it’s that little bastard Garth again’.

We need to do the same with all the emotions.

When anger arises, don’t think ‘I am angry’.

Instead, give anger a name — Loki or something. When Loki arrives on the scene, you see him visually being an angry spoilt shithead, and you say, Loki, you fuckhead. Nice to see you again, like you are greeting a long-time arch enemy.

Using this method, I have found myself speaking aloud from time to time, saying things like ‘Fuck you, Garth, you little prick’ in public places. I could be anywhere, really — on an escalator at K-Mart or in a noodle restaurant. You might look like a mad bastard but regardless, you must give yourself the freedom to interact with these little bully bastards wherever you are.

You cant let these pricks push you around anymore, cowering into a corner like a little weakling.

Sometimes, I say to Garth,

Come on then, you little prick. You think you’re tough eh? Let’s see what you’ve got.

In saying that I invite Garth to do his worst and it is liberating to watch that little bastard retreat quickly, knowing that all he has is words and fuck all substance to back it up.

Garth’s whole gang is like that. They are literally just words and zero substance.

Image: RODNAE Productions

Like everything, standing up to bullies is a skill that gets easier over time.

And I know some people will read this and go.

‘It’s just not that easy, Frank. You just don’t understand.’

You are wrong. Most of you mistakenly own your anxiety. Some of you wear it like a badge and think that you are special in some way.

You’re not.

And yes, I am speaking from experience, but yes, when you have been bullied by some fucker for a long time, the habit of subservience gets harder and harder to break.

That’s just how abusive relationships work. The groove gets deeper, and you become more and more afraid.

But that’s why we like those films where suddenly, an abused spouse turns on their partner and shoots them in the face.

We love watching the weak become the strong.

Still, it’s impossible in our heads until we get rid of the stupid names like, my anxiety, my anger and instead expose these fucking bullies for the substanceless big mouths that they are.

Give them good names, See their characters in your head, then go after the bastards.

Just shake your head, curl down your mouth like De Niro and say, ‘Are you talkin’ to me?’

There is nothing more substanceless than negative emotions.

They are like irritating tenants who eat all of your food and leave shitstains in your toilet but never pay any rent.

While they run your house you will never get a moment’s peace.

Time to kick those fuckers out and claim your home as yours once more.

We don’t surrender to bullies. We pick the biggest one and attack first.

Sign up for my free newsletter. That’s where I put all the really good stuff.

And sign up for Medium AKA ‘The Hollywood Boulevard of writing’ would ya? $5 a month to support millions of literary prostitutes like me. Maybe even become one yourself?

Also, do you like books, kind Sir/Madam/Other? How about bald, penis rocket spacemen who sell books? If so, visit my author page at the cracked head gasket of the economy AKA cockrocket.com.

More from Frank T Bird:

Bullying
Psychology
Emotions
Mental Health
The Bad Influence
Recommended from ReadMedium