Free AI web copilot to create summaries, insights and extended knowledge, download it at here

5243

Abstract

name">C:\Users\feng\Kafka\kraft>ls docker-compose.yml C:\Users\feng\Kafka\kraft>docker-compose up -d [+] Running 2/2

Network kraft_default Created 0.0s
Container kraft-kafka-1 Started

C:\Users\feng\Kafka\kraft>docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 54342e49a1f2 bitnami/kafka:latest "/opt/bitnami/script…" 18 seconds ago Up 17 seconds 0.0.0.0:9092->9092/tcp kraft-kafka-1 0.5s</pre></div><h2 id="095a">1.5 Create Kafka topic</h2>We’ll login to the instance and create a test topic in Kafka<div id="aaf2"><pre>## Login to Kafka docker instance C:\Users\feng\Kafka\kraft>docker exec -it kraft-kafka-1 /bin/bash $cd /opt/bitnami/kafka /opt/bitnami/kafka$ ./bin/kafka-topics.sh --version 3.4.0 (Commit:2e1947d240607d53)

## Create topic named "test_topic" /opt/bitnami/kafka$ ./bin/kafka-topics.sh --bootstrap-server localhost:9092 --create --replication-factor 1 --partitions 2 --topic test_topic WARNING: Due to limitations in metric names, topics with a period ('.') or underscore ('_') could collide. To avoid issues it is best to use either, but not both. Created topic test_topic.

## List current topics /opt/bitnami/kafka$ ./bin/kafka-topics.sh --bootstrap-server localhost:9092 --list test_topic</pre></div>So by now we have a Kafka docker instance running successfully.<h1 id="80ee">2 Run sanity checks using simple producer/consumer app codes</h1><h2 id="b504">2.1 Setup producer/consumer Dev ENV</h2><div id="8e5b"><pre>## Create conda env for Kafka producer and cosumer C:\Users\feng\Kafka\kraft>conda create -n kafka_env python=3.10 ... C:\Users\feng\Kafka\kraft>conda activate kafka_env

Install kafka-python package

(kafka_env) C:\Users\feng\Kafka\kraft>pip install kafka-python ... (kafka_env) C:\Users\feng\Kafka\kraft>pip list | grep kafka kafka-python 2.0.2

Install Faker package to generate dummy messages

(kafka_env) C:\Users\feng\Kafka\kraft>pip install Faker ... (kafka_env) C:\Users6119811\Kafka\kraft>pip list | grep Faker Faker 17.3.0</pre></div><h2 id="6701">2.2 Code examples</h2>Now we can use VSCode to create producer/consumer files.Producer generate fake user info as JSON load sending to Kafka topic “test_topic”. producer.py is like following.<div id="8801"><pre>import time import json from datetime import datetime from kafka import KafkaProducer from faker import Faker

# JSON messages needs to be serialized # when sending to Kafka topic def json_serializer(message): return json.dumps(message

Options

).encode('utf-8') # Kafka Producer producer = KafkaProducer( bootstrap_servers=['localhost:9092'], value_serializer=json_serializer ) if name == 'main': fake = Faker() for i in range(0, 3): # Generate a fake JSON message name = fake.name() email = fake.email() city = fake.city() fake_message = { "name": name, "email": email, "city": city }

    <span class="hljs-comment"># Send fake JSON message to Kafka topic</span>
    <span class="hljs-built_in">print</span>(<span class="hljs-string">f'<span class="hljs-subst">{datetime.now()}</span>: Message = <span class="hljs-subst">{<span class="hljs-built_in">str</span>(fake_message)}</span>'</span>)
    producer.send(<span class="hljs-string">'test_topic'</span>, fake_message)
                                                          
    time.sleep(<span class="hljs-number">1</span>)</pre></div><p id="6594">And here is our consumer.py</p><div id="a19b"><pre><span class="hljs-keyword">import</span> json

from kafka import KafkaConsumer

if name == 'main': # Kafka Consumer consumer = KafkaConsumer( 'test_topic', bootstrap_servers='localhost:9092', auto_offset_reset='earliest' ) for message in consumer: print(json.loads(message.value))</pre></div>OK, now let’s start consumer and run producer to send some fake message for a sanity check.<div id="572f"><pre># Run producer (kafka_env) C:\Users\feng\Kafka\kraft>python producer.py 2023-02-25 18:48:41.143953: Message = {'name': 'Susan Best', 'email': '[email protected]', 'city': 'Kellytown'} 2023-02-25 18:48:42.160545: Message = {'name': 'James Wilson', 'email': '[email protected]', 'city': 'Lake Bryanfort'} 2023-02-25 18:48:43.177933: Message = {'name': 'Haley Brooks', 'email': '[email protected]', 'city': 'East Janetburgh'}

# Monitor consumer (kafka_env) C:\Users\feng\Kafka\kraft>python consumer.py {'name': 'Susan Best', 'email': '[email protected]', 'city': 'Kellytown'} {'name': 'James Wilson', 'email': '[email protected]', 'city': 'Lake Bryanfort'} {'name': 'Haley Brooks', 'email': '[email protected]', 'city': 'East Janetburgh'}</pre></div>Great, our Kafka Docker instance and simple applications are working as expected!Happy Reading!<div id="2213" class="link-block"> <a href="https://medium.com/@fengliplatform/membership"> <div> <div> <h2>Join Medium with my referral link - Feng Li</h2> <div><h3>Writing helps ourselves, sharing helps many. It started from study notes for myself with no pressure of perfection…</h3></div> <div>medium.com</div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*K9psL5RefQfuKkzr)"></div> </div> </div> </a> </div></article></body>

Explore 10 features of Copilot that you should leverage in 2024!!

Microsoft has introduced Copilot, and its capabilities are remarkable. If you haven’t embraced it yet, you’re lagging behind.

Explore Top 10 features of Copilot that you should leverage in 2024:

𝟭. 𝗖𝗼𝗽𝗶𝗹𝗼𝘁 𝗣𝗿𝗼 → Access the cutting-edge capabilities of AI, empowering you to create your own Copilot GPTs.

𝟮. 𝗣𝗼𝘄𝗲𝗿𝗣𝗼𝗶𝗻𝘁 → Transform Word documents into PowerPoint presentations. → Generate fresh slides within an existing presentation guided by prompts. → Utilize natural language to enhance slide text, formatting, animations, and layout. → Condense extensive presentations into concise key slides.

𝟯. 𝗕𝗶𝗻𝗴 𝗖𝗵𝗮𝘁 𝗶𝘀 𝗻𝗼𝘄 𝗖𝗼𝗽𝗶𝗹𝗼𝘁 → Seamlessly compatible with Edge, Chrome, Safari, and your mobile phone, it offers accessibility across various platforms. → Delve into its latest AI features here.

𝟰. 𝗘𝘅𝗰𝗲𝗹 → Apply pertinent formulas and calculations to data prompted. → Generate visualizations, such as charts and graphs, to depict data. → Summarize trends and insights derived from data analysis. → Model potential scenarios through what-if analysis.

𝟱. 𝗚𝗣𝗧-𝟰 𝗽𝗼𝘄𝗲𝗿𝘀 𝗖𝗼𝗽𝗶𝗹𝗼𝘁 𝗖𝗵𝗮𝘁 → Engage in direct chat within your code editor to write code and obtain faster answers. → Facilitate the detection of security vulnerabilities and the identification and resolution of errors in code, terminal, and debugger.

𝟲. 𝗔𝗜-𝗽𝗼𝘄𝗲𝗿𝗲𝗱 𝘀𝗲𝗰𝘂𝗿𝗶𝘁𝘆 → Copilot can also assist in identifying security vulnerabilities within the IDE and promptly provide easy fixes.

𝟳. 𝗖𝗼𝗽𝗶𝗹𝗼𝘁 𝗦𝘁𝘂𝗱𝗶𝗼 → Build custom AI assistants that integrate seamlessly with Microsoft 365. → Train these AI assistants using your personal information and files. → Configure these AI helpers for use across various websites and systems. → Achieve this without requiring programming knowledge.

𝟴. 𝗢𝘂𝘁𝗹𝗼𝗼𝗸 → Condense unread emails and email threads into concise summaries. → Modify the tone and length of email responses with straightforward prompts. → Schedule follow-ups and develop agendas based on prior email conversations. → Provide recommendations for meeting attendees, agendas, and relevant documents during meeting preparation.

𝟵. 𝗪𝗼𝗿𝗱 → Generate Word documents effortlessly using basic prompts. → Revise sections of text or entire documents for conciseness or to align with a specific tone. → Summarize the most significant edits and changes made to a document. → Condense lengthy Word documents, extracting key information for easy reference.

𝟭𝟬. 𝗧𝗲𝗮𝗺𝘀 → Provides real-time recaps and insights during meetings upon request. → Takes notes throughout meetings, capturing essential points and action items. → Generates chats and adjusts tone in response to prompts. → Creates agendas and suggests discussion points based on prior conversations

𝟭𝟭. 𝗖𝗼𝗱𝗲 𝗜𝗻𝘁𝗲𝗿𝗽𝗿𝗲𝘁𝗲𝗿 Execute intricate tasks including: → Enhanced precision in calculations → Advanced data analysis → Dynamic visualization → Proficient coding → Mathematical operations and beyond.

Microsoft is currently collecting feedback on these features from a specific group of users and intends to introduce them to a broader audience in the near future.

Install kafka-python <span class="hljs-built_in">package</span>

Install Faker <span class="hljs-built_in">package</span> to generate dummy messages

Explore 10 features of Copilot that you should leverage in 2024!!