Free AI web copilot to create summaries, insights and extended knowledge, download it at here

Abstract

ime.datetime.now()), 'price': price, 'item': item, 'discount': discount }</pre></div>In our case, the output is:<div id="477f"><pre>{ 'date': '2018-05-13 13:37:21.414342', 'price': ' $169.99', 'item': 'Dyson AM08 Bladeless Pedestal Fan | White/Silver | Refurbished', 'discount': '$ 399.99 | 57% off' }</pre></div><h1 id="8e42">Step 2: Saving to S3</h1>To save our result to S3, we use <a href="https://boto3.readthedocs.io/en/latest/index.html">Boto 3</a>, the AWS SDK for Python. First we get a reference to S3. Then we create an <code>object</code> with given <code>bucket</code> and <code>file_name</code>(the bucket was created beforehand though this can be done programmatically). Finally, we convert our data to <code>json</code> and write our <code>data</code> into the object.<div id="acf2"><pre>import boto3 import json</pre></div><div id="34fd"><pre>def save_file_to_s3(bucket, file_name, data): s3 = boto3.resource('s3') obj = s3.Object(bucket, file_name) obj.put(Body=json.dumps(data))</pre></div>We will package this utility function in the handler file where we house the actual function Lambda will call. More on this in the following steps.Incidentally, if saving tabular data as in our example, we might choose a database instead of S3. We illustrate S3 here as it is also a good choice for documents, we are also frequently scraped items.<h1 id="dd59">Step 3: The Handler Function</h1>A Lambda function needs a <a href="https://docs.aws.amazon.com/lambda/latest/dg/python-programming-model-handler-types.html">handler function</a>, which is the function Lambda will execute when it gets called. We will put the handler function, along with our Python dependencies, in a sub-directory called <code>ebay_deal_scraper</code>. This will allow us to separate the files which will be part of the Lambda package, and ancillary project files such as the Serverless config file discussed in later steps.We name our handler function <code>scrape</code> and give it the signature required by Lambda. We don’t use the <code>event</code> or <code>context</code> parameters, but if you needed to pass data into your Lambda function, they are what you would use.<div id="2ee8"><pre>def scrape(event, context): data = deal_scrape() file_name = f"deals-{data['date']}" save_file_to_s3('ebay_daily_deals', file_name, data)</pre></div>Our handler calls our <code>deal_scrape()</code> function, then writes the returned data to S3 under a file name based on the date.<h1 id="6b1f">Step 4: Packaging our Function</h1>Our custom code is ready to go, but Lambda also requires you include your dependencies in the package you upload to AWS. In our case this means <code>pip installing</code> our Python packages locally. In the <code>ebay_deal_scrapper</code> directory, we run:<div id="bc42"><pre>pip3 install requests bs4 -t .</pre></div>(if you have any problems, see this <a href="https://stackoverflow.com/questions/24257803/distutilsoptionerror-must-supply-either-home-or-prefix-exec-prefix-not-both">Stack Overflow issue</a>)This will install the <code>requests</code> and <code>beatiful soup</code> packages in our directory. Lamdba has<code>boto3</code> pre-installed, so you don’t need to include it.Incidentally, including dependencies can be quite hairy if you require platform-dependent C/C++ libraries like <a href="https://www.boost.org/">Boost</a>, and may require you to use Docker to bundle everything together under the Amazon Linux OS that Lambda requires. But that’s the topic of another blog post.When you have dependencies, you probably want to use a zip file to package everything up. We give ours the generic name of <code>package.zip</code>:<div id="f3ce"><pre>zip -r package.zip *</pre></div><h1 id="b305">Step 5: Deploying to Lambda</h1>We will use the Serverless framework to deploy to AWS. Serverless offers a set of command line tools which make it very easy to deploy to the major serverless cloud providers including AWS. You can install it using <code>npm</code>:<code>npm install -g serverless</code>You specify Serverless deployment instructions in a file called <code>serverless.yml</code>. If you want to generate a boilerplate file, you can run:<div id="4295"><pre>serverless create --template aws-python</pre></div>This will also create a boilerplate<code>handler.py</code> file, but all we need there is the function which we specify i

Options

n the <code>serverless.yml</code> config file under the <code>functions</code> section.<div id="7831"><pre>service: ebay-deal-scraper provider: name: aws runtime: python3.6 package: artifact: ebay_deal_scraper/package.zip functions: ebay_scrape: handler: handler.scrape</pre></div>The <code>provider</code> section tells Serverless we’re deploying to AWS and that we’re using <code>python 3.6</code>.The <code>package</code> section is where we specify the zip file we created in the last step.We are ready to deploy!From the top directory of your project run:<div id="d1ed"><pre>serverless deploy</pre></div>If you have multiple AWS profiles (such as work and personal), you can specify a profile:<div id="981f"><pre>serverless deploy --aws-profile profile_i_want_to_use</pre></div>If all goes well, you should get the following output:<div id="4f5e"><pre>➜ ebay-deals-scrape git:(master) ✗ sd --aws-profile michael Serverless: Packaging service... Serverless: Uploading CloudFormation file to S3... Serverless: Uploading artifacts... Serverless: Validating template... Serverless: Updating Stack... Serverless: Checking Stack update progress... ......... Serverless: Stack update finished... Service Information service: ebay-deal-scraper stage: dev region: us-east-1 stack: ebay-deal-scraper-dev api keys: None endpoints: None functions: ebay_scrape: ebay-deal-scraper-dev-ebay_scrape Serverless: Removing old service versions...</pre></div>You can now try to invoke your function with:<div id="b911"><pre>serverless invoke -f ebay_scrape # --aws_profile profile_name </pre></div>This will result in an AccessDenied error. To fix this, you need to add permission to your Lambda function’s role (this gets created together with the function).<h1 id="da14">Step 6: Giving Lambda S3 Privileges</h1>Go to the Roles page in the IAM section of the AWS dashboard. Find the role for your Lambda function, in our case <code>ebay-deal-scraper-dev-us-east-1-lambdaRole</code> and add a policy which allows it to access S3. <code>AmazonS3FullAccess</code> will work for our demo, though in production you may want to create a new policy which is more restrictive.Once your function is deployed you should also be able to view and test it from the AWS console.<figure id="dc68"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*A1uCWEB2Hb-YS7lMEiXCww.png"><figcaption></figcaption></figure><h1 id="6080">Step 7: Scheduling the Lambda Function Using CloudWatch</h1>Final step! Go to the CloudWatch Management Page and click the<code>Rules</code> tab. Under Event Source, select <code>Schedule</code> and fill in a cron expression. We set ours to run every day at 6PM GMT, or afternoon in US Eastern Time. Next, in the <code>Targets</code> section, choose <code>Lambda function</code> in the select and then your Lambda function from the list in the <code>Function</code> select. You’re done!<figure id="1595"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*amgaVqAlsAl0pQdYaAP_PA.png"><figcaption></figcaption></figure>That’s the whirlwind tour of scraping the serverless way. I hope this gives a taste of the technologies involved, though each of them could be the subject of many, many blog posts.As far as scraping goes, with the rise of big data/machine learning, data acquisition is becoming more and more important. And if, for instance, you wanted to do something like feed your machine learning model with data to <a href="https://www.dataquest.io/blog/machine-learning-tutorial/">make price predictions for AirBnB</a>, scraping might be your only option. The serverless architecture exemplified here offers an efficient way to do this.</article></body>

The Reinterpretation of Emojis

Towards a New Iconography

The expansion and adoption of new emoji palates gives people a chance to use pictures rather than words to express themselves. As a society we are in the process of collectively determining what some symbols mean. The perverse among you are already well acquainted with peaches and eggplants. Before too many emojis fall to a similar fate, I want to get my two cents in. I would like to propose that the following emojis be used to express the ideas, concepts, and states of being that I find hard to express otherwise:

Emoji Name: Sleepy Face Gutbloom Name: Achoo Meaning: I just sneezed and now, somewhere around here, there is an wet wad of mucus waiting to be discovered. Let’s hope it’s not on my groin.

Emoji Name: Raised Fist Gutbloom Name: Wank Hand Meaning: The person speaking is wasting my time, and I’d like to either go get a sandwich or check my Medium stats.

Emoji Name: Right Pointing backhand index Gutbloom Name: Blame Game, right Meaning: The sense of quiet confidence that comes when someone is about to blame you for something, but you are already more than prepared to deflect the blame by saying that they should talk to Tom, who is sitting right over there.

Emoji Name: Bikini Gutbloom Name: Vampire Swimsuit Meaning: The invisibility that you feel even though you are the only person in the room wearing shitty clothes and whose waist is bigger than their shoulders.

Emoji Name: Lipstick Gutbloom Name: Red Rocket Meaning: The dog is excited

Emoji Name: Mouse Face Gutbloom Name: Rattenkönig Meaning: Death

Emoji Name: Hamster Face Gutbloom Name: The Banker Meaning: A special kind of debt awareness. The feeling that comes after knowing you are in debt and then buying a [n] online, where n = a matador suit, a model of the HMS victory, or one month access to nakedscubawomen.com.

Emoji Name: Rabbit Face Gutbloom Name: The Bunny Meaning: Sexual humiliation

Emoji Name: Cow Face Gutbloom Name: Braunvieh Meaning: Love, Devotion, Surrender

Emoji Name: Pig Face Gutbloom Name: Pig Face Meaning: The excitement that comes from knowing you are about to have a humiliatingly good time

Emoji Name: New moon Gutbloom Name: Black Spot Meaning: I’m depressed

Emoji Name: New moon with face Gutbloom Name: Trying hard Meaning: I’m depressed, but I have you fooled because I’m smiling

Emoji Name: Waxing gibbous moon Gutbloom Name: Waxing Depression Meaning: I might be sick, or tired, or… maybe I’m getting depressed

Emoji Name: Waning gibbous moon Gutbloom Name: Waning depression Meaning: I feel a little less awful, maybe I’ll go to work today… if I still have a job

Emoji Name: Full moon with face Gutbloom Name: Happy man Meaning: I think I might be happy, but I don’t trust it enough to say it.

Emoji Name: Hot dog Gutbloom Name: Lips & Assholes Meaning: Comfort, specifically, food comfort

Emoji Name: Hamburger Gutbloom Name: Hamburg Meaning: Acceptance, specifically, total existential acceptance

Emoji Name: Bread Gutbloom Name: Carb Loaf Meaning: Not only do I want to eat all of the carbs before me, but once again I am stunned by the recognition that the world is made of carbs

Emoji Name: Soft ice cream Gutbloom Name: Carvel Meaning: My belly is full of gas. I hope nobody gets close to me.

Emoji Name: Doughnut Gutbloom Name: The circle of life Meaning: A special kind of self-hatred. The self-hatred that comes from knowingly indulging in self-destructive behavior.

Emoji Name: Circus Tent Gutbloom Name: Work place Meaning: The paralysis that develops when your work place is so crazy you just read Medium all day on your computer. The tent symbolizes the fact that you work with clowns, strong men, and animals.

Emoji Name: Slot Machine Gutbloom Name: Conversational jackpot Meaning: The boredom you experience when someone completely ignores your over-the-top social signals (looking away, checking your watch, exhaling loudly) and continues to talk even though you have clearly communicated that you have no interest in what they are saying. Slot emoji is the shorthand version of, “I hit ‘blah, blah, blah’ on the conversational slot machine.”

Emoji Name: Soccer Ball Gutbloom Name: Flop Meaning: The special gratitude you feel when someone, like my wife, has sex with you even though they aren’t into it. Why a soccer ball? Because soccer is the game in which players “flop”, or go down with great drama and enthusiasm to help out their teammates, but nobody is buying it.