zexodus

I'm so tired of these...

Is there really no way we can make it technologically impossible for them to exfiltrate user data?

zexodus

2 anni fadiscuss

> the wood where my mouse was kept attracting weird black spots

Have the same issue, but can't subscribe to mousepads. I believe that's dust getting in the crevices of the wood.

zexodus

2 anni fadiscuss

Context size limits are usually the reason. Most websites I want to scrape end up being over 200K tokens. Tokenization for HTML isn't optimal because symbols like '<', '>', '/', etc. end up being separate tokens, whereas whole words can be one token if we're talking about plain text.

Possible approaches include transforming the text to MD or minimizing the HTML (e.g., removing script tags, comments, etc.).

zexodus

2 anni fadiscuss

It's possible to capture the DOM by running a headless browser (i.e. with chromedriver/geckodriver), allowing the js execute and then saving the HTML.

If these readers do not use already rendered HTML to parse the information on the screen, then...

zexodus

2 anni fadiscuss

I thought the left brain/right brain gibberish was debunked years ago.

zexodus

2 anni fadiscuss

It performed surprisingly well at categorization tasks where json results where involved compared to gemma:2b and gemma:7b

zexodus

2 anni fadiscuss

TypeSpec is great, but if you're working with Rust and you're about to write a new project that will require an OpenApi spec sooner or later, I'd like to recommend a web framework that has spec generation baked in:

https://github.com/poem-web/poem (see poem_openapi)

All you need to do is derive a trait on your response structs and in return you get an almost perfectly generated spec. Unions, objects, enums are first class citizens.

Also, if you're from coming from PHP, the controllers feel very much like symfony controllers.

P.s. Please do recommend an ORM that would feel closer to doctrine. I miss doctrine.

zexodus

2 anni fadiscuss

Every single time I see these scraping discussions I get the same thoughts:

Businesses use data from the user. The Business does additional crunching on that data to derive new interesting data for the user. Who owns the data? The user or the app?

At the very least the user partially owns the data and as such, I'd argue that the user should have the right to share the data between different applications however they see fit. However, businesses tend to think that they somehow have the legal (moral even?) right to keep that data in their walled gardens. For as long as this (imo unfair) stance is common, I think that data extraction by use of these anti-bot-bypassing technologies is fair game.

zexodus

3 anni fadiscuss

The technology would also be killer in real estate markets. Imagine being able to take a video and give potential tenants the ability to see the apartment/house/etc in detail.

zexodus

3 anni fadiscuss

I was about to throw some money down their way, but apparently the steam version does not work on Mac M1/M2. I'm too young/uninitiated/whatever/visually_oriented to play the older version.

zexodus

3 anni fadiscuss

It's possible to use an algorithmic approach (i.e. linear regression) to derive the weights for each of these factors.

zexodus

4 anni fadiscuss

Perhaps the most important thing about Jellyfin is that it's open source. I really wish the project received a little bit more love.

zexodus

5 anni fadiscuss

I wonder how they'd respond to a GDPR request.

zexodus

5 anni fadiscuss

Research like this could lead to IDE's suggesting names for some of our methods. Exciting!

zexodus

5 anni fadiscuss

Anybody looking for a team member?

zexodus

6 anni fadiscuss

Hello deandree,

Almost a year ago I've had pretty much an identical idea. Ultimately I got discouraged by the thought that historical data does not correlate with actual stock performance.

Nonetheless, I'm very proud of you for managing to release this product, regardless of the critique you get in this thread.

Best of luck in the future.

zexodus

6 anni fadiscuss

This article reminds me that I don't really know what I want to do in the first place.

zexodus

7 anni fadiscuss

Paywalled. Please provide a mirror.

zexodus

7 anni fadiscuss

Electroboom (Electronics) https://m.youtube.com/user/msadaghd

zexodus

9 anni fadiscuss

my screens are somewhat too bright if i want to do work at night so

   #!/bin/bash                                                                       
   xrandr --output DVI-I-1 --brightness $1                                      
   xrandr --output HDMI-0 --brightness $1  
   xrandr --output DVI-D-0 --brightness $1                      
~

Submissions

DiIiS: Diablo III open-source server

Web Scraping in a Nutshell: The How, When, and Why Answered

comments