DavidDeSchmikes
Full Member
- Joined
- Jan 20, 2013
- Messages
- 17,387
He's fecked it up so bad
It usually refers to using bots or other scripts to automatically scan and/or download data from a website.Can someone explain to me what data scraping is and why that means people have to be limited to viewing X amount of tweets per day?
Data scraping is a big topic right now because of LLM like Chat GPT which derive intelligence by churning a large amount of data that is scrapped from the web by bots. It is similar to how search indexes like Google work but for LLMs, the dependency on actual content or data is huge. Now sites like Reddit and Twitter, are not happy that companies like Open AI are getting free access to their data and then getting value from tools like ChatGPT. This is also the reason behind recent Reddit API changes.Can someone explain to me what data scraping is and why that means people have to be limited to viewing X amount of tweets per day?
People were getting data from Twitter using their APIs. Which are sometimes provided for this very reason. Scraping from the actual website is very load intensive and also very difficult to guard against. Twitter paywalled their backend APIs, so people started scraping which probably affected Twitter's performance.Can someone explain to me what data scraping is and why that means people have to be limited to viewing X amount of tweets per day?
Tweet
— Twitter API (@user) date
@Eboue
Your post is just hating a billionaire for what billionaires do. Which is fair enough. That’s your perogative. As billionaires go, Musk’s likely legacy puts him miles ahead of almost all of his peers in terms of having a positive affect on the world. So it just comes across as a bit predictable and unfair to single him out for your bile. If you care about the future of the planet anyway.
So long as billionaires exist (and they’re not going away any time soon) the world needs more billionaires like him and less like the anonymous 1%ers locking down crazy fortunes for their progeny, without giving a shit about anyone else.
More billionaires like Musk?@Eboue
Your post is just hating a billionaire for what billionaires do. Which is fair enough. That’s your perogative. As billionaires go, Musk’s likely legacy puts him miles ahead of almost all of his peers in terms of having a positive affect on the world. So it just comes across as a bit predictable and unfair to single him out for your bile. If you care about the future of the planet anyway.
So long as billionaires exist (and they’re not going away any time soon) the world needs more billionaires like him and less like the anonymous 1%ers locking down crazy fortunes for their progeny, without giving a shit about anyone else.
Let's not forget that he's a true man of the people and stands up for the little man against corrupt elites.@Eboue
Your post is just hating a billionaire for what billionaires do. Which is fair enough. That’s your perogative. As billionaires go, Musk’s likely legacy puts him miles ahead of almost all of his peers in terms of having a positive affect on the world. So it just comes across as a bit predictable and unfair to single him out for your bile. If you care about the future of the planet anyway.
So long as billionaires exist (and they’re not going away any time soon) the world needs more billionaires like him and less like the anonymous 1%ers locking down crazy fortunes for their progeny, without giving a shit about anyone else.
This is a dangerous game you're playing, friend. I played it myself not long ago.@Eboue
Your post is just hating a billionaire for what billionaires do. Which is fair enough. That’s your perogative. As billionaires go, Musk’s likely legacy puts him miles ahead of almost all of his peers in terms of having a positive affect on the world. So it just comes across as a bit predictable and unfair to single him out for your bile. If you care about the future of the planet anyway.
So long as billionaires exist (and they’re not going away any time soon) the world needs more billionaires like him and less like the anonymous 1%ers locking down crazy fortunes for their progeny, without giving a shit about anyone else.
So metaRight on, @berbatrick.
first few pages of that thread are goldThis is a dangerous game you're playing, friend. I played it myself not long ago.
He's certainly the greatest entrepreneur of our time and for me the biggest polymath in centuries.
They're either too deep in it to admit they're wrong or they're true believers and cultish.I find it amusing how there’s still a huge number of people who pretend that they really trust Musk with this, despite virtually all the signs pointing to him having absolutely zero clue how to manage Twitter.
Dickheads will pay to write shit far greater numbers than intelligent people will. It’s make it worse.A Twittermeter to pay as you write/read would solve the sh*tposting/cesspit issue in disguise imho?
Right on, @berbatrick.
Data scraping is a big topic right now because of LLM like Chat GPT which derive intelligence by churning a large amount of data that is scrapped from the web by bots. It is similar to how search indexes like Google work but for LLMs, the dependency on actual content or data is huge. Now sites like Reddit and Twitter, are not happy that companies like Open AI are getting free access to their data and then getting value from tools like ChatGPT. This is also the reason behind recent Reddit API changes.
I appreciate your responses, but I want you to know, I don’t know what the above in bold meansPeople were getting data from Twitter using their APIs. Which are sometimes provided for this very reason. Scraping from the actual website is very load intensive and also very difficult to guard against. Twitter paywalled their backend APIs, so people started scraping which probably affected Twitter's performance.
This is more my speedIt usually refers to using bots or other scripts to automatically scan and/or download data from a website.
it doesn’t
Thanks for that explanation of what age level responses should be geared to. I am in the same boat!I appreciate your responses, but I want you to know, I don’t know what the above in bold means
I think I need this explained in terms like I’m a 10 year old
This is more my speed
LLM means large language models, basically ChatGPT. When ChatGPT answers your queries, it has learnt to model that answer, partly from the data it downloaded it from websites like reddit. Scrapping data from web basically involves hitting different web URLs and parsing all the text you can download through a web page to extract useful content.I appreciate your responses, but I want you to know, I don’t know what the above in bold means
I think I need this explained in terms like I’m a 10 year old
This is more my speed
Entrepreneur I'd agree with, as long as we all accept he hasn't actually started a company and was born rich though. The recent washing of his history on that front is gross.He's certainly the greatest entrepreneur of our time and for me the biggest polymath in centuries.
I appreciate your responses, but I want you to know, I don’t know what the above in bold means
I think I need this explained in terms like I’m a 10 year old
This is more my speed
You know when you take a poster off the wall and some of the blutack is left? Well imagine taking all that blutack left and combining it into a huge ball, then giving it the the smartest child in the class to make a replica of the Sistine chapel.Thanks for that explanation of what age level responses should be geared to. I am in the same boat!
First thing I learned as a HS teacher, know your audience.This is more my speed
Tweet
— Twitter API (@user) date
@Eboue
Your post is just hating a billionaire for what billionaires do. Which is fair enough. That’s your perogative. As billionaires go, Musk’s likely legacy puts him miles ahead of almost all of his peers in terms of having a positive affect on the world. So it just comes across as a bit predictable and unfair to single him out for your bile. If you care about the future of the planet anyway.
So long as billionaires exist (and they’re not going away any time soon) the world needs more billionaires like him and less like the anonymous 1%ers locking down crazy fortunes for their progeny, without giving a shit about anyone else.
Ahhhh… so the machine is learning to give answers & learning what to say / how to mimic human responses by reading Twitter & Reddit and the like (unless I’m reading that incorrectly)LLM means large language models, basically ChatGPT. When ChatGPT answers your queries, it has learnt to model that answer, partly from the data it downloaded it from websites like reddit. Scrapping data from web basically involves hitting different web URLs and parsing all the text you can download through a web page to extract useful content.
So basically Elon is banging his head against the wall here. Seems par for the course for his tenure has ruler of the TwittersphereYou know when you take a poster off the wall and some of the blutack is left? Well imagine taking all that blutack left and combining it into a huge ball, then giving it the the smartest child in the class to make a replica of the Sistine chapel.
Then deciding you don't like that child nor the scraps of tack, so you think the best way to combat it is to let them still take the blutack but just a tiny bit slower and hoping the problem goes away.
My man!First thing I learned as a HS teacher, know your audience.
Tweet
— Twitter API (@user) date
Tweet
— Twitter API (@user) date
This is Elon's contention when he says he is worried about data scrappers. In reality, Twitter is probably not an important source of data for ChatGPT, Reddit much more so probably. But in general now all companies will start guarding their data with a lot more intent.Ahhhh… so the machine is learning to give answers & learning what to say / how to mimic human responses by reading Twitter & Reddit and the like (unless I’m reading that incorrectly)
Is Elon’s beef with this the fact that ChatGPT is profiting off of this learning?
"He is also cool"first few pages of that thread are gold
Tweet
— Twitter API (@user) date