So I want to a program something to scrape/store data (lets say words mentioned on twitter, a linear regression of price with X, past chart data ) as well as do basic operating like trading on the market
Would SQL + Python be good enough? What about SQL + JS?
Im a new programmer so I only know a little of all the languages and im not sure which route to go
Her or she?
Sup Forums
>Sup Forums
Gay
python + sql is fine. You will need html css js to display the data.
I suggest an mvc framework as well.
vanebp19, mom of two.
Whats a good mvp framework? Im new to this and I just want to get a hold of what I need to learn
>JS
>R (for more complicated statistics)
>SQL
>Python
>CSS and HTML
And then whatever an MVP framework is?
Anything else?
Im basically a second year in University so I have some 2-3 to finish this up in my spare time.
>Whats a good mvp framework? Im new to this and I just want to get a hold of what I need to learn
>>JS
>>R (for more complicated statistics)
>>SQL
>>Python
>>CSS and HTML
>And then whatever an MVP framework is?
>Anything else?
>Im basically a second year in University so I have some 2-3 to finish this up in my spare time.
You can do all of this with python + sql3 and flask or django for web framework
Sqlite3
So the essentials to learn are python and sql?
The rest is gray?
Yeah, python is not hard and if you know logic and English SQL is a breeze
Keep everything in as few systems as possible and don't mix languages
Thanks user your help means a lot
Any tips? Can I integrate R for complicated statistics or can it be done in python?
Is 2-3 years a good enough project scope in time?
R is useless if you know python. I rec python as well. Go search for libraries such as numpy to help you with the job.
Yes it's doable in just 1 summer I think.
Jesus christ 2-3 years?
as
said
A summer should be enough
R is way superior to python if you wanna implement sophisticated statistics (basically cuz community is heavy stats-oriented). But for OP demands python is fine.
Pro tip for op, go with twython instead of tweepy for twitter scraping
>tfw i dont get it how sqlite works
>it doesnt store data on server
>how does it stay saved anywhere
lel noob
What back end are you using
its just that i never used sqlite and i've heared that it is different thing from MySQL and others...
I was using Laravel since forever
Idk what you're trying to do. Are you trying to store data from a web page? Or are just trying to set up SQLite through its command line
well it would help a lot if i could just understand how is sqlite different from for example MySQL/MariaDB
and why to use it
I mean if I have some website where users post many images, comments ,and stuff should I use sqlite?
I was using MariaDB and started wondering about sqlite
SQLite is for small to medium projects it's pretty simple nothing too crazy. If you can use other DB systems you should def be able to use sqlite. There might not be any reason to change tho in your case not sure how scalable you plan your app being
so basically sqlite saves data in a text file? like fopen?
Muh loop reliance.
I'm pretty sure it uses a DB file at least that's what happened when I used it
what could be the core difference then? I mean difference between sqlite and MySQL-like RDMSs
>Whats a good mvp framework
Python with Flask and SQLAlchemy
what could be the core difference then?
It's stored in a DB file instead of running on a server, and sqlite has less features than MySQL.
It's for really small and lightweight projects.
Python is too slow for trading and a decent scrapper, because of the frameworks availabe, but has terrible regex capabilities. You don't even have to learn SQL here either. A simple JSON/XML file would be sufficient if your querries are basic. JS is fine if you're doing strict mode, it's automatically better than Python, just by virtue of being a compiled language.
I recently was scrapping twitter, but I went with Perl, because it's just too painful to work with Regex in Python. Also, are you in the North East?
>It's stored in a DB file instead of running on a server
well now i know that this is the thing that i dont understand
i thought that MySQL is stored in a file that runs on a server
In SQLAlchemy you do something like this:
engine = create_engine('sqlite:///sqlalchemy_example.db')
instead of
engine = create_engine('mysql:///192.168.0.1:3306')
So in sqlite the file needs to be on the same machine, hope that makes sense.
Wait wait does this mean that DB is located somewhere locally? In users's browser?(i know it doesnt make sense but im confused)
The code I posted is server side, so in the case of web, no. But if you developed a desktop app and used sqlite, the user that downloaded your program would have a .db file on his machine.
got it, thanks user