How do Process 3rd Party Data?
-
- Joomla! Enthusiast
- Posts: 241
- Joined: Thu Feb 25, 2010 4:37 pm
How do Process 3rd Party Data?
My Gov Publish OpenData who can used by everyone. Some of them get Updated Automaticly every 5, 10, 20, 30, 60,... Minutes and other every Day.
The 3 most used Files: CSV (1306), shp (558), JSON (437)
so 99% of the Data need to proceed and make it smooth and cosy to fit together. The Main Problem every City, Districts, federal State,... desired what the Publish or not. That mean I have to deal with different formats for the same Topic.
Next Problem is other Data (like Postcode Data for example) must be cominded.
Any idea how to make? It must run 24/7 w/o any user input.
Thanks
The 3 most used Files: CSV (1306), shp (558), JSON (437)
so 99% of the Data need to proceed and make it smooth and cosy to fit together. The Main Problem every City, Districts, federal State,... desired what the Publish or not. That mean I have to deal with different formats for the same Topic.
Next Problem is other Data (like Postcode Data for example) must be cominded.
Any idea how to make? It must run 24/7 w/o any user input.
Thanks
- sone12
- Joomla! Champion
- Posts: 5446
- Joined: Wed Oct 11, 2006 1:12 pm
- Location: Kristiansand, Norway
- Contact:
Re: How do Process 3rd Party Data?
If you want to collect and use data from multiple services, you will always see that the services have their own way to do things, and you will always need to do a lot of coding to format the data to fit your own application.
What you can do, is to ask each service the try follow some kind of standards and so on. Maybe you can show them your needs, and what they can do better to not make trouble for you.
What you can do, is to ask each service the try follow some kind of standards and so on. Maybe you can show them your needs, and what they can do better to not make trouble for you.
Kristian P. Granrud
-
- Joomla! Enthusiast
- Posts: 241
- Joined: Thu Feb 25, 2010 4:37 pm
Re: How do Process 3rd Party Data?
Nope its simple everyone can do whit the Data what but he have to find a solution to use it.
The are "just" CSV Files but the need to processed. The only Solution I would know is when I process them on a Virtual Linux at Home. (I dont know how or if it will work. I never use a Linux System before.)
But how to get the Data into the Homepage?! I would say the best thing is get the Data into a SQL Database.
But how to get the Data into the SQL Database?
The are "just" CSV Files but the need to processed. The only Solution I would know is when I process them on a Virtual Linux at Home. (I dont know how or if it will work. I never use a Linux System before.)
But how to get the Data into the Homepage?! I would say the best thing is get the Data into a SQL Database.
But how to get the Data into the SQL Database?
- sone12
- Joomla! Champion
- Posts: 5446
- Joined: Wed Oct 11, 2006 1:12 pm
- Location: Kristiansand, Norway
- Contact:
Re: How do Process 3rd Party Data?
You can read and write csv content with e.g php code. If you want to put the content into a database is up you you, but you dont need to. A good startingpoint is fgetcsv() to get/read the content, and then you can do what you want, print it out og save to database or both. There is also complete scripts shared and free for you to use, on git and in composer.
Kristian P. Granrud
-
- Joomla! Enthusiast
- Posts: 241
- Joined: Thu Feb 25, 2010 4:37 pm
Re: How do Process 3rd Party Data?
Cool but how does it look like in the end?
Something like this: In the Joomla Group from Germany I have to argue around who I not want to show it like the picture above.
It have to be integrated smoothly what no one know which System is behind. And I have to add a Copyright.
Something like this: In the Joomla Group from Germany I have to argue around who I not want to show it like the picture above.
It have to be integrated smoothly what no one know which System is behind. And I have to add a Copyright.
You do not have the required permissions to view the files attached to this post.
- sone12
- Joomla! Champion
- Posts: 5446
- Joined: Wed Oct 11, 2006 1:12 pm
- Location: Kristiansand, Norway
- Contact:
Re: How do Process 3rd Party Data?
Sure you can output the content from a csv like that, in a table. But you need to add some javascript to get those filters on top.
Kristian P. Granrud
-
- Joomla! Enthusiast
- Posts: 241
- Joined: Thu Feb 25, 2010 4:37 pm
Re: How do Process 3rd Party Data?
nnnnnnnnnnnoooooooooooo I dont want them in a Table!!!!
I will make my Subpage like the Wikipedia Page: https://en.wikipedia.org/wiki/Linz
with Weather and other Realtime Data.
I will make my Subpage like the Wikipedia Page: https://en.wikipedia.org/wiki/Linz
with Weather and other Realtime Data.
- sone12
- Joomla! Champion
- Posts: 5446
- Joined: Wed Oct 11, 2006 1:12 pm
- Location: Kristiansand, Norway
- Contact:
Re: How do Process 3rd Party Data?
You uploaded a picture of a table, and I answered you that you can get it like that if you wantMyFirstPage wrote:nnnnnnnnnnnoooooooooooo I dont want them in a Table!!!!
I will make my Subpage like the Wikipedia Page: https://en.wikipedia.org/wiki/Linz
with Weather and other Realtime Data.
Basicly, when you have loaded the content from csv into php, you probably have it as an object or an array. You can do what ever you want with it. You can print it as a table, create joomla articles of it, you can manipulate it before printing, save it to database, print it as a list, send it as email or something else. It is all about your php skillz and fantasy.
Of course, you can also connect and send needed data to a weather station rest service, and get information about the weather and such.
Kristian P. Granrud
-
- Joomla! Enthusiast
- Posts: 241
- Joined: Thu Feb 25, 2010 4:37 pm
Re: How do Process 3rd Party Data?
Sure I know my English skills are not the best.
Is there any Information how to do it?
Both are 0.It is all about your php skillz and fantasy.
Is there any Information how to do it?
-
- Joomla! Champion
- Posts: 5923
- Joined: Tue Aug 23, 2005 1:56 pm
- Location: South coast, UK
- Contact:
Re: How do Process 3rd Party Data?
Might be useful: https://dba.stackexchange.com/questions ... l-database
https://gadsolutions.biz Electrical services
https://electrical-testing-safety.co.uk Testing services
https://electrical-testing-safety.co.uk Testing services
-
- Joomla! Enthusiast
- Posts: 241
- Joined: Thu Feb 25, 2010 4:37 pm
Re: How do Process 3rd Party Data?
thx I dont understand it that much buy i will save it for later.