Importing and syncing contents with feeds module
Download as PPTX, PDF0 likes146 views
The document discusses the functionalities and use cases of a data importing and syncing module developed by Mihail Shahov, aimed at integrating large sets of external data into a site. It outlines various fetching, parsing, and processing methods, as well as potential use cases such as building activity streams and managing commerce products. Additionally, it addresses common challenges in data importation, including data quality and formatting issues.
Importing and syncing contents with feeds module
- 1. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis Importing and syncing contents with Feeds module By Mihail Shahov
- 2. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis About me > Mihail Shahov ( ShaxA ) > PHP Developer since 2009 > Senior Drupal Developer at FFW > Soon Acquia certificated Drupal developer > Will be co-lector with Vasil Boychev for Drupal course starting January 2016.
- 3. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis Basic description and use cases > Purpose > To get large sets of data from outside your site … into your site! > Use cases > Build Activity streams using feeds from Twitter, Facebook, Linkedin or etc. > Batch import sets of nodes, terms and users from a file or third party sites > Import of Commerce Products or simply updating stock levels for them > Whatever your imagination wants to import
- 4. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis
- 5. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis FETCHER PARSER PROCESSOR IMPORTER
- 6. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis
- 7. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis FETCHER PARSER PROCESSOR Where should I get the data from? How would I read and interpret the data? What should I do with the data? File upload, external RSS feed, etc. CSV, XLS, XML, RSS, etc. Create nodes, users, terms, etc.
- 8. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis
- 9. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis Fetchers > File upload > HTTP Fetcher > Directory fetcher > OAuth > Clients Fetcher > SOAP / WDSL More: https://www.drupal.org/node/856644
- 10. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis
- 11. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis Parsers > RSS > XML > CSV > XPath > Flickr, YouTube, Vimeo, Pinterest, Slideshare > JSON > Clients parser More: https://www.drupal.org/node/856644
- 12. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis
- 13. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis Processors > Node > Taxonomy > User > Comment > Commerce product More: https://www.drupal.org/node/856644
- 14. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis
- 15. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis Mapping Source Target Provided from parser Provided from processor Eaxmples “title” column in CSV Node title <ArticleContent> in XML Article body
- 16. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis Feeds Tamper > Replace every instance of a word > Filter items based on keywords or vocabularies > Make every letter uppercase, lowercase, or capitalize every first letter > Break a comma separated list of words into Taxonomy terms or a multivalued text field > Combine separate 'firstname' and 'lastname' fields into one 'name' field > Convert urls from relative to absolute > Many more
- 17. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis Common problems > Avoiding duplicate data > You need good data for import > Data formatting > Character encoding > CSV, Spreadsheets > Broken urls
- 18. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis Feeds plugins Feeds is using the Ctools plugin system - Fetcher plugins - Parser plugins - Processor plugins Write your own plugin - each of the three main plugins extends FeedsPlugin class and then they are extended by other classes. Extend the plugins to meet your requirements
- 19. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis
- 20. Formerly known as Bysted, Propeople, Blink Reaction, Chainbizz and Geekpolis
- 21. Thank you We can meet again soon!!!