Total Posts: 23
The solution depends on where the master source of data is stored and the type of data required such as product, categories, orders, customers. Point-to-point extensions are not designed to handle high volumes with multiple channels and flexibility.
The standard business solution for this is ETL Extraction, Transformation & Load (also known as middleware) which is a conversion process from one source application to one or more target applications though a centralised solution. The principle of ETL is to provide a dynamic framework that can be adapted to each business as they have different requirements, different categorisation, workflows, attributes, currencies, pricing rules,etc.
Starting with the simplest solution which is an extension, this provides a fixed point-to-point conversion normally in a fixed format between one application to another such as Amazon to Magento or Magento to Sage. Limitations include upgrades, not supporting required fields, no facility for custom rules, single source and single target, etc., therefore is not ETL.
ETL is a mid-level solution and dynamic environment where reference data is stored such as category to category mappings and mapping rules, the data passes through a conversion routine and via connectors processes the data to the target. There is normally a single master source for each data type (product, customer, order) and potentially multiple targets depending on the ETL solution.
The last and most complex is ESB or Enterprise Service Bus which is similar to ETL but converts the data to a fixed common format, this allows multiple applications to receive the data as needed and process it accordingly thereby separating the applications from each other.
The process that you are trying to perform is ETL or ESB and used by most mid to large size companies, with all the complexities of data mapping, conversion formats, API calls, etc. We have solutions: CoreETL - simplified source to multiple target ETL which can process almost 3million records per day; MDM which is a repository for master data such as products, categories, vendors and synchronised to applications; ETL to pass data between applications including orders, customers, products. We need to point out that the ETL tools we use already have pre-built connectors to applications such as Sage, SugarCRM, NetSuite, SAP, Salesforce allowing integration in days instead of months as with custom and point-to-point solutions.
All our products support Magento simple, grouped & configurable products and we are able to support Amazon, eBay and other marketplaces, however these are for larger sites who must process tens of thousands of records usually through multiple channels so most likely not suitable for yourselves. Having implemented solutions in all sizes of company, we recommend that you try and find off-the-shelf solutions. Point-to-point extensions will hit limits in both processing and design very quickly, what you really need are ETL solutions and these are normally complex to design, build and were the sole domain of enterprise companies, hence the lack of solutions on the market and their cost.